2023-02-09 20:53:36,610 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.mob.compactions.TestMobCompactor timeout: 13 mins 2023-02-09 20:53:36,875 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c2e7a7e1-d76d-10d1-eb7e-79dd8ea5a0ce 2023-02-09 20:53:36,888 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=1, rsPorts=, rsClass=null, numDataNodes=1, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-02-09 20:53:36,888 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c2e7a7e1-d76d-10d1-eb7e-79dd8ea5a0ce/cluster_fa6f1a2e-f8e7-684c-e5cc-577d8df2e8bf, deleteOnExit=true 2023-02-09 20:53:36,888 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-09 20:53:36,889 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c2e7a7e1-d76d-10d1-eb7e-79dd8ea5a0ce/test.cache.data in system properties and HBase conf 2023-02-09 20:53:36,889 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c2e7a7e1-d76d-10d1-eb7e-79dd8ea5a0ce/hadoop.tmp.dir in system properties and HBase conf 2023-02-09 20:53:36,890 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c2e7a7e1-d76d-10d1-eb7e-79dd8ea5a0ce/hadoop.log.dir in system properties and HBase conf 2023-02-09 20:53:36,890 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c2e7a7e1-d76d-10d1-eb7e-79dd8ea5a0ce/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-09 20:53:36,891 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c2e7a7e1-d76d-10d1-eb7e-79dd8ea5a0ce/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-09 20:53:36,891 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-09 20:53:37,010 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-02-09 20:53:37,430 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-09 20:53:37,434 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c2e7a7e1-d76d-10d1-eb7e-79dd8ea5a0ce/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-09 20:53:37,435 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c2e7a7e1-d76d-10d1-eb7e-79dd8ea5a0ce/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-09 20:53:37,435 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c2e7a7e1-d76d-10d1-eb7e-79dd8ea5a0ce/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-09 20:53:37,435 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c2e7a7e1-d76d-10d1-eb7e-79dd8ea5a0ce/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-09 20:53:37,435 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c2e7a7e1-d76d-10d1-eb7e-79dd8ea5a0ce/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-09 20:53:37,436 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c2e7a7e1-d76d-10d1-eb7e-79dd8ea5a0ce/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-09 20:53:37,436 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c2e7a7e1-d76d-10d1-eb7e-79dd8ea5a0ce/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-09 20:53:37,436 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c2e7a7e1-d76d-10d1-eb7e-79dd8ea5a0ce/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-09 20:53:37,437 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c2e7a7e1-d76d-10d1-eb7e-79dd8ea5a0ce/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-09 20:53:37,437 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c2e7a7e1-d76d-10d1-eb7e-79dd8ea5a0ce/nfs.dump.dir in system properties and HBase conf 2023-02-09 20:53:37,437 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c2e7a7e1-d76d-10d1-eb7e-79dd8ea5a0ce/java.io.tmpdir in system properties and HBase conf 2023-02-09 20:53:37,437 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c2e7a7e1-d76d-10d1-eb7e-79dd8ea5a0ce/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-09 20:53:37,438 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c2e7a7e1-d76d-10d1-eb7e-79dd8ea5a0ce/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-09 20:53:37,438 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c2e7a7e1-d76d-10d1-eb7e-79dd8ea5a0ce/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-09 20:53:37,991 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-09 20:53:37,996 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-09 20:53:38,296 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-02-09 20:53:38,466 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-02-09 20:53:38,482 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-09 20:53:38,528 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-02-09 20:53:38,563 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c2e7a7e1-d76d-10d1-eb7e-79dd8ea5a0ce/java.io.tmpdir/Jetty_localhost_36197_hdfs____73gn06/webapp 2023-02-09 20:53:38,719 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:36197 2023-02-09 20:53:38,769 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-09 20:53:38,769 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-09 20:53:39,254 WARN [Listener at localhost/34119] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-09 20:53:39,349 WARN [Listener at localhost/34119] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-09 20:53:39,368 WARN [Listener at localhost/34119] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-09 20:53:39,376 INFO [Listener at localhost/34119] log.Slf4jLog(67): jetty-6.1.26 2023-02-09 20:53:39,380 INFO [Listener at localhost/34119] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c2e7a7e1-d76d-10d1-eb7e-79dd8ea5a0ce/java.io.tmpdir/Jetty_localhost_37031_datanode____.r8z0q7/webapp 2023-02-09 20:53:39,480 INFO [Listener at localhost/34119] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:37031 2023-02-09 20:53:39,800 WARN [Listener at localhost/46855] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-09 20:53:40,233 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xa7c43a9aa778b465: Processing first storage report for DS-89f67f0d-ac57-4656-9e77-8187578c8881 from datanode 4947dc58-e5b7-43d6-abae-ca3f0a22a31e 2023-02-09 20:53:40,235 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xa7c43a9aa778b465: from storage DS-89f67f0d-ac57-4656-9e77-8187578c8881 node DatanodeRegistration(127.0.0.1:43431, datanodeUuid=4947dc58-e5b7-43d6-abae-ca3f0a22a31e, infoPort=38751, infoSecurePort=0, ipcPort=46855, storageInfo=lv=-57;cid=testClusterID;nsid=464422074;c=1675976018075), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-02-09 20:53:40,235 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xa7c43a9aa778b465: Processing first storage report for DS-622ac627-2a00-437c-8b49-154649269a25 from datanode 4947dc58-e5b7-43d6-abae-ca3f0a22a31e 2023-02-09 20:53:40,235 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xa7c43a9aa778b465: from storage DS-622ac627-2a00-437c-8b49-154649269a25 node DatanodeRegistration(127.0.0.1:43431, datanodeUuid=4947dc58-e5b7-43d6-abae-ca3f0a22a31e, infoPort=38751, infoSecurePort=0, ipcPort=46855, storageInfo=lv=-57;cid=testClusterID;nsid=464422074;c=1675976018075), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-09 20:53:40,287 DEBUG [Listener at localhost/46855] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c2e7a7e1-d76d-10d1-eb7e-79dd8ea5a0ce 2023-02-09 20:53:40,346 INFO [Listener at localhost/46855] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c2e7a7e1-d76d-10d1-eb7e-79dd8ea5a0ce/cluster_fa6f1a2e-f8e7-684c-e5cc-577d8df2e8bf/zookeeper_0, clientPort=62089, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c2e7a7e1-d76d-10d1-eb7e-79dd8ea5a0ce/cluster_fa6f1a2e-f8e7-684c-e5cc-577d8df2e8bf/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c2e7a7e1-d76d-10d1-eb7e-79dd8ea5a0ce/cluster_fa6f1a2e-f8e7-684c-e5cc-577d8df2e8bf/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-09 20:53:40,360 INFO [Listener at localhost/46855] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=62089 2023-02-09 20:53:40,367 INFO [Listener at localhost/46855] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 20:53:40,369 INFO [Listener at localhost/46855] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 20:53:41,020 INFO [Listener at localhost/46855] util.FSUtils(479): Created version file at hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c with version=8 2023-02-09 20:53:41,020 INFO [Listener at localhost/46855] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/hbase-staging 2023-02-09 20:53:41,321 INFO [Listener at localhost/46855] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-02-09 20:53:41,769 INFO [Listener at localhost/46855] client.ConnectionUtils(127): master/jenkins-hbase9:0 server-side Connection retries=3 2023-02-09 20:53:41,800 INFO [Listener at localhost/46855] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 20:53:41,800 INFO [Listener at localhost/46855] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-09 20:53:41,801 INFO [Listener at localhost/46855] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-09 20:53:41,801 INFO [Listener at localhost/46855] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 20:53:41,801 INFO [Listener at localhost/46855] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-09 20:53:41,939 INFO [Listener at localhost/46855] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-09 20:53:42,015 DEBUG [Listener at localhost/46855] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-02-09 20:53:42,107 INFO [Listener at localhost/46855] ipc.NettyRpcServer(120): Bind to /172.31.2.10:42951 2023-02-09 20:53:42,117 INFO [Listener at localhost/46855] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 20:53:42,119 INFO [Listener at localhost/46855] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 20:53:42,140 INFO [Listener at localhost/46855] zookeeper.RecoverableZooKeeper(93): Process identifier=master:42951 connecting to ZooKeeper ensemble=127.0.0.1:62089 2023-02-09 20:53:42,179 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:429510x0, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-09 20:53:42,181 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:42951-0x1003add715a0000 connected 2023-02-09 20:53:42,207 DEBUG [Listener at localhost/46855] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-09 20:53:42,208 DEBUG [Listener at localhost/46855] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 20:53:42,211 DEBUG [Listener at localhost/46855] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-09 20:53:42,219 DEBUG [Listener at localhost/46855] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=42951 2023-02-09 20:53:42,219 DEBUG [Listener at localhost/46855] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=42951 2023-02-09 20:53:42,220 DEBUG [Listener at localhost/46855] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=42951 2023-02-09 20:53:42,220 DEBUG [Listener at localhost/46855] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=42951 2023-02-09 20:53:42,220 DEBUG [Listener at localhost/46855] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=42951 2023-02-09 20:53:42,226 INFO [Listener at localhost/46855] master.HMaster(439): hbase.rootdir=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c, hbase.cluster.distributed=false 2023-02-09 20:53:42,294 INFO [Listener at localhost/46855] client.ConnectionUtils(127): regionserver/jenkins-hbase9:0 server-side Connection retries=3 2023-02-09 20:53:42,295 INFO [Listener at localhost/46855] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 20:53:42,295 INFO [Listener at localhost/46855] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-09 20:53:42,295 INFO [Listener at localhost/46855] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-09 20:53:42,295 INFO [Listener at localhost/46855] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-09 20:53:42,295 INFO [Listener at localhost/46855] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-09 20:53:42,300 INFO [Listener at localhost/46855] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-09 20:53:42,303 INFO [Listener at localhost/46855] ipc.NettyRpcServer(120): Bind to /172.31.2.10:40919 2023-02-09 20:53:42,305 INFO [Listener at localhost/46855] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-09 20:53:42,311 DEBUG [Listener at localhost/46855] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-09 20:53:42,312 INFO [Listener at localhost/46855] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 20:53:42,315 INFO [Listener at localhost/46855] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 20:53:42,316 INFO [Listener at localhost/46855] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:40919 connecting to ZooKeeper ensemble=127.0.0.1:62089 2023-02-09 20:53:42,319 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:409190x0, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-09 20:53:42,321 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:40919-0x1003add715a0001 connected 2023-02-09 20:53:42,321 DEBUG [Listener at localhost/46855] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-09 20:53:42,322 DEBUG [Listener at localhost/46855] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 20:53:42,323 DEBUG [Listener at localhost/46855] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-09 20:53:42,323 DEBUG [Listener at localhost/46855] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=40919 2023-02-09 20:53:42,324 DEBUG [Listener at localhost/46855] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=40919 2023-02-09 20:53:42,324 DEBUG [Listener at localhost/46855] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=40919 2023-02-09 20:53:42,324 DEBUG [Listener at localhost/46855] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=40919 2023-02-09 20:53:42,325 DEBUG [Listener at localhost/46855] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=40919 2023-02-09 20:53:42,327 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase9.apache.org,42951,1675976021166 2023-02-09 20:53:42,335 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-09 20:53:42,337 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase9.apache.org,42951,1675976021166 2023-02-09 20:53:42,355 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-09 20:53:42,355 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-09 20:53:42,355 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 20:53:42,356 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-09 20:53:42,357 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase9.apache.org,42951,1675976021166 from backup master directory 2023-02-09 20:53:42,357 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-09 20:53:42,360 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase9.apache.org,42951,1675976021166 2023-02-09 20:53:42,360 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-09 20:53:42,361 WARN [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-09 20:53:42,361 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase9.apache.org,42951,1675976021166 2023-02-09 20:53:42,364 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-02-09 20:53:42,365 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-02-09 20:53:42,445 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/hbase.id with ID: 6f12777d-3d71-49a9-8796-d936271b0a95 2023-02-09 20:53:42,489 INFO [master/jenkins-hbase9:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 20:53:42,505 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 20:53:42,545 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x03d96e17 to 127.0.0.1:62089 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 20:53:42,585 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3f2d4fd2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 20:53:42,615 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-09 20:53:42,617 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-09 20:53:42,637 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-02-09 20:53:42,638 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-02-09 20:53:42,640 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:849) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2178) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:523) at java.lang.Thread.run(Thread.java:750) 2023-02-09 20:53:42,644 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:849) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2178) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:523) at java.lang.Thread.run(Thread.java:750) 2023-02-09 20:53:42,645 INFO [master/jenkins-hbase9:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-09 20:53:42,679 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/MasterData/data/master/store-tmp 2023-02-09 20:53:42,712 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 20:53:42,713 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-09 20:53:42,713 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 20:53:42,713 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 20:53:42,713 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-09 20:53:42,713 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 20:53:42,714 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 20:53:42,714 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1675976022712Disabling compacts and flushes for region at 1675976022713 (+1 ms)Disabling writes for close at 1675976022713Writing region close event to WAL at 1675976022714 (+1 ms)Closed at 1675976022714 2023-02-09 20:53:42,715 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/MasterData/WALs/jenkins-hbase9.apache.org,42951,1675976021166 2023-02-09 20:53:42,737 INFO [master/jenkins-hbase9:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C42951%2C1675976021166, suffix=, logDir=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/MasterData/WALs/jenkins-hbase9.apache.org,42951,1675976021166, archiveDir=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/MasterData/oldWALs, maxLogs=10 2023-02-09 20:53:42,793 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43431,DS-89f67f0d-ac57-4656-9e77-8187578c8881,DISK] 2023-02-09 20:53:42,800 DEBUG [RS-EventLoopGroup-3-2] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-02-09 20:53:42,858 INFO [master/jenkins-hbase9:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/MasterData/WALs/jenkins-hbase9.apache.org,42951,1675976021166/jenkins-hbase9.apache.org%2C42951%2C1675976021166.1675976022751 2023-02-09 20:53:42,859 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:43431,DS-89f67f0d-ac57-4656-9e77-8187578c8881,DISK]] 2023-02-09 20:53:42,860 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-09 20:53:42,860 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 20:53:42,863 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-09 20:53:42,864 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-09 20:53:42,918 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-09 20:53:42,924 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-09 20:53:42,948 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-09 20:53:42,960 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 20:53:42,967 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-09 20:53:42,969 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-09 20:53:42,984 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-09 20:53:42,989 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 20:53:42,991 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59265560, jitterRate=-0.1168743371963501}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-09 20:53:42,991 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1675976022889Initializing all the Stores at 1675976022891 (+2 ms)Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675976022891Cleaning up temporary data from old regions at 1675976022976 (+85 ms)Cleaning up detritus from prior splits at 1675976022977 (+1 ms)Region opened successfully at 1675976022991 (+14 ms) 2023-02-09 20:53:42,992 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-09 20:53:43,014 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-09 20:53:43,015 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-09 20:53:43,017 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-09 20:53:43,019 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-02-09 20:53:43,050 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 31 msec 2023-02-09 20:53:43,050 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-09 20:53:43,075 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-09 20:53:43,080 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-09 20:53:43,103 INFO [master/jenkins-hbase9:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-09 20:53:43,107 INFO [master/jenkins-hbase9:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-09 20:53:43,109 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-09 20:53:43,114 INFO [master/jenkins-hbase9:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-09 20:53:43,117 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-09 20:53:43,121 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 20:53:43,122 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-09 20:53:43,123 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-09 20:53:43,134 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-09 20:53:43,139 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-09 20:53:43,139 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-09 20:53:43,139 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 20:53:43,139 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase9.apache.org,42951,1675976021166, sessionid=0x1003add715a0000, setting cluster-up flag (Was=false) 2023-02-09 20:53:43,154 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 20:53:43,160 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-09 20:53:43,161 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase9.apache.org,42951,1675976021166 2023-02-09 20:53:43,167 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 20:53:43,171 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-09 20:53:43,172 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase9.apache.org,42951,1675976021166 2023-02-09 20:53:43,175 WARN [master/jenkins-hbase9:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/.hbase-snapshot/.tmp 2023-02-09 20:53:43,228 INFO [RS:0;jenkins-hbase9:40919] regionserver.HRegionServer(952): ClusterId : 6f12777d-3d71-49a9-8796-d936271b0a95 2023-02-09 20:53:43,233 DEBUG [RS:0;jenkins-hbase9:40919] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-09 20:53:43,239 DEBUG [RS:0;jenkins-hbase9:40919] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-09 20:53:43,240 DEBUG [RS:0;jenkins-hbase9:40919] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-09 20:53:43,243 DEBUG [RS:0;jenkins-hbase9:40919] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-09 20:53:43,243 DEBUG [RS:0;jenkins-hbase9:40919] zookeeper.ReadOnlyZKClient(139): Connect 0x01a9cf94 to 127.0.0.1:62089 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 20:53:43,247 DEBUG [RS:0;jenkins-hbase9:40919] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@f6e31d1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 20:53:43,248 DEBUG [RS:0;jenkins-hbase9:40919] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@b51a4e4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase9.apache.org/172.31.2.10:0 2023-02-09 20:53:43,271 DEBUG [RS:0;jenkins-hbase9:40919] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase9:40919 2023-02-09 20:53:43,275 INFO [RS:0;jenkins-hbase9:40919] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-09 20:53:43,275 INFO [RS:0;jenkins-hbase9:40919] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-09 20:53:43,275 DEBUG [RS:0;jenkins-hbase9:40919] regionserver.HRegionServer(1023): About to register with Master. 2023-02-09 20:53:43,280 INFO [RS:0;jenkins-hbase9:40919] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase9.apache.org,42951,1675976021166 with isa=jenkins-hbase9.apache.org/172.31.2.10:40919, startcode=1675976022294 2023-02-09 20:53:43,286 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-09 20:53:43,296 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-02-09 20:53:43,296 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-02-09 20:53:43,296 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-02-09 20:53:43,297 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-02-09 20:53:43,297 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase9:0, corePoolSize=10, maxPoolSize=10 2023-02-09 20:53:43,297 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-09 20:53:43,297 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=2, maxPoolSize=2 2023-02-09 20:53:43,297 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-09 20:53:43,297 DEBUG [RS:0;jenkins-hbase9:40919] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-09 20:53:43,299 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1675976053299 2023-02-09 20:53:43,302 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-09 20:53:43,305 DEBUG [PEWorker-2] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-09 20:53:43,305 INFO [PEWorker-2] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-09 20:53:43,310 INFO [PEWorker-2] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-09 20:53:43,315 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-09 20:53:43,322 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-09 20:53:43,323 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-09 20:53:43,324 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-09 20:53:43,324 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-09 20:53:43,324 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-09 20:53:43,326 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-09 20:53:43,328 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-09 20:53:43,328 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-09 20:53:43,335 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-09 20:53:43,339 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-09 20:53:43,343 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.large.0-1675976023343,5,FailOnTimeoutGroup] 2023-02-09 20:53:43,344 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.small.0-1675976023344,5,FailOnTimeoutGroup] 2023-02-09 20:53:43,344 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-09 20:53:43,344 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-09 20:53:43,346 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-09 20:53:43,346 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-09 20:53:43,362 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:45505, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-02-09 20:53:43,373 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.ServerManager(394): Registering regionserver=jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:43,387 DEBUG [RS:0;jenkins-hbase9:40919] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c 2023-02-09 20:53:43,387 DEBUG [RS:0;jenkins-hbase9:40919] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost:34119 2023-02-09 20:53:43,387 DEBUG [RS:0;jenkins-hbase9:40919] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-09 20:53:43,392 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-09 20:53:43,392 DEBUG [RS:0;jenkins-hbase9:40919] zookeeper.ZKUtil(162): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:43,393 WARN [RS:0;jenkins-hbase9:40919] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-09 20:53:43,393 INFO [RS:0;jenkins-hbase9:40919] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-09 20:53:43,393 DEBUG [RS:0;jenkins-hbase9:40919] regionserver.HRegionServer(1947): logDir=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/WALs/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:43,394 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase9.apache.org,40919,1675976022294] 2023-02-09 20:53:43,402 DEBUG [RS:0;jenkins-hbase9:40919] zookeeper.ZKUtil(162): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:43,411 DEBUG [RS:0;jenkins-hbase9:40919] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-09 20:53:43,419 INFO [RS:0;jenkins-hbase9:40919] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-09 20:53:43,439 INFO [RS:0;jenkins-hbase9:40919] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-09 20:53:43,442 INFO [RS:0;jenkins-hbase9:40919] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-09 20:53:43,442 INFO [RS:0;jenkins-hbase9:40919] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 20:53:43,443 INFO [RS:0;jenkins-hbase9:40919] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-09 20:53:43,450 INFO [RS:0;jenkins-hbase9:40919] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=100, unit=MILLISECONDS is enabled. 2023-02-09 20:53:43,450 DEBUG [RS:0;jenkins-hbase9:40919] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-09 20:53:43,451 DEBUG [RS:0;jenkins-hbase9:40919] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-09 20:53:43,451 DEBUG [RS:0;jenkins-hbase9:40919] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-09 20:53:43,451 DEBUG [RS:0;jenkins-hbase9:40919] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-09 20:53:43,451 DEBUG [RS:0;jenkins-hbase9:40919] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-09 20:53:43,451 DEBUG [RS:0;jenkins-hbase9:40919] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0, corePoolSize=2, maxPoolSize=2 2023-02-09 20:53:43,451 DEBUG [RS:0;jenkins-hbase9:40919] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-09 20:53:43,451 DEBUG [RS:0;jenkins-hbase9:40919] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-09 20:53:43,452 DEBUG [RS:0;jenkins-hbase9:40919] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-09 20:53:43,452 DEBUG [RS:0;jenkins-hbase9:40919] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-02-09 20:53:43,452 INFO [RS:0;jenkins-hbase9:40919] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-09 20:53:43,453 INFO [RS:0;jenkins-hbase9:40919] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-09 20:53:43,453 INFO [RS:0;jenkins-hbase9:40919] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-09 20:53:43,468 INFO [RS:0;jenkins-hbase9:40919] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-09 20:53:43,470 INFO [RS:0;jenkins-hbase9:40919] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,40919,1675976022294-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 20:53:43,485 INFO [RS:0;jenkins-hbase9:40919] regionserver.Replication(203): jenkins-hbase9.apache.org,40919,1675976022294 started 2023-02-09 20:53:43,485 INFO [RS:0;jenkins-hbase9:40919] regionserver.HRegionServer(1638): Serving as jenkins-hbase9.apache.org,40919,1675976022294, RpcServer on jenkins-hbase9.apache.org/172.31.2.10:40919, sessionid=0x1003add715a0001 2023-02-09 20:53:43,485 DEBUG [RS:0;jenkins-hbase9:40919] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-09 20:53:43,485 DEBUG [RS:0;jenkins-hbase9:40919] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:43,485 DEBUG [RS:0;jenkins-hbase9:40919] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,40919,1675976022294' 2023-02-09 20:53:43,485 DEBUG [RS:0;jenkins-hbase9:40919] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:53:43,486 DEBUG [RS:0;jenkins-hbase9:40919] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:53:43,487 DEBUG [RS:0;jenkins-hbase9:40919] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-09 20:53:43,487 DEBUG [RS:0;jenkins-hbase9:40919] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-09 20:53:43,487 DEBUG [RS:0;jenkins-hbase9:40919] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:43,487 DEBUG [RS:0;jenkins-hbase9:40919] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,40919,1675976022294' 2023-02-09 20:53:43,487 DEBUG [RS:0;jenkins-hbase9:40919] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 20:53:43,487 DEBUG [RS:0;jenkins-hbase9:40919] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 20:53:43,488 DEBUG [RS:0;jenkins-hbase9:40919] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-09 20:53:43,488 INFO [RS:0;jenkins-hbase9:40919] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-09 20:53:43,488 INFO [RS:0;jenkins-hbase9:40919] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-09 20:53:43,598 INFO [RS:0;jenkins-hbase9:40919] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C40919%2C1675976022294, suffix=, logDir=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/WALs/jenkins-hbase9.apache.org,40919,1675976022294, archiveDir=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/oldWALs, maxLogs=32 2023-02-09 20:53:43,616 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43431,DS-89f67f0d-ac57-4656-9e77-8187578c8881,DISK] 2023-02-09 20:53:43,619 INFO [RS:0;jenkins-hbase9:40919] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/WALs/jenkins-hbase9.apache.org,40919,1675976022294/jenkins-hbase9.apache.org%2C40919%2C1675976022294.1675976023601 2023-02-09 20:53:43,620 DEBUG [RS:0;jenkins-hbase9:40919] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:43431,DS-89f67f0d-ac57-4656-9e77-8187578c8881,DISK]] 2023-02-09 20:53:43,748 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-09 20:53:43,749 INFO [PEWorker-2] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-09 20:53:43,749 INFO [PEWorker-2] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c 2023-02-09 20:53:44,163 DEBUG [PEWorker-2] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 20:53:44,166 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-09 20:53:44,168 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/hbase/meta/1588230740/info 2023-02-09 20:53:44,169 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-09 20:53:44,170 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 20:53:44,170 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-09 20:53:44,173 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/hbase/meta/1588230740/rep_barrier 2023-02-09 20:53:44,174 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-09 20:53:44,174 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 20:53:44,175 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-09 20:53:44,177 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/hbase/meta/1588230740/table 2023-02-09 20:53:44,177 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-09 20:53:44,178 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 20:53:44,179 DEBUG [PEWorker-2] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/hbase/meta/1588230740 2023-02-09 20:53:44,180 DEBUG [PEWorker-2] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/hbase/meta/1588230740 2023-02-09 20:53:44,184 DEBUG [PEWorker-2] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-09 20:53:44,186 DEBUG [PEWorker-2] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-09 20:53:44,189 DEBUG [PEWorker-2] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 20:53:44,190 INFO [PEWorker-2] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59266573, jitterRate=-0.11685924232006073}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-09 20:53:44,191 DEBUG [PEWorker-2] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1675976024163Initializing all the Stores at 1675976024165 (+2 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675976024165Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675976024165Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675976024165Cleaning up temporary data from old regions at 1675976024182 (+17 ms)Cleaning up detritus from prior splits at 1675976024183 (+1 ms)Region opened successfully at 1675976024190 (+7 ms) 2023-02-09 20:53:44,191 DEBUG [PEWorker-2] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-09 20:53:44,191 INFO [PEWorker-2] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-09 20:53:44,191 DEBUG [PEWorker-2] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-09 20:53:44,191 DEBUG [PEWorker-2] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-09 20:53:44,191 DEBUG [PEWorker-2] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-09 20:53:44,192 INFO [PEWorker-2] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-09 20:53:44,192 DEBUG [PEWorker-2] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1675976024191Disabling compacts and flushes for region at 1675976024191Disabling writes for close at 1675976024191Writing region close event to WAL at 1675976024192 (+1 ms)Closed at 1675976024192 2023-02-09 20:53:44,196 DEBUG [PEWorker-2] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-09 20:53:44,196 INFO [PEWorker-2] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-09 20:53:44,204 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-09 20:53:44,215 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-09 20:53:44,217 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-09 20:53:44,369 DEBUG [jenkins-hbase9:42951] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=1, allServersCount=1 2023-02-09 20:53:44,372 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase9.apache.org,40919,1675976022294, state=OPENING 2023-02-09 20:53:44,380 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-09 20:53:44,381 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 20:53:44,382 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-09 20:53:44,384 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase9.apache.org,40919,1675976022294}] 2023-02-09 20:53:44,567 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:44,569 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-09 20:53:44,572 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:52308, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-09 20:53:44,584 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-09 20:53:44,584 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-09 20:53:44,588 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C40919%2C1675976022294.meta, suffix=.meta, logDir=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/WALs/jenkins-hbase9.apache.org,40919,1675976022294, archiveDir=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/oldWALs, maxLogs=32 2023-02-09 20:53:44,603 DEBUG [RS-EventLoopGroup-3-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43431,DS-89f67f0d-ac57-4656-9e77-8187578c8881,DISK] 2023-02-09 20:53:44,607 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/WALs/jenkins-hbase9.apache.org,40919,1675976022294/jenkins-hbase9.apache.org%2C40919%2C1675976022294.meta.1675976024589.meta 2023-02-09 20:53:44,608 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:43431,DS-89f67f0d-ac57-4656-9e77-8187578c8881,DISK]] 2023-02-09 20:53:44,608 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-09 20:53:44,610 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-09 20:53:44,626 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-09 20:53:44,631 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-09 20:53:44,636 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-09 20:53:44,637 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 20:53:44,637 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-09 20:53:44,637 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-09 20:53:44,639 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-09 20:53:44,641 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/hbase/meta/1588230740/info 2023-02-09 20:53:44,641 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/hbase/meta/1588230740/info 2023-02-09 20:53:44,642 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-09 20:53:44,643 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 20:53:44,643 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-09 20:53:44,644 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/hbase/meta/1588230740/rep_barrier 2023-02-09 20:53:44,644 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/hbase/meta/1588230740/rep_barrier 2023-02-09 20:53:44,645 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-09 20:53:44,646 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 20:53:44,646 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-09 20:53:44,647 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/hbase/meta/1588230740/table 2023-02-09 20:53:44,648 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/hbase/meta/1588230740/table 2023-02-09 20:53:44,648 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-09 20:53:44,649 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 20:53:44,650 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/hbase/meta/1588230740 2023-02-09 20:53:44,653 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/hbase/meta/1588230740 2023-02-09 20:53:44,657 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-09 20:53:44,660 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-09 20:53:44,661 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70654036, jitterRate=0.05282717943191528}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-09 20:53:44,662 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1675976024637Writing region info on filesystem at 1675976024637Initializing all the Stores at 1675976024639 (+2 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675976024639Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675976024639Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675976024639Cleaning up temporary data from old regions at 1675976024655 (+16 ms)Cleaning up detritus from prior splits at 1675976024656 (+1 ms)Running coprocessor post-open hooks at 1675976024661 (+5 ms)Region opened successfully at 1675976024661 2023-02-09 20:53:44,671 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1675976024559 2023-02-09 20:53:44,688 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-09 20:53:44,688 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-09 20:53:44,689 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase9.apache.org,40919,1675976022294, state=OPEN 2023-02-09 20:53:44,692 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-09 20:53:44,692 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-09 20:53:44,695 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-09 20:53:44,696 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase9.apache.org,40919,1675976022294 in 308 msec 2023-02-09 20:53:44,700 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-09 20:53:44,700 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 493 msec 2023-02-09 20:53:44,705 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.4860 sec 2023-02-09 20:53:44,705 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1675976022351, completionTime=-1 2023-02-09 20:53:44,705 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=1; waited=0ms, expected min=1 server(s), max=1 server(s), master is running 2023-02-09 20:53:44,705 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-09 20:53:44,766 DEBUG [hconnection-0x728232e6-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 20:53:44,770 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:52324, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 20:53:44,786 INFO [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=1 2023-02-09 20:53:44,787 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1675976084787 2023-02-09 20:53:44,787 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1675976144787 2023-02-09 20:53:44,787 INFO [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 81 msec 2023-02-09 20:53:44,808 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,42951,1675976021166-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 20:53:44,809 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,42951,1675976021166-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-09 20:53:44,809 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,42951,1675976021166-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-09 20:53:44,810 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase9:42951, period=300000, unit=MILLISECONDS is enabled. 2023-02-09 20:53:44,811 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-09 20:53:44,816 DEBUG [master/jenkins-hbase9:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-09 20:53:44,824 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-09 20:53:44,825 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-09 20:53:44,835 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-09 20:53:44,837 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-09 20:53:44,840 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-09 20:53:44,863 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/.tmp/data/hbase/namespace/d516db36738f07b6767e3c994ea08b05 2023-02-09 20:53:44,866 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/.tmp/data/hbase/namespace/d516db36738f07b6767e3c994ea08b05 empty. 2023-02-09 20:53:44,867 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/.tmp/data/hbase/namespace/d516db36738f07b6767e3c994ea08b05 2023-02-09 20:53:44,867 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-09 20:53:45,289 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-09 20:53:45,291 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => d516db36738f07b6767e3c994ea08b05, NAME => 'hbase:namespace,,1675976024825.d516db36738f07b6767e3c994ea08b05.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/.tmp 2023-02-09 20:53:45,304 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1675976024825.d516db36738f07b6767e3c994ea08b05.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 20:53:45,304 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing d516db36738f07b6767e3c994ea08b05, disabling compactions & flushes 2023-02-09 20:53:45,305 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1675976024825.d516db36738f07b6767e3c994ea08b05. 2023-02-09 20:53:45,305 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1675976024825.d516db36738f07b6767e3c994ea08b05. 2023-02-09 20:53:45,305 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1675976024825.d516db36738f07b6767e3c994ea08b05. after waiting 0 ms 2023-02-09 20:53:45,305 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1675976024825.d516db36738f07b6767e3c994ea08b05. 2023-02-09 20:53:45,305 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1675976024825.d516db36738f07b6767e3c994ea08b05. 2023-02-09 20:53:45,305 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for d516db36738f07b6767e3c994ea08b05: Waiting for close lock at 1675976025304Disabling compacts and flushes for region at 1675976025304Disabling writes for close at 1675976025305 (+1 ms)Writing region close event to WAL at 1675976025305Closed at 1675976025305 2023-02-09 20:53:45,309 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-09 20:53:45,324 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1675976024825.d516db36738f07b6767e3c994ea08b05.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675976025312"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675976025312"}]},"ts":"1675976025312"} 2023-02-09 20:53:45,351 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-09 20:53:45,353 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-09 20:53:45,357 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675976025353"}]},"ts":"1675976025353"} 2023-02-09 20:53:45,362 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-09 20:53:45,371 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=d516db36738f07b6767e3c994ea08b05, ASSIGN}] 2023-02-09 20:53:45,374 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=d516db36738f07b6767e3c994ea08b05, ASSIGN 2023-02-09 20:53:45,376 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=d516db36738f07b6767e3c994ea08b05, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,40919,1675976022294; forceNewPlan=false, retain=false 2023-02-09 20:53:45,527 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=d516db36738f07b6767e3c994ea08b05, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:45,527 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1675976024825.d516db36738f07b6767e3c994ea08b05.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675976025526"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675976025526"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675976025526"}]},"ts":"1675976025526"} 2023-02-09 20:53:45,531 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure d516db36738f07b6767e3c994ea08b05, server=jenkins-hbase9.apache.org,40919,1675976022294}] 2023-02-09 20:53:45,691 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1675976024825.d516db36738f07b6767e3c994ea08b05. 2023-02-09 20:53:45,692 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => d516db36738f07b6767e3c994ea08b05, NAME => 'hbase:namespace,,1675976024825.d516db36738f07b6767e3c994ea08b05.', STARTKEY => '', ENDKEY => ''} 2023-02-09 20:53:45,693 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace d516db36738f07b6767e3c994ea08b05 2023-02-09 20:53:45,693 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1675976024825.d516db36738f07b6767e3c994ea08b05.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 20:53:45,693 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for d516db36738f07b6767e3c994ea08b05 2023-02-09 20:53:45,693 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for d516db36738f07b6767e3c994ea08b05 2023-02-09 20:53:45,695 INFO [StoreOpener-d516db36738f07b6767e3c994ea08b05-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region d516db36738f07b6767e3c994ea08b05 2023-02-09 20:53:45,697 DEBUG [StoreOpener-d516db36738f07b6767e3c994ea08b05-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/hbase/namespace/d516db36738f07b6767e3c994ea08b05/info 2023-02-09 20:53:45,697 DEBUG [StoreOpener-d516db36738f07b6767e3c994ea08b05-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/hbase/namespace/d516db36738f07b6767e3c994ea08b05/info 2023-02-09 20:53:45,698 INFO [StoreOpener-d516db36738f07b6767e3c994ea08b05-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d516db36738f07b6767e3c994ea08b05 columnFamilyName info 2023-02-09 20:53:45,698 INFO [StoreOpener-d516db36738f07b6767e3c994ea08b05-1] regionserver.HStore(310): Store=d516db36738f07b6767e3c994ea08b05/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 20:53:45,700 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/hbase/namespace/d516db36738f07b6767e3c994ea08b05 2023-02-09 20:53:45,701 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/hbase/namespace/d516db36738f07b6767e3c994ea08b05 2023-02-09 20:53:45,705 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for d516db36738f07b6767e3c994ea08b05 2023-02-09 20:53:45,708 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/hbase/namespace/d516db36738f07b6767e3c994ea08b05/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 20:53:45,709 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened d516db36738f07b6767e3c994ea08b05; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70770746, jitterRate=0.05456629395484924}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-09 20:53:45,709 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for d516db36738f07b6767e3c994ea08b05: Running coprocessor pre-open hook at 1675976025693Writing region info on filesystem at 1675976025693Initializing all the Stores at 1675976025695 (+2 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675976025695Cleaning up temporary data from old regions at 1675976025701 (+6 ms)Cleaning up detritus from prior splits at 1675976025702 (+1 ms)Running coprocessor post-open hooks at 1675976025709 (+7 ms)Region opened successfully at 1675976025709 2023-02-09 20:53:45,711 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1675976024825.d516db36738f07b6767e3c994ea08b05., pid=6, masterSystemTime=1675976025685 2023-02-09 20:53:45,714 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1675976024825.d516db36738f07b6767e3c994ea08b05. 2023-02-09 20:53:45,715 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1675976024825.d516db36738f07b6767e3c994ea08b05. 2023-02-09 20:53:45,716 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=d516db36738f07b6767e3c994ea08b05, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:45,717 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1675976024825.d516db36738f07b6767e3c994ea08b05.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675976025716"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675976025716"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675976025716"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675976025716"}]},"ts":"1675976025716"} 2023-02-09 20:53:45,725 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-09 20:53:45,725 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure d516db36738f07b6767e3c994ea08b05, server=jenkins-hbase9.apache.org,40919,1675976022294 in 191 msec 2023-02-09 20:53:45,728 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-09 20:53:45,729 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=d516db36738f07b6767e3c994ea08b05, ASSIGN in 354 msec 2023-02-09 20:53:45,730 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-09 20:53:45,731 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675976025730"}]},"ts":"1675976025730"} 2023-02-09 20:53:45,733 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-09 20:53:45,738 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-09 20:53:45,738 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-09 20:53:45,739 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-09 20:53:45,739 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 20:53:45,741 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 912 msec 2023-02-09 20:53:45,778 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-09 20:53:45,795 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-09 20:53:45,801 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 33 msec 2023-02-09 20:53:45,813 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-09 20:53:45,825 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-09 20:53:45,829 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 15 msec 2023-02-09 20:53:45,839 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-09 20:53:45,842 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-09 20:53:45,842 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 3.481sec 2023-02-09 20:53:45,844 INFO [master/jenkins-hbase9:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-09 20:53:45,845 INFO [master/jenkins-hbase9:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-09 20:53:45,845 INFO [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-09 20:53:45,846 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,42951,1675976021166-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-09 20:53:45,848 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,42951,1675976021166-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-09 20:53:45,858 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-09 20:53:45,935 DEBUG [Listener at localhost/46855] zookeeper.ReadOnlyZKClient(139): Connect 0x0629018b to 127.0.0.1:62089 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 20:53:45,940 DEBUG [Listener at localhost/46855] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3c1e7f16, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 20:53:45,953 DEBUG [hconnection-0x77bc4ff1-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 20:53:45,964 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:52326, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 20:53:45,974 INFO [Listener at localhost/46855] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase9.apache.org,42951,1675976021166 2023-02-09 20:53:45,975 DEBUG [Listener at localhost/46855] zookeeper.ReadOnlyZKClient(139): Connect 0x7defec53 to 127.0.0.1:62089 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 20:53:45,980 DEBUG [Listener at localhost/46855] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@64b944ad, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 20:53:45,980 INFO [Listener at localhost/46855] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 20:53:46,001 INFO [Listener at localhost/46855] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthly Thread=212, OpenFileDescriptor=475, MaxFileDescriptor=60000, SystemLoadAverage=344, ProcessCount=168, AvailableMemoryMB=11640 2023-02-09 20:53:46,012 DEBUG [Listener at localhost/46855] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-09 20:53:46,015 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:47416, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-09 20:53:46,028 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.HMaster$4(2102): Client=jenkins//172.31.2.10 create 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-02-09 20:53:46,030 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:46,032 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_PRE_OPERATION 2023-02-09 20:53:46,034 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-09 20:53:46,036 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(697): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthly" procId is: 9 2023-02-09 20:53:46,037 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8dc66f5ff2c0373922a1a609b1d90cf4 2023-02-09 20:53:46,038 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8dc66f5ff2c0373922a1a609b1d90cf4 empty. 2023-02-09 20:53:46,040 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8dc66f5ff2c0373922a1a609b1d90cf4 2023-02-09 20:53:46,040 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthly regions 2023-02-09 20:53:46,045 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1227): Checking to see if procedure is done pid=9 2023-02-09 20:53:46,150 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1227): Checking to see if procedure is done pid=9 2023-02-09 20:53:46,352 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1227): Checking to see if procedure is done pid=9 2023-02-09 20:53:46,457 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000001 2023-02-09 20:53:46,459 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(7671): creating {ENCODED => 8dc66f5ff2c0373922a1a609b1d90cf4, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1675976026024.8dc66f5ff2c0373922a1a609b1d90cf4.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/.tmp 2023-02-09 20:53:46,472 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1675976026024.8dc66f5ff2c0373922a1a609b1d90cf4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 20:53:46,472 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1603): Closing 8dc66f5ff2c0373922a1a609b1d90cf4, disabling compactions & flushes 2023-02-09 20:53:46,472 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1675976026024.8dc66f5ff2c0373922a1a609b1d90cf4. 2023-02-09 20:53:46,472 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1675976026024.8dc66f5ff2c0373922a1a609b1d90cf4. 2023-02-09 20:53:46,472 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1675976026024.8dc66f5ff2c0373922a1a609b1d90cf4. after waiting 0 ms 2023-02-09 20:53:46,472 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1675976026024.8dc66f5ff2c0373922a1a609b1d90cf4. 2023-02-09 20:53:46,473 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1675976026024.8dc66f5ff2c0373922a1a609b1d90cf4. 2023-02-09 20:53:46,473 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1557): Region close journal for 8dc66f5ff2c0373922a1a609b1d90cf4: Waiting for close lock at 1675976026472Disabling compacts and flushes for region at 1675976026472Disabling writes for close at 1675976026472Writing region close event to WAL at 1675976026472Closed at 1675976026473 (+1 ms) 2023-02-09 20:53:46,477 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_ADD_TO_META 2023-02-09 20:53:46,478 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1675976026024.8dc66f5ff2c0373922a1a609b1d90cf4.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1675976026478"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675976026478"}]},"ts":"1675976026478"} 2023-02-09 20:53:46,481 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-09 20:53:46,482 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-09 20:53:46,482 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675976026482"}]},"ts":"1675976026482"} 2023-02-09 20:53:46,485 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthly, state=ENABLING in hbase:meta 2023-02-09 20:53:46,489 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=8dc66f5ff2c0373922a1a609b1d90cf4, ASSIGN}] 2023-02-09 20:53:46,491 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=8dc66f5ff2c0373922a1a609b1d90cf4, ASSIGN 2023-02-09 20:53:46,492 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=8dc66f5ff2c0373922a1a609b1d90cf4, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,40919,1675976022294; forceNewPlan=false, retain=false 2023-02-09 20:53:46,644 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=8dc66f5ff2c0373922a1a609b1d90cf4, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:46,644 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1675976026024.8dc66f5ff2c0373922a1a609b1d90cf4.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1675976026643"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675976026643"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675976026643"}]},"ts":"1675976026643"} 2023-02-09 20:53:46,647 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 8dc66f5ff2c0373922a1a609b1d90cf4, server=jenkins-hbase9.apache.org,40919,1675976022294}] 2023-02-09 20:53:46,653 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1227): Checking to see if procedure is done pid=9 2023-02-09 20:53:46,805 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthly,,1675976026024.8dc66f5ff2c0373922a1a609b1d90cf4. 2023-02-09 20:53:46,805 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 8dc66f5ff2c0373922a1a609b1d90cf4, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1675976026024.8dc66f5ff2c0373922a1a609b1d90cf4.', STARTKEY => '', ENDKEY => ''} 2023-02-09 20:53:46,806 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthly 8dc66f5ff2c0373922a1a609b1d90cf4 2023-02-09 20:53:46,806 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1675976026024.8dc66f5ff2c0373922a1a609b1d90cf4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 20:53:46,806 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for 8dc66f5ff2c0373922a1a609b1d90cf4 2023-02-09 20:53:46,806 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for 8dc66f5ff2c0373922a1a609b1d90cf4 2023-02-09 20:53:46,809 INFO [StoreOpener-8dc66f5ff2c0373922a1a609b1d90cf4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 8dc66f5ff2c0373922a1a609b1d90cf4 2023-02-09 20:53:46,811 DEBUG [StoreOpener-8dc66f5ff2c0373922a1a609b1d90cf4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8dc66f5ff2c0373922a1a609b1d90cf4/family1 2023-02-09 20:53:46,811 DEBUG [StoreOpener-8dc66f5ff2c0373922a1a609b1d90cf4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8dc66f5ff2c0373922a1a609b1d90cf4/family1 2023-02-09 20:53:46,814 INFO [StoreOpener-8dc66f5ff2c0373922a1a609b1d90cf4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8dc66f5ff2c0373922a1a609b1d90cf4 columnFamilyName family1 2023-02-09 20:53:46,817 INFO [StoreOpener-8dc66f5ff2c0373922a1a609b1d90cf4-1] regionserver.HStore(310): Store=8dc66f5ff2c0373922a1a609b1d90cf4/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 20:53:46,820 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8dc66f5ff2c0373922a1a609b1d90cf4 2023-02-09 20:53:46,821 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8dc66f5ff2c0373922a1a609b1d90cf4 2023-02-09 20:53:46,826 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for 8dc66f5ff2c0373922a1a609b1d90cf4 2023-02-09 20:53:46,830 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8dc66f5ff2c0373922a1a609b1d90cf4/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 20:53:46,831 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened 8dc66f5ff2c0373922a1a609b1d90cf4; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61624091, jitterRate=-0.08172948658466339}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-09 20:53:46,831 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for 8dc66f5ff2c0373922a1a609b1d90cf4: Running coprocessor pre-open hook at 1675976026806Writing region info on filesystem at 1675976026806Initializing all the Stores at 1675976026807 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} at 1675976026807Cleaning up temporary data from old regions at 1675976026821 (+14 ms)Cleaning up detritus from prior splits at 1675976026822 (+1 ms)Running coprocessor post-open hooks at 1675976026831 (+9 ms)Region opened successfully at 1675976026831 2023-02-09 20:53:46,832 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthly,,1675976026024.8dc66f5ff2c0373922a1a609b1d90cf4., pid=11, masterSystemTime=1675976026799 2023-02-09 20:53:46,835 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthly,,1675976026024.8dc66f5ff2c0373922a1a609b1d90cf4. 2023-02-09 20:53:46,835 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthly,,1675976026024.8dc66f5ff2c0373922a1a609b1d90cf4. 2023-02-09 20:53:46,836 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=8dc66f5ff2c0373922a1a609b1d90cf4, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:46,837 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1675976026024.8dc66f5ff2c0373922a1a609b1d90cf4.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1675976026836"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675976026836"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675976026836"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675976026836"}]},"ts":"1675976026836"} 2023-02-09 20:53:46,843 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-09 20:53:46,844 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 8dc66f5ff2c0373922a1a609b1d90cf4, server=jenkins-hbase9.apache.org,40919,1675976022294 in 193 msec 2023-02-09 20:53:46,847 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-02-09 20:53:46,847 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=8dc66f5ff2c0373922a1a609b1d90cf4, ASSIGN in 355 msec 2023-02-09 20:53:46,848 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-09 20:53:46,848 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675976026848"}]},"ts":"1675976026848"} 2023-02-09 20:53:46,851 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthly, state=ENABLED in hbase:meta 2023-02-09 20:53:46,853 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_POST_OPERATION 2023-02-09 20:53:46,856 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 825 msec 2023-02-09 20:53:47,155 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1227): Checking to see if procedure is done pid=9 2023-02-09 20:53:47,156 INFO [Listener at localhost/46855] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthly, procId: 9 completed 2023-02-09 20:53:47,178 DEBUG [hconnection-0x3666aa34-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 20:53:47,181 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:52342, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 20:53:47,374 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(933): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-02-09 20:53:47,384 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:47,384 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-09 20:53:47,384 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:53:47,385 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-02-09 20:53:47,385 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-02-09 20:53:47,385 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:47,385 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:47,387 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:53:47,387 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:47,387 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:53:47,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:53:47,387 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:47,387 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 20:53:47,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:47,388 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:47,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 20:53:47,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:47,389 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:47,390 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:47,391 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-02-09 20:53:47,391 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:53:47,391 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-02-09 20:53:47,393 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 20:53:47,393 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 20:53:47,393 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1675976026024.8dc66f5ff2c0373922a1a609b1d90cf4. 2023-02-09 20:53:47,394 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1675976026024.8dc66f5ff2c0373922a1a609b1d90cf4. started... 2023-02-09 20:53:47,395 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 8dc66f5ff2c0373922a1a609b1d90cf4 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-02-09 20:53:47,954 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511309ccc0455d62d4b34bdddb1a4bc51ee81 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511309ccc0455d62d4b34bdddb1a4bc51ee81 2023-02-09 20:53:47,970 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8dc66f5ff2c0373922a1a609b1d90cf4/.tmp/family1/cd1c6ea061724a3fba86c5717a56aa80 2023-02-09 20:53:47,984 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8dc66f5ff2c0373922a1a609b1d90cf4/.tmp/family1/cd1c6ea061724a3fba86c5717a56aa80 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8dc66f5ff2c0373922a1a609b1d90cf4/family1/cd1c6ea061724a3fba86c5717a56aa80 2023-02-09 20:53:47,998 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8dc66f5ff2c0373922a1a609b1d90cf4/family1/cd1c6ea061724a3fba86c5717a56aa80, entries=1000, sequenceid=5, filesize=175.8 K 2023-02-09 20:53:48,002 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 8dc66f5ff2c0373922a1a609b1d90cf4 in 606ms, sequenceid=5, compaction requested=false 2023-02-09 20:53:48,004 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-09 20:53:48,007 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 8dc66f5ff2c0373922a1a609b1d90cf4: 2023-02-09 20:53:48,007 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1675976026024.8dc66f5ff2c0373922a1a609b1d90cf4. 2023-02-09 20:53:48,008 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 20:53:48,009 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 20:53:48,009 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:48,009 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-02-09 20:53:48,009 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-02-09 20:53:48,012 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:48,013 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:48,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:48,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:53:48,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:53:48,013 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:48,013 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 20:53:48,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:53:48,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:53:48,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:48,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:48,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:53:48,016 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-02-09 20:53:48,016 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-02-09 20:53:48,016 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3a4b2661[Count = 0] remaining members to acquire global barrier 2023-02-09 20:53:48,016 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:48,017 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:48,018 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:48,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:48,018 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-02-09 20:53:48,018 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-02-09 20:53:48,018 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase9.apache.org,40919,1675976022294' in zk 2023-02-09 20:53:48,018 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:48,018 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 20:53:48,021 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:48,021 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-02-09 20:53:48,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:48,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:53:48,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:53:48,021 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:53:48,021 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-02-09 20:53:48,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:53:48,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:53:48,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:48,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:48,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:53:48,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:48,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:48,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase9.apache.org,40919,1675976022294': 2023-02-09 20:53:48,025 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-02-09 20:53:48,025 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 20:53:48,025 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-02-09 20:53:48,025 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 20:53:48,025 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:48,025 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 20:53:48,028 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:48,028 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:48,028 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:48,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:48,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:53:48,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:53:48,028 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:53:48,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:48,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:53:48,029 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:53:48,029 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:48,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:53:48,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:48,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:48,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:53:48,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:48,031 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:48,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:48,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:53:48,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:48,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:48,040 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:48,040 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:53:48,040 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:48,040 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:53:48,040 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-09 20:53:48,040 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 20:53:48,040 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:53:48,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:53:48,040 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:48,040 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:53:48,041 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:48,041 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:48,041 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:48,041 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:48,041 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:53:48,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:53:48,043 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-02-09 20:53:48,043 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 20:53:48,143 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 20:53:48,150 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 20:53:48,161 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(933): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-02-09 20:53:48,164 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-02-09 20:53:48,164 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:48,164 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-09 20:53:48,164 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:53:48,165 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-02-09 20:53:48,165 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-02-09 20:53:48,165 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:48,165 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:48,168 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:53:48,168 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:53:48,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:53:48,168 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:48,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:48,168 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:48,169 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 20:53:48,169 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:48,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 20:53:48,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:48,170 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:48,172 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-02-09 20:53:48,172 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:48,172 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-02-09 20:53:48,172 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:53:48,172 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-02-09 20:53:48,172 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 20:53:48,172 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 20:53:48,173 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1675976026024.8dc66f5ff2c0373922a1a609b1d90cf4. 2023-02-09 20:53:48,173 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1675976026024.8dc66f5ff2c0373922a1a609b1d90cf4. started... 2023-02-09 20:53:48,173 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 8dc66f5ff2c0373922a1a609b1d90cf4 1/1 column families, dataSize=74 B heapSize=408 B 2023-02-09 20:53:48,606 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511285cb6aec07b2e4e68a57d9ec156c59d0f to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511285cb6aec07b2e4e68a57d9ec156c59d0f 2023-02-09 20:53:49,028 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8dc66f5ff2c0373922a1a609b1d90cf4/.tmp/family1/513840e417f34652a361a50f771dfa9e 2023-02-09 20:53:49,038 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8dc66f5ff2c0373922a1a609b1d90cf4/.tmp/family1/513840e417f34652a361a50f771dfa9e as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8dc66f5ff2c0373922a1a609b1d90cf4/family1/513840e417f34652a361a50f771dfa9e 2023-02-09 20:53:49,047 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8dc66f5ff2c0373922a1a609b1d90cf4/family1/513840e417f34652a361a50f771dfa9e, entries=1, sequenceid=9, filesize=5.0 K 2023-02-09 20:53:49,049 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 8dc66f5ff2c0373922a1a609b1d90cf4 in 876ms, sequenceid=9, compaction requested=false 2023-02-09 20:53:49,050 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 8dc66f5ff2c0373922a1a609b1d90cf4: 2023-02-09 20:53:49,050 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1675976026024.8dc66f5ff2c0373922a1a609b1d90cf4. 2023-02-09 20:53:49,050 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 20:53:49,050 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 20:53:49,050 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:49,050 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-02-09 20:53:49,050 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-02-09 20:53:49,053 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:49,053 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:49,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:49,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:53:49,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:53:49,053 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:49,053 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 20:53:49,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:53:49,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:53:49,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:49,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:49,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:53:49,055 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-02-09 20:53:49,055 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7a3d4439[Count = 0] remaining members to acquire global barrier 2023-02-09 20:53:49,055 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-02-09 20:53:49,055 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:49,056 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:49,057 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:49,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:49,057 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-02-09 20:53:49,057 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-02-09 20:53:49,057 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase9.apache.org,40919,1675976022294' in zk 2023-02-09 20:53:49,057 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:49,057 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 20:53:49,059 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-02-09 20:53:49,059 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:49,059 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:53:49,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:49,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:53:49,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:53:49,059 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-02-09 20:53:49,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:53:49,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:53:49,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:49,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:49,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:53:49,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:49,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:49,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase9.apache.org,40919,1675976022294': 2023-02-09 20:53:49,063 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-02-09 20:53:49,063 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-02-09 20:53:49,063 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 20:53:49,063 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 20:53:49,063 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:49,063 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 20:53:49,070 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:49,070 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:49,070 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:49,070 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:53:49,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:49,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:49,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:53:49,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:53:49,071 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:49,071 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:53:49,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:53:49,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:53:49,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:49,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:49,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:53:49,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:49,073 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:49,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:49,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:53:49,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:49,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:49,077 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:49,077 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:49,077 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:49,077 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:49,077 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:49,077 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:53:49,077 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:53:49,077 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-02-09 20:53:49,077 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-09 20:53:49,078 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 20:53:49,077 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:49,078 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:53:49,078 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:53:49,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:53:49,078 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:49,078 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-02-09 20:53:49,079 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 20:53:49,079 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:53:49,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:53:49,179 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 20:53:49,181 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 20:53:49,190 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(933): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-02-09 20:53:49,200 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-02-09 20:53:49,201 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:49,201 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-09 20:53:49,201 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:53:49,201 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-02-09 20:53:49,202 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-02-09 20:53:49,202 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:49,202 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:49,204 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:53:49,204 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:49,204 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:53:49,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:53:49,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:49,205 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:49,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 20:53:49,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:49,205 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:49,206 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-02-09 20:53:49,206 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:49,206 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-02-09 20:53:49,206 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:53:49,206 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-02-09 20:53:49,207 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 20:53:49,207 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 20:53:49,207 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1675976026024.8dc66f5ff2c0373922a1a609b1d90cf4. 2023-02-09 20:53:49,207 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1675976026024.8dc66f5ff2c0373922a1a609b1d90cf4. started... 2023-02-09 20:53:49,207 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 8dc66f5ff2c0373922a1a609b1d90cf4 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-09 20:53:49,209 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:49,209 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 20:53:49,416 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-02-09 20:53:49,417 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-02-09 20:53:49,642 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512012fd0c2497aac49e6b160dc1e14525efd to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512012fd0c2497aac49e6b160dc1e14525efd 2023-02-09 20:53:50,069 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8dc66f5ff2c0373922a1a609b1d90cf4/.tmp/family1/d68ea3e2bea94fbfb3b44732404b0433 2023-02-09 20:53:50,082 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8dc66f5ff2c0373922a1a609b1d90cf4/.tmp/family1/d68ea3e2bea94fbfb3b44732404b0433 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8dc66f5ff2c0373922a1a609b1d90cf4/family1/d68ea3e2bea94fbfb3b44732404b0433 2023-02-09 20:53:50,095 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8dc66f5ff2c0373922a1a609b1d90cf4/family1/d68ea3e2bea94fbfb3b44732404b0433, entries=1, sequenceid=13, filesize=5.0 K 2023-02-09 20:53:50,097 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 8dc66f5ff2c0373922a1a609b1d90cf4 in 890ms, sequenceid=13, compaction requested=true 2023-02-09 20:53:50,097 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 8dc66f5ff2c0373922a1a609b1d90cf4: 2023-02-09 20:53:50,097 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1675976026024.8dc66f5ff2c0373922a1a609b1d90cf4. 2023-02-09 20:53:50,097 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 20:53:50,097 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 20:53:50,097 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:50,097 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-02-09 20:53:50,098 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-02-09 20:53:50,100 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:50,100 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:50,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:50,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:53:50,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:53:50,100 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:50,100 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 20:53:50,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:53:50,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:53:50,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:50,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:50,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:53:50,103 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-02-09 20:53:50,103 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6f2f5077[Count = 0] remaining members to acquire global barrier 2023-02-09 20:53:50,103 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-02-09 20:53:50,103 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:50,105 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:50,105 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:50,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:50,105 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-02-09 20:53:50,105 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-02-09 20:53:50,105 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase9.apache.org,40919,1675976022294' in zk 2023-02-09 20:53:50,105 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:50,105 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 20:53:50,107 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:50,107 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-02-09 20:53:50,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:50,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:53:50,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:53:50,107 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:53:50,108 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-02-09 20:53:50,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:53:50,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:53:50,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:50,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:50,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:53:50,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:50,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:50,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase9.apache.org,40919,1675976022294': 2023-02-09 20:53:50,112 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-02-09 20:53:50,112 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-02-09 20:53:50,112 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 20:53:50,112 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 20:53:50,112 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:50,112 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 20:53:50,121 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:50,121 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:50,121 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:50,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:50,121 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:53:50,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:50,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:53:50,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:53:50,122 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:53:50,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:53:50,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:53:50,122 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:50,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:50,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:50,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:53:50,126 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:50,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:50,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:50,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:53:50,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:50,130 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:50,130 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:53:50,130 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:50,131 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:53:50,131 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:53:50,131 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:53:50,131 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-09 20:53:50,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:53:50,131 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:50,131 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 20:53:50,131 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-02-09 20:53:50,131 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:50,132 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:50,132 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:50,132 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:50,132 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:53:50,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:53:50,132 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-02-09 20:53:50,132 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 20:53:50,165 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-09 20:53:50,232 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 20:53:50,234 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 20:53:50,243 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(933): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-02-09 20:53:50,246 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-02-09 20:53:50,247 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:50,247 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-09 20:53:50,247 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:53:50,247 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-02-09 20:53:50,247 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-02-09 20:53:50,251 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:50,251 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:50,254 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:53:50,254 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:50,254 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:53:50,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:53:50,255 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:50,255 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 20:53:50,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:50,256 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:50,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 20:53:50,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:50,256 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:50,256 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-02-09 20:53:50,257 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:50,257 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-02-09 20:53:50,257 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:53:50,257 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-02-09 20:53:50,257 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 20:53:50,258 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1675976026024.8dc66f5ff2c0373922a1a609b1d90cf4. 2023-02-09 20:53:50,258 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 20:53:50,258 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1675976026024.8dc66f5ff2c0373922a1a609b1d90cf4. started... 2023-02-09 20:53:50,258 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 8dc66f5ff2c0373922a1a609b1d90cf4 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-09 20:53:50,289 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205eda9edf8ae1e4f718c6bde74caee05e6 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151205eda9edf8ae1e4f718c6bde74caee05e6 2023-02-09 20:53:50,307 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8dc66f5ff2c0373922a1a609b1d90cf4/.tmp/family1/ce98a9b8059d4033933ed16b7cce2af4 2023-02-09 20:53:50,318 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8dc66f5ff2c0373922a1a609b1d90cf4/.tmp/family1/ce98a9b8059d4033933ed16b7cce2af4 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8dc66f5ff2c0373922a1a609b1d90cf4/family1/ce98a9b8059d4033933ed16b7cce2af4 2023-02-09 20:53:50,327 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8dc66f5ff2c0373922a1a609b1d90cf4/family1/ce98a9b8059d4033933ed16b7cce2af4, entries=1, sequenceid=17, filesize=5.0 K 2023-02-09 20:53:50,329 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 8dc66f5ff2c0373922a1a609b1d90cf4 in 70ms, sequenceid=17, compaction requested=true 2023-02-09 20:53:50,329 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 8dc66f5ff2c0373922a1a609b1d90cf4: 2023-02-09 20:53:50,329 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1675976026024.8dc66f5ff2c0373922a1a609b1d90cf4. 2023-02-09 20:53:50,329 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 20:53:50,329 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 20:53:50,329 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:50,330 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-02-09 20:53:50,330 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-02-09 20:53:50,332 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:50,332 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:50,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:50,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:53:50,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:53:50,333 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:50,333 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 20:53:50,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:53:50,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:53:50,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:50,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:50,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:53:50,335 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-02-09 20:53:50,335 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4c6563ed[Count = 0] remaining members to acquire global barrier 2023-02-09 20:53:50,335 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-02-09 20:53:50,335 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:50,341 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:50,341 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:50,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:50,342 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-02-09 20:53:50,342 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-02-09 20:53:50,342 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase9.apache.org,40919,1675976022294' in zk 2023-02-09 20:53:50,342 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:50,342 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 20:53:50,344 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-02-09 20:53:50,344 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:50,344 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:53:50,344 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-02-09 20:53:50,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:50,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:53:50,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:53:50,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:53:50,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:53:50,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:50,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:50,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:53:50,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:50,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:50,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase9.apache.org,40919,1675976022294': 2023-02-09 20:53:50,348 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-02-09 20:53:50,348 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-02-09 20:53:50,348 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 20:53:50,348 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 20:53:50,348 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:50,348 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 20:53:50,351 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:50,351 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:53:50,351 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:50,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:50,354 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:50,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:50,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:53:50,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:53:50,354 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:53:50,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:53:50,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:53:50,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:50,355 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:50,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:50,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:53:50,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:50,357 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:50,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:50,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:53:50,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:50,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:50,368 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:53:50,368 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:50,368 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:53:50,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:53:50,369 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-09 20:53:50,369 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 20:53:50,368 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:50,368 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:53:50,369 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:50,369 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:50,369 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:50,369 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:50,369 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:50,368 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:53:50,369 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:53:50,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:53:50,370 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-02-09 20:53:50,370 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-02-09 20:53:50,370 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 20:53:50,470 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 20:53:50,472 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 20:53:50,479 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(933): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-02-09 20:53:50,482 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-02-09 20:53:50,482 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:50,482 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-09 20:53:50,482 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:53:50,482 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-02-09 20:53:50,483 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-02-09 20:53:50,483 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:50,483 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:50,485 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:53:50,485 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:50,485 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:53:50,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:53:50,485 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:50,485 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 20:53:50,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:50,486 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:50,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 20:53:50,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:50,486 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:50,486 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-02-09 20:53:50,486 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:50,486 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-02-09 20:53:50,487 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:53:50,487 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-02-09 20:53:50,487 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 20:53:50,487 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 20:53:50,487 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1675976026024.8dc66f5ff2c0373922a1a609b1d90cf4. 2023-02-09 20:53:50,487 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1675976026024.8dc66f5ff2c0373922a1a609b1d90cf4. started... 2023-02-09 20:53:50,487 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 8dc66f5ff2c0373922a1a609b1d90cf4 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-09 20:53:50,517 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228369e63d545ad48a6bf3816d4da8b80b7 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151228369e63d545ad48a6bf3816d4da8b80b7 2023-02-09 20:53:50,929 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8dc66f5ff2c0373922a1a609b1d90cf4/.tmp/family1/58423666922f40d29282b5477f439dff 2023-02-09 20:53:50,937 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8dc66f5ff2c0373922a1a609b1d90cf4/.tmp/family1/58423666922f40d29282b5477f439dff as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8dc66f5ff2c0373922a1a609b1d90cf4/family1/58423666922f40d29282b5477f439dff 2023-02-09 20:53:50,945 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8dc66f5ff2c0373922a1a609b1d90cf4/family1/58423666922f40d29282b5477f439dff, entries=1, sequenceid=21, filesize=5.0 K 2023-02-09 20:53:50,946 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 8dc66f5ff2c0373922a1a609b1d90cf4 in 459ms, sequenceid=21, compaction requested=true 2023-02-09 20:53:50,946 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 8dc66f5ff2c0373922a1a609b1d90cf4: 2023-02-09 20:53:50,946 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1675976026024.8dc66f5ff2c0373922a1a609b1d90cf4. 2023-02-09 20:53:50,946 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 20:53:50,947 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 20:53:50,947 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:50,947 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-02-09 20:53:50,947 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-02-09 20:53:50,953 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:50,953 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:50,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:50,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:53:50,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:53:50,954 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:50,954 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 20:53:50,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:53:50,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:53:50,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:50,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:50,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:53:50,955 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-02-09 20:53:50,955 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2f7e2c2e[Count = 0] remaining members to acquire global barrier 2023-02-09 20:53:50,955 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-02-09 20:53:50,956 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:50,957 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:50,957 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:50,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:50,957 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-02-09 20:53:50,957 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-02-09 20:53:50,957 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase9.apache.org,40919,1675976022294' in zk 2023-02-09 20:53:50,957 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:50,957 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 20:53:50,959 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:50,959 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-02-09 20:53:50,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:50,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:53:50,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:53:50,959 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:53:50,959 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-02-09 20:53:50,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:53:50,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:53:50,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:50,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:50,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:53:50,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:50,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:50,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase9.apache.org,40919,1675976022294': 2023-02-09 20:53:50,962 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-02-09 20:53:50,962 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-02-09 20:53:50,962 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 20:53:50,962 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 20:53:50,962 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:50,962 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 20:53:50,964 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:50,964 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:50,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:50,964 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:50,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:53:50,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:53:50,964 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:53:50,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:50,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:53:50,965 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:50,965 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:53:50,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:53:50,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:50,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:50,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:53:50,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:50,966 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:50,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:50,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:53:50,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:50,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:50,968 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:50,969 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:50,969 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:50,969 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:50,969 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:53:50,969 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-09 20:53:50,969 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 20:53:50,969 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:53:50,969 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:53:50,969 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:53:50,969 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:50,969 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:50,969 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:50,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:53:50,969 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-02-09 20:53:50,970 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-02-09 20:53:50,970 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 20:53:50,970 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:53:50,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:53:51,070 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 20:53:51,072 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 20:53:51,079 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(933): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-02-09 20:53:51,081 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-02-09 20:53:51,081 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:51,081 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-09 20:53:51,081 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:53:51,082 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-02-09 20:53:51,082 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-02-09 20:53:51,082 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:51,082 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:51,084 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:53:51,084 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:51,084 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:53:51,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:53:51,084 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:51,084 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 20:53:51,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:51,085 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:51,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 20:53:51,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:51,085 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:51,085 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-02-09 20:53:51,085 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:51,085 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-02-09 20:53:51,085 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:53:51,086 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-02-09 20:53:51,086 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 20:53:51,086 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 20:53:51,086 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1675976026024.8dc66f5ff2c0373922a1a609b1d90cf4. 2023-02-09 20:53:51,086 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1675976026024.8dc66f5ff2c0373922a1a609b1d90cf4. started... 2023-02-09 20:53:51,087 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 8dc66f5ff2c0373922a1a609b1d90cf4 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-09 20:53:51,315 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-09 20:53:51,316 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-02-09 20:53:51,508 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231e5bfac70b8e34b72a33a6e6116e27662 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151231e5bfac70b8e34b72a33a6e6116e27662 2023-02-09 20:53:51,918 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8dc66f5ff2c0373922a1a609b1d90cf4/.tmp/family1/62d7210d15fc41f49ca07c24ae358e81 2023-02-09 20:53:51,926 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8dc66f5ff2c0373922a1a609b1d90cf4/.tmp/family1/62d7210d15fc41f49ca07c24ae358e81 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8dc66f5ff2c0373922a1a609b1d90cf4/family1/62d7210d15fc41f49ca07c24ae358e81 2023-02-09 20:53:51,934 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8dc66f5ff2c0373922a1a609b1d90cf4/family1/62d7210d15fc41f49ca07c24ae358e81, entries=1, sequenceid=25, filesize=5.0 K 2023-02-09 20:53:51,935 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 8dc66f5ff2c0373922a1a609b1d90cf4 in 848ms, sequenceid=25, compaction requested=true 2023-02-09 20:53:51,935 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 8dc66f5ff2c0373922a1a609b1d90cf4: 2023-02-09 20:53:51,936 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1675976026024.8dc66f5ff2c0373922a1a609b1d90cf4. 2023-02-09 20:53:51,936 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 20:53:51,936 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 20:53:51,936 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:51,936 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-02-09 20:53:51,936 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-02-09 20:53:51,939 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:51,939 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:51,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:51,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:53:51,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:53:51,940 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:51,940 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 20:53:51,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:53:51,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:53:51,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:51,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:51,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:53:51,942 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-02-09 20:53:51,942 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3f72a974[Count = 0] remaining members to acquire global barrier 2023-02-09 20:53:51,942 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-02-09 20:53:51,942 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:51,943 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:51,943 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:51,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:51,943 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-02-09 20:53:51,943 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-02-09 20:53:51,944 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase9.apache.org,40919,1675976022294' in zk 2023-02-09 20:53:51,944 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:51,944 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 20:53:51,945 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-02-09 20:53:51,945 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:51,945 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:53:51,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:51,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:53:51,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:53:51,945 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-02-09 20:53:51,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:53:51,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:53:51,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:51,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:51,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:53:51,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:51,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:51,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase9.apache.org,40919,1675976022294': 2023-02-09 20:53:51,949 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-02-09 20:53:51,949 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-02-09 20:53:51,949 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 20:53:51,949 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 20:53:51,949 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:51,949 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 20:53:51,951 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:51,951 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:51,951 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:51,951 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:53:51,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:51,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:51,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:53:51,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:53:51,952 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:51,952 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:53:51,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:53:51,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:53:51,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:51,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:51,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:53:51,953 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:51,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:51,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:51,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:53:51,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:51,960 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:51,960 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:53:51,960 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:51,960 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:53:51,960 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:53:51,960 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:53:51,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:53:51,960 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-09 20:53:51,961 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 20:53:51,961 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-02-09 20:53:51,960 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:51,961 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:51,961 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:51,961 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:51,961 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:51,962 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-02-09 20:53:51,962 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:53:51,962 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 20:53:51,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:53:52,062 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 20:53:52,063 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 20:53:52,070 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(933): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-02-09 20:53:52,073 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-02-09 20:53:52,073 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:52,073 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-09 20:53:52,073 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:53:52,073 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-02-09 20:53:52,073 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-02-09 20:53:52,074 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:52,074 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:52,075 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:53:52,075 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:52,075 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:53:52,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:53:52,076 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:52,076 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 20:53:52,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:52,076 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:52,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 20:53:52,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:52,077 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:52,077 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-02-09 20:53:52,077 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:52,077 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-02-09 20:53:52,077 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:53:52,077 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-02-09 20:53:52,078 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 20:53:52,078 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 20:53:52,078 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1675976026024.8dc66f5ff2c0373922a1a609b1d90cf4. 2023-02-09 20:53:52,078 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1675976026024.8dc66f5ff2c0373922a1a609b1d90cf4. started... 2023-02-09 20:53:52,078 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 8dc66f5ff2c0373922a1a609b1d90cf4 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-09 20:53:52,500 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010165bbe6dc05d7488d8e4d932b4e049776 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2016010165bbe6dc05d7488d8e4d932b4e049776 2023-02-09 20:53:52,909 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8dc66f5ff2c0373922a1a609b1d90cf4/.tmp/family1/e8589bd30d2a4b928f43689ea40e9ad0 2023-02-09 20:53:52,917 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8dc66f5ff2c0373922a1a609b1d90cf4/.tmp/family1/e8589bd30d2a4b928f43689ea40e9ad0 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8dc66f5ff2c0373922a1a609b1d90cf4/family1/e8589bd30d2a4b928f43689ea40e9ad0 2023-02-09 20:53:52,925 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8dc66f5ff2c0373922a1a609b1d90cf4/family1/e8589bd30d2a4b928f43689ea40e9ad0, entries=1, sequenceid=29, filesize=5.0 K 2023-02-09 20:53:52,927 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 8dc66f5ff2c0373922a1a609b1d90cf4 in 849ms, sequenceid=29, compaction requested=true 2023-02-09 20:53:52,927 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 8dc66f5ff2c0373922a1a609b1d90cf4: 2023-02-09 20:53:52,927 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1675976026024.8dc66f5ff2c0373922a1a609b1d90cf4. 2023-02-09 20:53:52,927 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 20:53:52,928 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 20:53:52,928 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:52,928 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-02-09 20:53:52,928 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-02-09 20:53:52,930 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:52,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:52,930 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:52,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:53:52,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:53:52,930 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:52,931 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 20:53:52,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:53:52,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:53:52,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:52,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:52,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:53:52,932 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-02-09 20:53:52,932 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2acbfa05[Count = 0] remaining members to acquire global barrier 2023-02-09 20:53:52,932 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-02-09 20:53:52,932 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:52,933 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:52,933 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:52,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:52,934 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-02-09 20:53:52,934 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-02-09 20:53:52,934 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase9.apache.org,40919,1675976022294' in zk 2023-02-09 20:53:52,934 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:52,934 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 20:53:52,936 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-02-09 20:53:52,936 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:53:52,936 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:52,936 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-02-09 20:53:52,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:52,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:53:52,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:53:52,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:53:52,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:53:52,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:52,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:52,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:53:52,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:52,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:52,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase9.apache.org,40919,1675976022294': 2023-02-09 20:53:52,939 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-02-09 20:53:52,939 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-02-09 20:53:52,939 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 20:53:52,939 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 20:53:52,939 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:52,939 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 20:53:52,940 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:52,940 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:52,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:52,940 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:52,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:53:52,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:52,940 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:53:52,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:53:52,941 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:52,941 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:53:52,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:53:52,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:53:52,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:52,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:52,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:53:52,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:52,942 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:52,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:52,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:53:52,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:52,947 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:52,947 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:52,947 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:53:52,947 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:52,947 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:53:52,947 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:52,947 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-09 20:53:52,947 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 20:53:52,947 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:53:52,947 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:53:52,948 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-02-09 20:53:52,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:53:52,947 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:52,948 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:52,948 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:52,948 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-02-09 20:53:52,948 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 20:53:52,948 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:53:52,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:53:53,048 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 20:53:53,050 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 20:53:53,057 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(933): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-02-09 20:53:53,059 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-02-09 20:53:53,059 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:53,059 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-09 20:53:53,059 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:53:53,060 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-02-09 20:53:53,060 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-02-09 20:53:53,060 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:53,060 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:53,062 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:53:53,062 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:53,062 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:53:53,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:53:53,062 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:53,062 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 20:53:53,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:53,063 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:53,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 20:53:53,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:53,063 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:53,063 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-02-09 20:53:53,063 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:53,063 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-02-09 20:53:53,063 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:53:53,064 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-02-09 20:53:53,064 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 20:53:53,064 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 20:53:53,064 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1675976026024.8dc66f5ff2c0373922a1a609b1d90cf4. 2023-02-09 20:53:53,064 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1675976026024.8dc66f5ff2c0373922a1a609b1d90cf4. started... 2023-02-09 20:53:53,064 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 8dc66f5ff2c0373922a1a609b1d90cf4 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-09 20:53:53,486 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103ed3940ae726a4ad18d6123038fdd9b9e to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160103ed3940ae726a4ad18d6123038fdd9b9e 2023-02-09 20:53:53,895 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8dc66f5ff2c0373922a1a609b1d90cf4/.tmp/family1/1e90149792f14a489b7aa8107202cf4c 2023-02-09 20:53:53,904 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8dc66f5ff2c0373922a1a609b1d90cf4/.tmp/family1/1e90149792f14a489b7aa8107202cf4c as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8dc66f5ff2c0373922a1a609b1d90cf4/family1/1e90149792f14a489b7aa8107202cf4c 2023-02-09 20:53:53,910 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8dc66f5ff2c0373922a1a609b1d90cf4/family1/1e90149792f14a489b7aa8107202cf4c, entries=1, sequenceid=33, filesize=5.0 K 2023-02-09 20:53:53,912 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 8dc66f5ff2c0373922a1a609b1d90cf4 in 848ms, sequenceid=33, compaction requested=true 2023-02-09 20:53:53,912 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 8dc66f5ff2c0373922a1a609b1d90cf4: 2023-02-09 20:53:53,912 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1675976026024.8dc66f5ff2c0373922a1a609b1d90cf4. 2023-02-09 20:53:53,912 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 20:53:53,912 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 20:53:53,913 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:53,913 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-02-09 20:53:53,913 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-02-09 20:53:53,915 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:53,915 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:53,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:53,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:53:53,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:53:53,915 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:53,915 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 20:53:53,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:53:53,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:53:53,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:53,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:53,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:53:53,916 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-02-09 20:53:53,916 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4d569eba[Count = 0] remaining members to acquire global barrier 2023-02-09 20:53:53,916 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-02-09 20:53:53,917 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:53,918 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:53,918 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:53,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:53,918 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-02-09 20:53:53,918 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-02-09 20:53:53,918 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase9.apache.org,40919,1675976022294' in zk 2023-02-09 20:53:53,918 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:53,918 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 20:53:53,919 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-02-09 20:53:53,919 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:53,919 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:53:53,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:53,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:53:53,920 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-02-09 20:53:53,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:53:53,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:53:53,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:53:53,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:53,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:53,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:53:53,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:53,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:53,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase9.apache.org,40919,1675976022294': 2023-02-09 20:53:53,923 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-02-09 20:53:53,923 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-02-09 20:53:53,923 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 20:53:53,923 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 20:53:53,923 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:53,923 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 20:53:53,926 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:53,926 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:53,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:53,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:53:53,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:53:53,926 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:53,926 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:53:53,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:53,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:53:53,927 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:53:53,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:53:53,927 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:53,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:53,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:53,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:53:53,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:53,928 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:53,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:53,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:53:53,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:53,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:53,931 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:53,931 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:53,931 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:53:53,931 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:53:53,931 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:53,931 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:53:53,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:53:53,931 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:53:53,931 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-09 20:53:53,932 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 20:53:53,932 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:53,932 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:53,932 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:53,932 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:53,932 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:53:53,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:53:53,932 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-02-09 20:53:53,932 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 20:53:54,033 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 20:53:54,034 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 20:53:54,041 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(933): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-02-09 20:53:54,043 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-02-09 20:53:54,044 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:54,044 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-09 20:53:54,044 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:53:54,044 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-02-09 20:53:54,044 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-02-09 20:53:54,045 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:54,045 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:54,046 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:54,046 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:53:54,046 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:53:54,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:53:54,047 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:54,047 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 20:53:54,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:54,047 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:54,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 20:53:54,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:54,047 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:54,048 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-02-09 20:53:54,048 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:54,049 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-02-09 20:53:54,049 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:53:54,049 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-02-09 20:53:54,050 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 20:53:54,050 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 20:53:54,050 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1675976026024.8dc66f5ff2c0373922a1a609b1d90cf4. 2023-02-09 20:53:54,050 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1675976026024.8dc66f5ff2c0373922a1a609b1d90cf4. started... 2023-02-09 20:53:54,050 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 8dc66f5ff2c0373922a1a609b1d90cf4 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-09 20:53:54,470 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907bbf5214f4b344ff19d6a3305e3fad99a to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20150907bbf5214f4b344ff19d6a3305e3fad99a 2023-02-09 20:53:54,879 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8dc66f5ff2c0373922a1a609b1d90cf4/.tmp/family1/f90bc607dabd4cd98c43a44fdf076f21 2023-02-09 20:53:54,887 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8dc66f5ff2c0373922a1a609b1d90cf4/.tmp/family1/f90bc607dabd4cd98c43a44fdf076f21 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8dc66f5ff2c0373922a1a609b1d90cf4/family1/f90bc607dabd4cd98c43a44fdf076f21 2023-02-09 20:53:54,894 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8dc66f5ff2c0373922a1a609b1d90cf4/family1/f90bc607dabd4cd98c43a44fdf076f21, entries=1, sequenceid=37, filesize=5.0 K 2023-02-09 20:53:54,895 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 8dc66f5ff2c0373922a1a609b1d90cf4 in 845ms, sequenceid=37, compaction requested=true 2023-02-09 20:53:54,895 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 8dc66f5ff2c0373922a1a609b1d90cf4: 2023-02-09 20:53:54,895 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1675976026024.8dc66f5ff2c0373922a1a609b1d90cf4. 2023-02-09 20:53:54,895 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 20:53:54,896 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 20:53:54,896 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:54,896 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-02-09 20:53:54,896 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-02-09 20:53:54,898 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:54,898 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:54,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:54,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:53:54,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:53:54,898 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:54,898 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 20:53:54,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:53:54,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:53:54,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:54,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:54,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:53:54,900 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-02-09 20:53:54,900 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1317d462[Count = 0] remaining members to acquire global barrier 2023-02-09 20:53:54,900 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-02-09 20:53:54,900 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:54,902 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:54,902 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:54,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:54,902 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-02-09 20:53:54,902 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-02-09 20:53:54,902 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase9.apache.org,40919,1675976022294' in zk 2023-02-09 20:53:54,902 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:54,903 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 20:53:54,905 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-02-09 20:53:54,905 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:54,905 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:53:54,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:54,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:53:54,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:53:54,905 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-02-09 20:53:54,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:53:54,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:53:54,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:54,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:54,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:53:54,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:54,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:54,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase9.apache.org,40919,1675976022294': 2023-02-09 20:53:54,908 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-02-09 20:53:54,908 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-02-09 20:53:54,908 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 20:53:54,908 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 20:53:54,908 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:54,908 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 20:53:54,909 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:54,909 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:54,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:54,909 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:54,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:53:54,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:53:54,909 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:53:54,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:54,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:53:54,910 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:54,910 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:53:54,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:53:54,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:54,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:54,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:53:54,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:54,911 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:54,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:54,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:53:54,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:54,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:54,913 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:54,914 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:53:54,914 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:54,914 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:53:54,914 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-02-09 20:53:54,914 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:54,914 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:53:54,914 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:53:54,914 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:54,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:53:54,914 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-09 20:53:54,915 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 20:53:54,914 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:54,915 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:54,915 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:54,915 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:53:54,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:53:54,915 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-02-09 20:53:54,915 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 20:53:55,015 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 20:53:55,017 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 20:53:55,024 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(933): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-02-09 20:53:55,027 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-02-09 20:53:55,027 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:55,027 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-09 20:53:55,027 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:53:55,027 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-02-09 20:53:55,027 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-02-09 20:53:55,028 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:55,028 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:55,030 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:55,030 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:53:55,030 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:53:55,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:53:55,030 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:55,030 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 20:53:55,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:55,031 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:55,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 20:53:55,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:55,031 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:55,031 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-02-09 20:53:55,032 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:55,032 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-02-09 20:53:55,032 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:53:55,033 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-02-09 20:53:55,033 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 20:53:55,033 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 20:53:55,033 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1675976026024.8dc66f5ff2c0373922a1a609b1d90cf4. 2023-02-09 20:53:55,033 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1675976026024.8dc66f5ff2c0373922a1a609b1d90cf4. started... 2023-02-09 20:53:55,033 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 8dc66f5ff2c0373922a1a609b1d90cf4 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-09 20:53:55,453 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112053a4786428294e0c9d681ee0c1711324 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015112053a4786428294e0c9d681ee0c1711324 2023-02-09 20:53:55,861 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8dc66f5ff2c0373922a1a609b1d90cf4/.tmp/family1/ba54485a37414965beda60573be2cd0e 2023-02-09 20:53:55,869 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8dc66f5ff2c0373922a1a609b1d90cf4/.tmp/family1/ba54485a37414965beda60573be2cd0e as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8dc66f5ff2c0373922a1a609b1d90cf4/family1/ba54485a37414965beda60573be2cd0e 2023-02-09 20:53:55,876 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8dc66f5ff2c0373922a1a609b1d90cf4/family1/ba54485a37414965beda60573be2cd0e, entries=1, sequenceid=41, filesize=5.0 K 2023-02-09 20:53:55,877 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 8dc66f5ff2c0373922a1a609b1d90cf4 in 844ms, sequenceid=41, compaction requested=true 2023-02-09 20:53:55,877 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 8dc66f5ff2c0373922a1a609b1d90cf4: 2023-02-09 20:53:55,877 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1675976026024.8dc66f5ff2c0373922a1a609b1d90cf4. 2023-02-09 20:53:55,877 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 20:53:55,878 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 20:53:55,878 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:55,878 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-02-09 20:53:55,878 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-02-09 20:53:55,879 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:55,879 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:55,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:55,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:53:55,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:53:55,880 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:55,880 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 20:53:55,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:53:55,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:53:55,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:55,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:55,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:53:55,881 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-02-09 20:53:55,881 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3904e67d[Count = 0] remaining members to acquire global barrier 2023-02-09 20:53:55,881 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-02-09 20:53:55,881 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:55,882 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:55,882 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:55,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:55,883 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-02-09 20:53:55,883 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:55,883 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 20:53:55,883 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-02-09 20:53:55,883 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase9.apache.org,40919,1675976022294' in zk 2023-02-09 20:53:55,887 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-02-09 20:53:55,887 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:55,887 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:53:55,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:55,887 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-02-09 20:53:55,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:53:55,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:53:55,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:53:55,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:53:55,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:55,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:55,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:53:55,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:55,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:55,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase9.apache.org,40919,1675976022294': 2023-02-09 20:53:55,891 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-02-09 20:53:55,891 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-02-09 20:53:55,892 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 20:53:55,892 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 20:53:55,892 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:55,892 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 20:53:55,893 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:55,893 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:55,893 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:55,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:55,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:53:55,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:53:55,893 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:53:55,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:55,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:53:55,894 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:55,894 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:53:55,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:53:55,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:55,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:55,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:53:55,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:55,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:55,895 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:55,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:53:55,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:55,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:55,898 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:55,898 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:53:55,898 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:55,898 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:53:55,898 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-02-09 20:53:55,898 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-09 20:53:55,898 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 20:53:55,898 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:53:55,898 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:55,898 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:53:55,899 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:55,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:53:55,899 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:55,899 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:55,899 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:55,899 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-02-09 20:53:55,899 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 20:53:55,899 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:53:55,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:53:55,999 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 20:53:56,001 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 20:53:56,006 DEBUG [Listener at localhost/46855] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-09 20:53:56,009 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:57456, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-09 20:53:56,011 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=42951] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:56,024 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1675976025848] procedure2.ProcedureExecutor(1029): Stored pid=12, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-02-09 20:53:56,024 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=12, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-02-09 20:53:56,026 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1675976025848] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-09 20:53:56,026 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=12, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1675976636026 2023-02-09 20:53:56,027 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1675976025848] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-09 20:53:56,031 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1675976025848] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthly' and column 'family1' 2023-02-09 20:53:56,031 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1675976025848] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-02-09 20:53:56,031 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1675976025848] zookeeper.ReadOnlyZKClient(139): Connect 0x3b67ed6c to 127.0.0.1:62089 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 20:53:56,079 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1675976025848] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@60a245ab, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 20:53:56,081 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-09 20:53:56,951 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103b2e06f9980f04cf0aa18884ca4322ca8 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160103b2e06f9980f04cf0aa18884ca4322ca8 2023-02-09 20:53:56,952 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-02-09 20:53:56,972 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 20:53:56,974 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:39312, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 20:53:56,985 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-09 20:53:56,986 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:57466, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-09 20:53:57,019 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/6c619ea1d9bc40378c7c8230bad5560c first=Optional[r3] last=Optional[r6] 2023-02-09 20:53:57,030 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1675976026024.8dc66f5ff2c0373922a1a609b1d90cf4., hostname=jenkins-hbase9.apache.org,40919,1675976022294, seqNum=2 for row with hfile group [{family1,hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/6c619ea1d9bc40378c7c8230bad5560c}] 2023-02-09 20:53:57,046 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HStore(763): Validating hfile at hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/6c619ea1d9bc40378c7c8230bad5560c for inclusion in 8dc66f5ff2c0373922a1a609b1d90cf4/family1 2023-02-09 20:53:57,053 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-02-09 20:53:57,053 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HStore(777): Region bounds: first= last= 2023-02-09 20:53:57,053 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HRegion(2445): Flush status journal for 8dc66f5ff2c0373922a1a609b1d90cf4: 2023-02-09 20:53:57,055 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/6c619ea1d9bc40378c7c8230bad5560c to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__2mi3ja4r0bva26mu1vrrh0j5cvtur8k1c4vt5dsm25fjug6o6jpv14vmt0kllt9o/family1/6c619ea1d9bc40378c7c8230bad5560c 2023-02-09 20:53:57,058 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__2mi3ja4r0bva26mu1vrrh0j5cvtur8k1c4vt5dsm25fjug6o6jpv14vmt0kllt9o/family1/6c619ea1d9bc40378c7c8230bad5560c as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8dc66f5ff2c0373922a1a609b1d90cf4/family1/6bac2ec49eb44e54a4b0de1485e81b1f_SeqId_44_ 2023-02-09 20:53:57,059 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HStore(849): Loaded HFile hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__2mi3ja4r0bva26mu1vrrh0j5cvtur8k1c4vt5dsm25fjug6o6jpv14vmt0kllt9o/family1/6c619ea1d9bc40378c7c8230bad5560c into 8dc66f5ff2c0373922a1a609b1d90cf4/family1 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8dc66f5ff2c0373922a1a609b1d90cf4/family1/6bac2ec49eb44e54a4b0de1485e81b1f_SeqId_44_ - updating store file list. 2023-02-09 20:53:57,065 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HStore(882): Loaded HFile hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8dc66f5ff2c0373922a1a609b1d90cf4/family1/6bac2ec49eb44e54a4b0de1485e81b1f_SeqId_44_ into 8dc66f5ff2c0373922a1a609b1d90cf4/family1 2023-02-09 20:53:57,065 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HStore(855): Successfully loaded hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__2mi3ja4r0bva26mu1vrrh0j5cvtur8k1c4vt5dsm25fjug6o6jpv14vmt0kllt9o/family1/6c619ea1d9bc40378c7c8230bad5560c into 8dc66f5ff2c0373922a1a609b1d90cf4/family1 (new location: hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8dc66f5ff2c0373922a1a609b1d90cf4/family1/6bac2ec49eb44e54a4b0de1485e81b1f_SeqId_44_) 2023-02-09 20:53:57,065 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__2mi3ja4r0bva26mu1vrrh0j5cvtur8k1c4vt5dsm25fjug6o6jpv14vmt0kllt9o/family1/6c619ea1d9bc40378c7c8230bad5560c 2023-02-09 20:53:57,067 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-02-09 20:53:57,073 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51357 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-02-09 20:53:57,075 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HStore(1912): 8dc66f5ff2c0373922a1a609b1d90cf4/family1 is initiating minor compaction 2023-02-09 20:53:57,076 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@1210364d; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-09 20:53:57,076 INFO [RS:0;jenkins-hbase9:40919-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 8dc66f5ff2c0373922a1a609b1d90cf4/family1 in testMajorCompactionWithWeeklyFollowedByMonthly,,1675976026024.8dc66f5ff2c0373922a1a609b1d90cf4. 2023-02-09 20:53:57,077 INFO [RS:0;jenkins-hbase9:40919-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8dc66f5ff2c0373922a1a609b1d90cf4/family1/513840e417f34652a361a50f771dfa9e, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8dc66f5ff2c0373922a1a609b1d90cf4/family1/d68ea3e2bea94fbfb3b44732404b0433, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8dc66f5ff2c0373922a1a609b1d90cf4/family1/ce98a9b8059d4033933ed16b7cce2af4, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8dc66f5ff2c0373922a1a609b1d90cf4/family1/58423666922f40d29282b5477f439dff, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8dc66f5ff2c0373922a1a609b1d90cf4/family1/62d7210d15fc41f49ca07c24ae358e81, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8dc66f5ff2c0373922a1a609b1d90cf4/family1/e8589bd30d2a4b928f43689ea40e9ad0, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8dc66f5ff2c0373922a1a609b1d90cf4/family1/1e90149792f14a489b7aa8107202cf4c, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8dc66f5ff2c0373922a1a609b1d90cf4/family1/f90bc607dabd4cd98c43a44fdf076f21, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8dc66f5ff2c0373922a1a609b1d90cf4/family1/ba54485a37414965beda60573be2cd0e, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8dc66f5ff2c0373922a1a609b1d90cf4/family1/6bac2ec49eb44e54a4b0de1485e81b1f_SeqId_44_] into tmpdir=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8dc66f5ff2c0373922a1a609b1d90cf4/.tmp, totalSize=50.2 K 2023-02-09 20:53:57,078 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] compactions.Compactor(207): Compacting 513840e417f34652a361a50f771dfa9e, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-02-09 20:53:57,078 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] compactions.Compactor(207): Compacting d68ea3e2bea94fbfb3b44732404b0433, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-02-09 20:53:57,078 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] compactions.Compactor(207): Compacting ce98a9b8059d4033933ed16b7cce2af4, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-02-09 20:53:57,078 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] compactions.Compactor(207): Compacting 58423666922f40d29282b5477f439dff, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-02-09 20:53:57,078 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] compactions.Compactor(207): Compacting 62d7210d15fc41f49ca07c24ae358e81, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-02-09 20:53:57,078 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] compactions.Compactor(207): Compacting e8589bd30d2a4b928f43689ea40e9ad0, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-02-09 20:53:57,078 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] compactions.Compactor(207): Compacting 1e90149792f14a489b7aa8107202cf4c, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-02-09 20:53:57,078 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] compactions.Compactor(207): Compacting f90bc607dabd4cd98c43a44fdf076f21, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-02-09 20:53:57,079 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] compactions.Compactor(207): Compacting ba54485a37414965beda60573be2cd0e, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-02-09 20:53:57,079 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] compactions.Compactor(207): Compacting 6bac2ec49eb44e54a4b0de1485e81b1f_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-02-09 20:53:57,091 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-02-09 20:53:57,093 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 20:53:57,099 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151228369e63d545ad48a6bf3816d4da8b80b7 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151228369e63d545ad48a6bf3816d4da8b80b7 2023-02-09 20:53:57,100 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151231e5bfac70b8e34b72a33a6e6116e27662 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151231e5bfac70b8e34b72a33a6e6116e27662 2023-02-09 20:53:57,102 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2016010165bbe6dc05d7488d8e4d932b4e049776 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2016010165bbe6dc05d7488d8e4d932b4e049776 2023-02-09 20:53:57,103 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160103ed3940ae726a4ad18d6123038fdd9b9e to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160103ed3940ae726a4ad18d6123038fdd9b9e 2023-02-09 20:53:57,104 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 4 expired mob files are deleted 2023-02-09 20:53:57,104 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-02-09 20:53:57,104 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-09 20:53:57,104 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-09 20:53:57,104 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-09 20:53:57,104 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-09 20:53:57,104 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-09 20:53:57,104 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-09 20:53:57,105 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-09 20:53:57,105 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-09 20:53:57,132 INFO [RS:0;jenkins-hbase9:40919-shortCompactions-0] throttle.PressureAwareThroughputController(145): 8dc66f5ff2c0373922a1a609b1d90cf4#family1#compaction#10 average throughput is 0.36 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-09 20:53:57,961 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8dc66f5ff2c0373922a1a609b1d90cf4/.tmp/family1/729820457ec04ac5ae1241cb1a0f1427 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8dc66f5ff2c0373922a1a609b1d90cf4/family1/729820457ec04ac5ae1241cb1a0f1427 2023-02-09 20:53:57,976 INFO [RS:0;jenkins-hbase9:40919-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 8dc66f5ff2c0373922a1a609b1d90cf4/family1 of 8dc66f5ff2c0373922a1a609b1d90cf4 into 729820457ec04ac5ae1241cb1a0f1427(size=6.6 K), total size for store is 182.5 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-09 20:53:57,976 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 8dc66f5ff2c0373922a1a609b1d90cf4: 2023-02-09 20:53:57,977 INFO [RS:0;jenkins-hbase9:40919-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthly,,1675976026024.8dc66f5ff2c0373922a1a609b1d90cf4., storeName=family1, fileCount=10, fileSize=50.2 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.5 K), priority=2, time=1675976037074; duration=0sec 2023-02-09 20:53:57,978 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-09 20:53:57,991 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120572b5fb887cde44edb3c72e0653b8f4a4 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015120572b5fb887cde44edb3c72e0653b8f4a4 2023-02-09 20:53:57,993 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-02-09 20:53:58,024 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/bd51541b733f48019b72b1280edfb19e first=Optional[r00] last=Optional[r2] 2023-02-09 20:53:58,025 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1675976026024.8dc66f5ff2c0373922a1a609b1d90cf4., hostname=jenkins-hbase9.apache.org,40919,1675976022294, seqNum=2 for row with hfile group [{family1,hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/bd51541b733f48019b72b1280edfb19e}] 2023-02-09 20:53:58,028 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HStore(763): Validating hfile at hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/bd51541b733f48019b72b1280edfb19e for inclusion in 8dc66f5ff2c0373922a1a609b1d90cf4/family1 2023-02-09 20:53:58,031 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-02-09 20:53:58,032 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HStore(777): Region bounds: first= last= 2023-02-09 20:53:58,032 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HRegion(2445): Flush status journal for 8dc66f5ff2c0373922a1a609b1d90cf4: 2023-02-09 20:53:58,033 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/bd51541b733f48019b72b1280edfb19e to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__di1hbl9bdilm6g65m3qu2valkm07unpubg3gu0ngs5fqs1gubnaslm687genigq1/family1/bd51541b733f48019b72b1280edfb19e 2023-02-09 20:53:58,036 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__di1hbl9bdilm6g65m3qu2valkm07unpubg3gu0ngs5fqs1gubnaslm687genigq1/family1/bd51541b733f48019b72b1280edfb19e as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8dc66f5ff2c0373922a1a609b1d90cf4/family1/edb56ceb16cd47b99d7b5b1a0b2c36b2_SeqId_47_ 2023-02-09 20:53:58,037 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HStore(849): Loaded HFile hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__di1hbl9bdilm6g65m3qu2valkm07unpubg3gu0ngs5fqs1gubnaslm687genigq1/family1/bd51541b733f48019b72b1280edfb19e into 8dc66f5ff2c0373922a1a609b1d90cf4/family1 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8dc66f5ff2c0373922a1a609b1d90cf4/family1/edb56ceb16cd47b99d7b5b1a0b2c36b2_SeqId_47_ - updating store file list. 2023-02-09 20:53:58,042 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HStore(882): Loaded HFile hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8dc66f5ff2c0373922a1a609b1d90cf4/family1/edb56ceb16cd47b99d7b5b1a0b2c36b2_SeqId_47_ into 8dc66f5ff2c0373922a1a609b1d90cf4/family1 2023-02-09 20:53:58,042 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HStore(855): Successfully loaded hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__di1hbl9bdilm6g65m3qu2valkm07unpubg3gu0ngs5fqs1gubnaslm687genigq1/family1/bd51541b733f48019b72b1280edfb19e into 8dc66f5ff2c0373922a1a609b1d90cf4/family1 (new location: hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8dc66f5ff2c0373922a1a609b1d90cf4/family1/edb56ceb16cd47b99d7b5b1a0b2c36b2_SeqId_47_) 2023-02-09 20:53:58,043 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__di1hbl9bdilm6g65m3qu2valkm07unpubg3gu0ngs5fqs1gubnaslm687genigq1/family1/bd51541b733f48019b72b1280edfb19e 2023-02-09 20:53:58,043 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-02-09 20:53:58,044 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 367249 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-02-09 20:53:58,045 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HStore(1912): 8dc66f5ff2c0373922a1a609b1d90cf4/family1 is initiating minor compaction (all files) 2023-02-09 20:53:58,045 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@6584ae04; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-09 20:53:58,045 INFO [RS:0;jenkins-hbase9:40919-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 8dc66f5ff2c0373922a1a609b1d90cf4/family1 in testMajorCompactionWithWeeklyFollowedByMonthly,,1675976026024.8dc66f5ff2c0373922a1a609b1d90cf4. 2023-02-09 20:53:58,046 INFO [RS:0;jenkins-hbase9:40919-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8dc66f5ff2c0373922a1a609b1d90cf4/family1/cd1c6ea061724a3fba86c5717a56aa80, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8dc66f5ff2c0373922a1a609b1d90cf4/family1/729820457ec04ac5ae1241cb1a0f1427, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8dc66f5ff2c0373922a1a609b1d90cf4/family1/edb56ceb16cd47b99d7b5b1a0b2c36b2_SeqId_47_] into tmpdir=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8dc66f5ff2c0373922a1a609b1d90cf4/.tmp, totalSize=358.6 K 2023-02-09 20:53:58,046 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] compactions.Compactor(207): Compacting cd1c6ea061724a3fba86c5717a56aa80, keycount=1000, bloomtype=ROW, size=175.8 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878845982 2023-02-09 20:53:58,047 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] compactions.Compactor(207): Compacting 729820457ec04ac5ae1241cb1a0f1427, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621245982 2023-02-09 20:53:58,048 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] compactions.Compactor(207): Compacting edb56ceb16cd47b99d7b5b1a0b2c36b2_SeqId_47_, keycount=1002, bloomtype=ROW, size=176.2 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878845982 2023-02-09 20:53:58,049 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-02-09 20:53:58,050 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 20:53:58,053 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511309ccc0455d62d4b34bdddb1a4bc51ee81 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511309ccc0455d62d4b34bdddb1a4bc51ee81 2023-02-09 20:53:58,058 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512012fd0c2497aac49e6b160dc1e14525efd to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512012fd0c2497aac49e6b160dc1e14525efd 2023-02-09 20:53:58,064 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151205eda9edf8ae1e4f718c6bde74caee05e6 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151205eda9edf8ae1e4f718c6bde74caee05e6 2023-02-09 20:53:58,064 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 3 expired mob files are deleted 2023-02-09 20:53:58,064 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-02-09 20:53:58,066 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-09 20:53:58,066 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1675976025848] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-02-09 20:53:58,073 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8dc66f5ff2c0373922a1a609b1d90cf4/family1/513840e417f34652a361a50f771dfa9e, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8dc66f5ff2c0373922a1a609b1d90cf4/family1/d68ea3e2bea94fbfb3b44732404b0433, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8dc66f5ff2c0373922a1a609b1d90cf4/family1/ce98a9b8059d4033933ed16b7cce2af4, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8dc66f5ff2c0373922a1a609b1d90cf4/family1/58423666922f40d29282b5477f439dff, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8dc66f5ff2c0373922a1a609b1d90cf4/family1/62d7210d15fc41f49ca07c24ae358e81, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8dc66f5ff2c0373922a1a609b1d90cf4/family1/e8589bd30d2a4b928f43689ea40e9ad0, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8dc66f5ff2c0373922a1a609b1d90cf4/family1/1e90149792f14a489b7aa8107202cf4c, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8dc66f5ff2c0373922a1a609b1d90cf4/family1/f90bc607dabd4cd98c43a44fdf076f21, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8dc66f5ff2c0373922a1a609b1d90cf4/family1/ba54485a37414965beda60573be2cd0e, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8dc66f5ff2c0373922a1a609b1d90cf4/family1/6bac2ec49eb44e54a4b0de1485e81b1f_SeqId_44_] to archive 2023-02-09 20:53:58,073 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1675976025848] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-09 20:53:58,074 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=12, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-02-09 20:53:58,075 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 20:53:58,076 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=12, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE in 2.0580 sec 2023-02-09 20:53:58,078 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8dc66f5ff2c0373922a1a609b1d90cf4/family1/513840e417f34652a361a50f771dfa9e to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8dc66f5ff2c0373922a1a609b1d90cf4/family1/513840e417f34652a361a50f771dfa9e 2023-02-09 20:53:58,079 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8dc66f5ff2c0373922a1a609b1d90cf4/family1/d68ea3e2bea94fbfb3b44732404b0433 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8dc66f5ff2c0373922a1a609b1d90cf4/family1/d68ea3e2bea94fbfb3b44732404b0433 2023-02-09 20:53:58,081 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8dc66f5ff2c0373922a1a609b1d90cf4/family1/ce98a9b8059d4033933ed16b7cce2af4 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8dc66f5ff2c0373922a1a609b1d90cf4/family1/ce98a9b8059d4033933ed16b7cce2af4 2023-02-09 20:53:58,082 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8dc66f5ff2c0373922a1a609b1d90cf4/family1/58423666922f40d29282b5477f439dff to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8dc66f5ff2c0373922a1a609b1d90cf4/family1/58423666922f40d29282b5477f439dff 2023-02-09 20:53:58,084 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8dc66f5ff2c0373922a1a609b1d90cf4/family1/62d7210d15fc41f49ca07c24ae358e81 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8dc66f5ff2c0373922a1a609b1d90cf4/family1/62d7210d15fc41f49ca07c24ae358e81 2023-02-09 20:53:58,086 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8dc66f5ff2c0373922a1a609b1d90cf4/family1/e8589bd30d2a4b928f43689ea40e9ad0 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8dc66f5ff2c0373922a1a609b1d90cf4/family1/e8589bd30d2a4b928f43689ea40e9ad0 2023-02-09 20:53:58,088 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8dc66f5ff2c0373922a1a609b1d90cf4/family1/1e90149792f14a489b7aa8107202cf4c to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8dc66f5ff2c0373922a1a609b1d90cf4/family1/1e90149792f14a489b7aa8107202cf4c 2023-02-09 20:53:58,089 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8dc66f5ff2c0373922a1a609b1d90cf4/family1/f90bc607dabd4cd98c43a44fdf076f21 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8dc66f5ff2c0373922a1a609b1d90cf4/family1/f90bc607dabd4cd98c43a44fdf076f21 2023-02-09 20:53:58,092 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8dc66f5ff2c0373922a1a609b1d90cf4/family1/ba54485a37414965beda60573be2cd0e to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8dc66f5ff2c0373922a1a609b1d90cf4/family1/ba54485a37414965beda60573be2cd0e 2023-02-09 20:53:58,094 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8dc66f5ff2c0373922a1a609b1d90cf4/family1/6bac2ec49eb44e54a4b0de1485e81b1f_SeqId_44_ to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8dc66f5ff2c0373922a1a609b1d90cf4/family1/6bac2ec49eb44e54a4b0de1485e81b1f_SeqId_44_ 2023-02-09 20:53:58,111 INFO [RS:0;jenkins-hbase9:40919-shortCompactions-0] throttle.PressureAwareThroughputController(145): 8dc66f5ff2c0373922a1a609b1d90cf4#family1#compaction#11 average throughput is 4.35 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-09 20:53:58,156 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8dc66f5ff2c0373922a1a609b1d90cf4/.tmp/family1/c66f62a69f0a45a0ab8d4e5e6f708f59 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8dc66f5ff2c0373922a1a609b1d90cf4/family1/c66f62a69f0a45a0ab8d4e5e6f708f59 2023-02-09 20:53:58,173 INFO [RS:0;jenkins-hbase9:40919-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 8dc66f5ff2c0373922a1a609b1d90cf4/family1 of 8dc66f5ff2c0373922a1a609b1d90cf4 into c66f62a69f0a45a0ab8d4e5e6f708f59(size=177.2 K), total size for store is 177.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-09 20:53:58,174 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 8dc66f5ff2c0373922a1a609b1d90cf4: 2023-02-09 20:53:58,174 INFO [RS:0;jenkins-hbase9:40919-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthly,,1675976026024.8dc66f5ff2c0373922a1a609b1d90cf4., storeName=family1, fileCount=3, fileSize=358.6 K (175.8 K, 6.6 K, 176.2 K), priority=2, time=1675976038045; duration=0sec 2023-02-09 20:53:58,174 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-09 20:53:58,245 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.HMaster$12(2441): Client=jenkins//172.31.2.10 modify table testMajorCompactionWithWeeklyFollowedByMonthly from 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-02-09 20:53:58,254 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8dc66f5ff2c0373922a1a609b1d90cf4/family1/cd1c6ea061724a3fba86c5717a56aa80, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8dc66f5ff2c0373922a1a609b1d90cf4/family1/729820457ec04ac5ae1241cb1a0f1427, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8dc66f5ff2c0373922a1a609b1d90cf4/family1/edb56ceb16cd47b99d7b5b1a0b2c36b2_SeqId_47_] to archive 2023-02-09 20:53:58,255 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 20:53:58,258 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:58,258 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8dc66f5ff2c0373922a1a609b1d90cf4/family1/cd1c6ea061724a3fba86c5717a56aa80 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8dc66f5ff2c0373922a1a609b1d90cf4/family1/cd1c6ea061724a3fba86c5717a56aa80 2023-02-09 20:53:58,261 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8dc66f5ff2c0373922a1a609b1d90cf4/family1/729820457ec04ac5ae1241cb1a0f1427 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8dc66f5ff2c0373922a1a609b1d90cf4/family1/729820457ec04ac5ae1241cb1a0f1427 2023-02-09 20:53:58,263 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8dc66f5ff2c0373922a1a609b1d90cf4/family1/edb56ceb16cd47b99d7b5b1a0b2c36b2_SeqId_47_ to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8dc66f5ff2c0373922a1a609b1d90cf4/family1/edb56ceb16cd47b99d7b5b1a0b2c36b2_SeqId_47_ 2023-02-09 20:53:58,674 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000002 2023-02-09 20:53:58,675 DEBUG [PEWorker-2] util.FSTableDescriptors(519): Deleted hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000001 2023-02-09 20:53:58,675 INFO [PEWorker-2] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000002 2023-02-09 20:53:58,681 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=14, ppid=13, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly}] 2023-02-09 20:53:58,693 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=8dc66f5ff2c0373922a1a609b1d90cf4, REOPEN/MOVE}] 2023-02-09 20:53:58,694 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=8dc66f5ff2c0373922a1a609b1d90cf4, REOPEN/MOVE 2023-02-09 20:53:58,695 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=8dc66f5ff2c0373922a1a609b1d90cf4, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:58,695 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1675976026024.8dc66f5ff2c0373922a1a609b1d90cf4.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1675976038695"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675976038695"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675976038695"}]},"ts":"1675976038695"} 2023-02-09 20:53:58,697 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE; CloseRegionProcedure 8dc66f5ff2c0373922a1a609b1d90cf4, server=jenkins-hbase9.apache.org,40919,1675976022294}] 2023-02-09 20:53:58,855 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(109): Close 8dc66f5ff2c0373922a1a609b1d90cf4 2023-02-09 20:53:58,856 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing 8dc66f5ff2c0373922a1a609b1d90cf4, disabling compactions & flushes 2023-02-09 20:53:58,856 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1675976026024.8dc66f5ff2c0373922a1a609b1d90cf4. 2023-02-09 20:53:58,856 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1675976026024.8dc66f5ff2c0373922a1a609b1d90cf4. 2023-02-09 20:53:58,856 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1675976026024.8dc66f5ff2c0373922a1a609b1d90cf4. after waiting 0 ms 2023-02-09 20:53:58,856 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1675976026024.8dc66f5ff2c0373922a1a609b1d90cf4. 2023-02-09 20:53:58,862 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8dc66f5ff2c0373922a1a609b1d90cf4/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-02-09 20:53:58,863 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1675976026024.8dc66f5ff2c0373922a1a609b1d90cf4. 2023-02-09 20:53:58,863 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for 8dc66f5ff2c0373922a1a609b1d90cf4: Waiting for close lock at 1675976038856Running coprocessor pre-close hooks at 1675976038856Disabling compacts and flushes for region at 1675976038856Disabling writes for close at 1675976038856Writing region close event to WAL at 1675976038858 (+2 ms)Running coprocessor post-close hooks at 1675976038863 (+5 ms)Closed at 1675976038863 2023-02-09 20:53:58,863 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(3509): Not adding moved region record: 8dc66f5ff2c0373922a1a609b1d90cf4 to self. 2023-02-09 20:53:58,866 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(147): Closed 8dc66f5ff2c0373922a1a609b1d90cf4 2023-02-09 20:53:58,866 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=8dc66f5ff2c0373922a1a609b1d90cf4, regionState=CLOSED 2023-02-09 20:53:58,866 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1675976026024.8dc66f5ff2c0373922a1a609b1d90cf4.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1675976038866"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675976038866"}]},"ts":"1675976038866"} 2023-02-09 20:53:58,870 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-09 20:53:58,871 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; CloseRegionProcedure 8dc66f5ff2c0373922a1a609b1d90cf4, server=jenkins-hbase9.apache.org,40919,1675976022294 in 171 msec 2023-02-09 20:53:58,871 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=8dc66f5ff2c0373922a1a609b1d90cf4, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase9.apache.org,40919,1675976022294; forceNewPlan=false, retain=true 2023-02-09 20:53:59,022 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=8dc66f5ff2c0373922a1a609b1d90cf4, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:59,022 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1675976026024.8dc66f5ff2c0373922a1a609b1d90cf4.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1675976039022"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675976039022"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675976039022"}]},"ts":"1675976039022"} 2023-02-09 20:53:59,025 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=15, state=RUNNABLE; OpenRegionProcedure 8dc66f5ff2c0373922a1a609b1d90cf4, server=jenkins-hbase9.apache.org,40919,1675976022294}] 2023-02-09 20:53:59,181 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthly,,1675976026024.8dc66f5ff2c0373922a1a609b1d90cf4. 2023-02-09 20:53:59,181 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 8dc66f5ff2c0373922a1a609b1d90cf4, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1675976026024.8dc66f5ff2c0373922a1a609b1d90cf4.', STARTKEY => '', ENDKEY => ''} 2023-02-09 20:53:59,182 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthly 8dc66f5ff2c0373922a1a609b1d90cf4 2023-02-09 20:53:59,182 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1675976026024.8dc66f5ff2c0373922a1a609b1d90cf4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 20:53:59,182 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for 8dc66f5ff2c0373922a1a609b1d90cf4 2023-02-09 20:53:59,182 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for 8dc66f5ff2c0373922a1a609b1d90cf4 2023-02-09 20:53:59,183 INFO [StoreOpener-8dc66f5ff2c0373922a1a609b1d90cf4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 8dc66f5ff2c0373922a1a609b1d90cf4 2023-02-09 20:53:59,185 DEBUG [StoreOpener-8dc66f5ff2c0373922a1a609b1d90cf4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8dc66f5ff2c0373922a1a609b1d90cf4/family1 2023-02-09 20:53:59,185 DEBUG [StoreOpener-8dc66f5ff2c0373922a1a609b1d90cf4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8dc66f5ff2c0373922a1a609b1d90cf4/family1 2023-02-09 20:53:59,185 INFO [StoreOpener-8dc66f5ff2c0373922a1a609b1d90cf4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8dc66f5ff2c0373922a1a609b1d90cf4 columnFamilyName family1 2023-02-09 20:53:59,192 DEBUG [StoreOpener-8dc66f5ff2c0373922a1a609b1d90cf4-1] regionserver.HStore(539): loaded hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8dc66f5ff2c0373922a1a609b1d90cf4/family1/c66f62a69f0a45a0ab8d4e5e6f708f59 2023-02-09 20:53:59,193 INFO [StoreOpener-8dc66f5ff2c0373922a1a609b1d90cf4-1] regionserver.HStore(310): Store=8dc66f5ff2c0373922a1a609b1d90cf4/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 20:53:59,194 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8dc66f5ff2c0373922a1a609b1d90cf4 2023-02-09 20:53:59,195 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8dc66f5ff2c0373922a1a609b1d90cf4 2023-02-09 20:53:59,198 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for 8dc66f5ff2c0373922a1a609b1d90cf4 2023-02-09 20:53:59,199 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened 8dc66f5ff2c0373922a1a609b1d90cf4; next sequenceid=51; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62543917, jitterRate=-0.06802301108837128}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-09 20:53:59,199 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for 8dc66f5ff2c0373922a1a609b1d90cf4: Running coprocessor pre-open hook at 1675976039182Writing region info on filesystem at 1675976039182Initializing all the Stores at 1675976039183 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} at 1675976039183Cleaning up temporary data from old regions at 1675976039195 (+12 ms)Cleaning up detritus from prior splits at 1675976039196 (+1 ms)Running coprocessor post-open hooks at 1675976039199 (+3 ms)Region opened successfully at 1675976039199 2023-02-09 20:53:59,200 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthly,,1675976026024.8dc66f5ff2c0373922a1a609b1d90cf4., pid=17, masterSystemTime=1675976039177 2023-02-09 20:53:59,202 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthly,,1675976026024.8dc66f5ff2c0373922a1a609b1d90cf4. 2023-02-09 20:53:59,202 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthly,,1675976026024.8dc66f5ff2c0373922a1a609b1d90cf4. 2023-02-09 20:53:59,202 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=8dc66f5ff2c0373922a1a609b1d90cf4, regionState=OPEN, openSeqNum=51, regionLocation=jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:53:59,203 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1675976026024.8dc66f5ff2c0373922a1a609b1d90cf4.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1675976039202"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675976039202"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675976039202"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675976039202"}]},"ts":"1675976039202"} 2023-02-09 20:53:59,206 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=15 2023-02-09 20:53:59,206 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=15, state=SUCCESS; OpenRegionProcedure 8dc66f5ff2c0373922a1a609b1d90cf4, server=jenkins-hbase9.apache.org,40919,1675976022294 in 179 msec 2023-02-09 20:53:59,208 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=15, resume processing ppid=14 2023-02-09 20:53:59,208 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=14, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=8dc66f5ff2c0373922a1a609b1d90cf4, REOPEN/MOVE in 513 msec 2023-02-09 20:53:59,211 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=14, resume processing ppid=13 2023-02-09 20:53:59,211 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=13, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 530 msec 2023-02-09 20:53:59,214 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 963 msec 2023-02-09 20:53:59,216 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1227): Checking to see if procedure is done pid=13 2023-02-09 20:53:59,223 INFO [Listener at localhost/46855] compactions.TestMobCompactor(278): alter status finished 2023-02-09 20:53:59,224 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=42951] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-09 20:53:59,226 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1675976025848] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-02-09 20:53:59,227 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-02-09 20:53:59,228 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1675976025848] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-09 20:53:59,228 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1675976639228 2023-02-09 20:53:59,229 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1675976025848] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-09 20:53:59,230 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1675976025848] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthly' and column 'family1' 2023-02-09 20:53:59,230 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1675976025848] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-02-09 20:53:59,230 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1675976025848] zookeeper.ReadOnlyZKClient(139): Connect 0x24124008 to 127.0.0.1:62089 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 20:53:59,235 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1675976025848] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3cddc548, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 20:53:59,235 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-09 20:53:59,236 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-09 20:53:59,236 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-09 20:53:59,236 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-09 20:53:59,236 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-09 20:54:00,070 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128e6590e208e40462eb3226a14edc8c529 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151128e6590e208e40462eb3226a14edc8c529 2023-02-09 20:54:00,072 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-02-09 20:54:00,084 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 20:54:00,085 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:39318, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 20:54:00,093 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-09 20:54:00,094 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:57474, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-09 20:54:00,105 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/f16a168c516c4d4a9e4bf25f85afd059 first=Optional[r05] last=Optional[r8] 2023-02-09 20:54:00,105 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1675976026024.8dc66f5ff2c0373922a1a609b1d90cf4., hostname=jenkins-hbase9.apache.org,40919,1675976022294, seqNum=51 for row with hfile group [{family1,hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/f16a168c516c4d4a9e4bf25f85afd059}] 2023-02-09 20:54:00,110 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HStore(763): Validating hfile at hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/f16a168c516c4d4a9e4bf25f85afd059 for inclusion in 8dc66f5ff2c0373922a1a609b1d90cf4/family1 2023-02-09 20:54:00,114 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-02-09 20:54:00,114 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HStore(777): Region bounds: first= last= 2023-02-09 20:54:00,114 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HRegion(2445): Flush status journal for 8dc66f5ff2c0373922a1a609b1d90cf4: 2023-02-09 20:54:00,115 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/f16a168c516c4d4a9e4bf25f85afd059 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__5kr6trfo3k0ph6al1hi11dksngbkamh5r8f1bdr4kkkdk5m4eh2rlmbdhh4nvlgm/family1/f16a168c516c4d4a9e4bf25f85afd059 2023-02-09 20:54:00,118 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__5kr6trfo3k0ph6al1hi11dksngbkamh5r8f1bdr4kkkdk5m4eh2rlmbdhh4nvlgm/family1/f16a168c516c4d4a9e4bf25f85afd059 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8dc66f5ff2c0373922a1a609b1d90cf4/family1/8f217821f6684583a7398a9e124d20a9_SeqId_53_ 2023-02-09 20:54:00,119 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HStore(849): Loaded HFile hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__5kr6trfo3k0ph6al1hi11dksngbkamh5r8f1bdr4kkkdk5m4eh2rlmbdhh4nvlgm/family1/f16a168c516c4d4a9e4bf25f85afd059 into 8dc66f5ff2c0373922a1a609b1d90cf4/family1 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8dc66f5ff2c0373922a1a609b1d90cf4/family1/8f217821f6684583a7398a9e124d20a9_SeqId_53_ - updating store file list. 2023-02-09 20:54:00,123 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HStore(882): Loaded HFile hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8dc66f5ff2c0373922a1a609b1d90cf4/family1/8f217821f6684583a7398a9e124d20a9_SeqId_53_ into 8dc66f5ff2c0373922a1a609b1d90cf4/family1 2023-02-09 20:54:00,124 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HStore(855): Successfully loaded hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__5kr6trfo3k0ph6al1hi11dksngbkamh5r8f1bdr4kkkdk5m4eh2rlmbdhh4nvlgm/family1/f16a168c516c4d4a9e4bf25f85afd059 into 8dc66f5ff2c0373922a1a609b1d90cf4/family1 (new location: hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8dc66f5ff2c0373922a1a609b1d90cf4/family1/8f217821f6684583a7398a9e124d20a9_SeqId_53_) 2023-02-09 20:54:00,124 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__5kr6trfo3k0ph6al1hi11dksngbkamh5r8f1bdr4kkkdk5m4eh2rlmbdhh4nvlgm/family1/f16a168c516c4d4a9e4bf25f85afd059 2023-02-09 20:54:00,126 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-02-09 20:54:00,127 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 20:54:00,128 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015112053a4786428294e0c9d681ee0c1711324 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015112053a4786428294e0c9d681ee0c1711324 2023-02-09 20:54:00,130 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511285cb6aec07b2e4e68a57d9ec156c59d0f to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511285cb6aec07b2e4e68a57d9ec156c59d0f 2023-02-09 20:54:00,130 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 2 expired mob files are deleted 2023-02-09 20:54:00,130 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-02-09 20:54:00,130 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-09 20:54:00,130 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-09 20:54:00,130 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-09 20:54:00,130 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1675976025848] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-02-09 20:54:00,131 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1675976025848] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-09 20:54:00,131 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-02-09 20:54:00,133 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE in 906 msec 2023-02-09 20:54:00,200 INFO [Listener at localhost/46855] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthly Thread=245 (was 212) Potentially hanging thread: HFileArchiver-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1937004114_15 at /127.0.0.1:38388 [Waiting for operation #12] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hfile_cleaner-dir-scan-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x14d9ae60-shared-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1937004114_15 at /127.0.0.1:38488 [Waiting for operation #12] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1675976025848 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1937004114_15 at /127.0.0.1:38412 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1937004114_15 at /127.0.0.1:38452 [Waiting for operation #22] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1937004114_15 at /127.0.0.1:38510 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1937004114_15 at /127.0.0.1:38606 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1937004114_15 at /127.0.0.1:38514 [Waiting for operation #13] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:62089@0x24124008 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$45/635576566.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1937004114_15 at /127.0.0.1:38590 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:62089@0x3b67ed6c-SendThread(127.0.0.1:62089) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:345) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1223) Potentially hanging thread: hconnection-0x14d9ae60-metaLookup-shared--pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hfile_cleaner-dir-scan-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'HBase' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:62089@0x3b67ed6c sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$45/635576566.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:62089@0x24124008-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: MobCompactor-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x719027c9-shared-pool-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1937004114_15 at /127.0.0.1:38436 [Waiting for operation #14] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1937004114_15 at /127.0.0.1:38430 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1937004114_15 at /127.0.0.1:38492 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x14d9ae60-shared-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RSProcedureDispatcher-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS:0;jenkins-hbase9:40919-shortCompactions-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.PriorityBlockingQueue.take(PriorityBlockingQueue.java:549) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_225982754_15 at /127.0.0.1:38480 [Waiting for operation #15] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:62089@0x24124008-SendThread(127.0.0.1:62089) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:345) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1223) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1937004114_15 at /127.0.0.1:38408 [Waiting for operation #17] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:62089@0x3b67ed6c-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: hconnection-0x719027c9-shared-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=584 (was 475) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=274 (was 344), ProcessCount=168 (was 168), AvailableMemoryMB=11508 (was 11640) 2023-02-09 20:54:00,212 INFO [Listener at localhost/46855] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithMonthlyPolicy Thread=245, OpenFileDescriptor=584, MaxFileDescriptor=60000, SystemLoadAverage=274, ProcessCount=168, AvailableMemoryMB=11508 2023-02-09 20:54:00,214 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.HMaster$4(2102): Client=jenkins//172.31.2.10 create 'testMajorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-02-09 20:54:00,215 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure2.ProcedureExecutor(1029): Stored pid=19, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:00,216 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-02-09 20:54:00,217 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(697): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithMonthlyPolicy" procId is: 19 2023-02-09 20:54:00,217 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-09 20:54:00,217 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1227): Checking to see if procedure is done pid=19 2023-02-09 20:54:00,219 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/2453f3b87d227457629ba8909b526463 2023-02-09 20:54:00,219 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/2453f3b87d227457629ba8909b526463 empty. 2023-02-09 20:54:00,220 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/2453f3b87d227457629ba8909b526463 2023-02-09 20:54:00,220 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithMonthlyPolicy regions 2023-02-09 20:54:00,318 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1227): Checking to see if procedure is done pid=19 2023-02-09 20:54:00,520 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1227): Checking to see if procedure is done pid=19 2023-02-09 20:54:00,629 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/.tabledesc/.tableinfo.0000000001 2023-02-09 20:54:00,631 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(7671): creating {ENCODED => 2453f3b87d227457629ba8909b526463, NAME => 'testMajorCompactionWithMonthlyPolicy,,1675976040214.2453f3b87d227457629ba8909b526463.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}, regionDir=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/.tmp 2023-02-09 20:54:00,821 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1227): Checking to see if procedure is done pid=19 2023-02-09 20:54:01,038 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithMonthlyPolicy,,1675976040214.2453f3b87d227457629ba8909b526463.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 20:54:01,038 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1603): Closing 2453f3b87d227457629ba8909b526463, disabling compactions & flushes 2023-02-09 20:54:01,038 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithMonthlyPolicy,,1675976040214.2453f3b87d227457629ba8909b526463. 2023-02-09 20:54:01,038 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithMonthlyPolicy,,1675976040214.2453f3b87d227457629ba8909b526463. 2023-02-09 20:54:01,038 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithMonthlyPolicy,,1675976040214.2453f3b87d227457629ba8909b526463. after waiting 0 ms 2023-02-09 20:54:01,038 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithMonthlyPolicy,,1675976040214.2453f3b87d227457629ba8909b526463. 2023-02-09 20:54:01,038 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1837): Closed testMajorCompactionWithMonthlyPolicy,,1675976040214.2453f3b87d227457629ba8909b526463. 2023-02-09 20:54:01,038 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1557): Region close journal for 2453f3b87d227457629ba8909b526463: Waiting for close lock at 1675976041038Disabling compacts and flushes for region at 1675976041038Disabling writes for close at 1675976041038Writing region close event to WAL at 1675976041038Closed at 1675976041038 2023-02-09 20:54:01,041 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-02-09 20:54:01,042 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithMonthlyPolicy,,1675976040214.2453f3b87d227457629ba8909b526463.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1675976041042"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675976041042"}]},"ts":"1675976041042"} 2023-02-09 20:54:01,044 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-09 20:54:01,044 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-09 20:54:01,045 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675976041045"}]},"ts":"1675976041045"} 2023-02-09 20:54:01,046 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithMonthlyPolicy, state=ENABLING in hbase:meta 2023-02-09 20:54:01,050 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=2453f3b87d227457629ba8909b526463, ASSIGN}] 2023-02-09 20:54:01,051 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=2453f3b87d227457629ba8909b526463, ASSIGN 2023-02-09 20:54:01,052 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=2453f3b87d227457629ba8909b526463, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,40919,1675976022294; forceNewPlan=false, retain=false 2023-02-09 20:54:01,203 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=2453f3b87d227457629ba8909b526463, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:01,203 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithMonthlyPolicy,,1675976040214.2453f3b87d227457629ba8909b526463.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1675976041203"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675976041203"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675976041203"}]},"ts":"1675976041203"} 2023-02-09 20:54:01,205 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=21, ppid=20, state=RUNNABLE; OpenRegionProcedure 2453f3b87d227457629ba8909b526463, server=jenkins-hbase9.apache.org,40919,1675976022294}] 2023-02-09 20:54:01,322 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1227): Checking to see if procedure is done pid=19 2023-02-09 20:54:01,361 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithMonthlyPolicy,,1675976040214.2453f3b87d227457629ba8909b526463. 2023-02-09 20:54:01,361 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 2453f3b87d227457629ba8909b526463, NAME => 'testMajorCompactionWithMonthlyPolicy,,1675976040214.2453f3b87d227457629ba8909b526463.', STARTKEY => '', ENDKEY => ''} 2023-02-09 20:54:01,362 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithMonthlyPolicy 2453f3b87d227457629ba8909b526463 2023-02-09 20:54:01,362 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithMonthlyPolicy,,1675976040214.2453f3b87d227457629ba8909b526463.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 20:54:01,362 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for 2453f3b87d227457629ba8909b526463 2023-02-09 20:54:01,362 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for 2453f3b87d227457629ba8909b526463 2023-02-09 20:54:01,363 INFO [StoreOpener-2453f3b87d227457629ba8909b526463-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 2453f3b87d227457629ba8909b526463 2023-02-09 20:54:01,365 DEBUG [StoreOpener-2453f3b87d227457629ba8909b526463-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithMonthlyPolicy/2453f3b87d227457629ba8909b526463/family1 2023-02-09 20:54:01,365 DEBUG [StoreOpener-2453f3b87d227457629ba8909b526463-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithMonthlyPolicy/2453f3b87d227457629ba8909b526463/family1 2023-02-09 20:54:01,365 INFO [StoreOpener-2453f3b87d227457629ba8909b526463-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2453f3b87d227457629ba8909b526463 columnFamilyName family1 2023-02-09 20:54:01,367 INFO [StoreOpener-2453f3b87d227457629ba8909b526463-1] regionserver.HStore(310): Store=2453f3b87d227457629ba8909b526463/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 20:54:01,368 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithMonthlyPolicy/2453f3b87d227457629ba8909b526463 2023-02-09 20:54:01,368 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithMonthlyPolicy/2453f3b87d227457629ba8909b526463 2023-02-09 20:54:01,371 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for 2453f3b87d227457629ba8909b526463 2023-02-09 20:54:01,374 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithMonthlyPolicy/2453f3b87d227457629ba8909b526463/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 20:54:01,374 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened 2453f3b87d227457629ba8909b526463; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71109018, jitterRate=0.05960693955421448}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-09 20:54:01,374 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for 2453f3b87d227457629ba8909b526463: Running coprocessor pre-open hook at 1675976041362Writing region info on filesystem at 1675976041362Initializing all the Stores at 1675976041363 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} at 1675976041363Cleaning up temporary data from old regions at 1675976041369 (+6 ms)Cleaning up detritus from prior splits at 1675976041369Running coprocessor post-open hooks at 1675976041374 (+5 ms)Region opened successfully at 1675976041374 2023-02-09 20:54:01,375 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithMonthlyPolicy,,1675976040214.2453f3b87d227457629ba8909b526463., pid=21, masterSystemTime=1675976041357 2023-02-09 20:54:01,377 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithMonthlyPolicy,,1675976040214.2453f3b87d227457629ba8909b526463. 2023-02-09 20:54:01,377 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithMonthlyPolicy,,1675976040214.2453f3b87d227457629ba8909b526463. 2023-02-09 20:54:01,378 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=2453f3b87d227457629ba8909b526463, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:01,378 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithMonthlyPolicy,,1675976040214.2453f3b87d227457629ba8909b526463.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1675976041378"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675976041378"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675976041378"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675976041378"}]},"ts":"1675976041378"} 2023-02-09 20:54:01,382 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=21, resume processing ppid=20 2023-02-09 20:54:01,382 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=20, state=SUCCESS; OpenRegionProcedure 2453f3b87d227457629ba8909b526463, server=jenkins-hbase9.apache.org,40919,1675976022294 in 175 msec 2023-02-09 20:54:01,384 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=20, resume processing ppid=19 2023-02-09 20:54:01,384 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=19, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=2453f3b87d227457629ba8909b526463, ASSIGN in 332 msec 2023-02-09 20:54:01,385 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-09 20:54:01,385 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675976041385"}]},"ts":"1675976041385"} 2023-02-09 20:54:01,386 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithMonthlyPolicy, state=ENABLED in hbase:meta 2023-02-09 20:54:01,389 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-02-09 20:54:01,391 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=19, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy in 1.1750 sec 2023-02-09 20:54:01,418 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithMonthlyPolicy' 2023-02-09 20:54:02,323 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1227): Checking to see if procedure is done pid=19 2023-02-09 20:54:02,324 INFO [Listener at localhost/46855] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithMonthlyPolicy, procId: 19 completed 2023-02-09 20:54:02,352 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(933): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-02-09 20:54:02,354 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:02,354 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-02-09 20:54:02,354 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:54:02,354 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-09 20:54:02,354 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-09 20:54:02,355 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:02,355 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:02,356 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:02,356 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:54:02,356 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:54:02,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:54:02,356 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:02,357 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 20:54:02,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:02,357 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:02,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 20:54:02,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:02,358 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:02,358 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:02,358 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-09 20:54:02,358 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:54:02,359 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-09 20:54:02,359 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 20:54:02,359 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 20:54:02,359 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1675976040214.2453f3b87d227457629ba8909b526463. 2023-02-09 20:54:02,359 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1675976040214.2453f3b87d227457629ba8909b526463. started... 2023-02-09 20:54:02,360 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 2453f3b87d227457629ba8909b526463 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-02-09 20:54:02,388 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015113021c5051e1976468787d88e6c82d6f6e5 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015113021c5051e1976468787d88e6c82d6f6e5 2023-02-09 20:54:02,792 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithMonthlyPolicy/2453f3b87d227457629ba8909b526463/.tmp/family1/d7c24654ee8649a9a1a725ddd3b970f7 2023-02-09 20:54:02,799 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithMonthlyPolicy/2453f3b87d227457629ba8909b526463/.tmp/family1/d7c24654ee8649a9a1a725ddd3b970f7 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithMonthlyPolicy/2453f3b87d227457629ba8909b526463/family1/d7c24654ee8649a9a1a725ddd3b970f7 2023-02-09 20:54:02,804 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithMonthlyPolicy/2453f3b87d227457629ba8909b526463/family1/d7c24654ee8649a9a1a725ddd3b970f7, entries=1000, sequenceid=5, filesize=166.0 K 2023-02-09 20:54:02,806 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 2453f3b87d227457629ba8909b526463 in 446ms, sequenceid=5, compaction requested=false 2023-02-09 20:54:02,806 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 2453f3b87d227457629ba8909b526463: 2023-02-09 20:54:02,806 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1675976040214.2453f3b87d227457629ba8909b526463. 2023-02-09 20:54:02,807 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 20:54:02,807 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 20:54:02,807 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:02,807 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-02-09 20:54:02,807 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-02-09 20:54:02,809 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:02,809 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:02,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:02,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:54:02,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:54:02,809 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:02,809 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 20:54:02,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:54:02,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:54:02,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:02,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:02,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:54:02,811 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-02-09 20:54:02,811 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4cea288a[Count = 0] remaining members to acquire global barrier 2023-02-09 20:54:02,811 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-09 20:54:02,811 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:02,812 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:02,812 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:02,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:02,812 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-09 20:54:02,812 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:02,812 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 20:54:02,812 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-02-09 20:54:02,812 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase9.apache.org,40919,1675976022294' in zk 2023-02-09 20:54:02,815 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-09 20:54:02,815 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:02,815 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:54:02,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:02,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:54:02,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:54:02,815 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-02-09 20:54:02,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:54:02,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:54:02,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:02,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:02,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:54:02,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:02,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:02,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase9.apache.org,40919,1675976022294': 2023-02-09 20:54:02,818 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-09 20:54:02,818 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-02-09 20:54:02,818 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 20:54:02,818 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 20:54:02,818 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:02,818 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 20:54:02,820 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:02,820 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:02,820 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:02,820 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:54:02,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:02,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:02,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:54:02,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:54:02,821 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:54:02,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:54:02,821 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:02,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:54:02,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:02,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:02,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:54:02,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:02,822 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:02,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:02,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:54:02,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:02,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:02,825 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:02,825 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:02,825 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:54:02,825 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:02,825 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:54:02,825 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:02,825 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:02,825 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:54:02,825 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:54:02,825 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:02,825 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:02,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:54:02,826 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-09 20:54:02,825 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-02-09 20:54:02,827 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 20:54:02,827 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:54:02,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:54:02,827 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-09 20:54:02,827 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 20:54:02,927 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 20:54:02,929 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 20:54:02,936 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(933): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-02-09 20:54:02,938 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-09 20:54:02,938 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:02,938 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-02-09 20:54:02,938 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:54:02,939 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-09 20:54:02,939 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-09 20:54:02,939 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:02,939 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:02,943 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:02,943 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:54:02,943 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:54:02,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:54:02,943 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:02,943 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 20:54:02,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:02,944 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:02,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 20:54:02,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:02,945 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:02,945 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-02-09 20:54:02,945 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:02,945 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-09 20:54:02,945 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:54:02,946 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-09 20:54:02,946 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 20:54:02,946 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 20:54:02,946 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1675976040214.2453f3b87d227457629ba8909b526463. 2023-02-09 20:54:02,946 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1675976040214.2453f3b87d227457629ba8909b526463. started... 2023-02-09 20:54:02,946 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 2453f3b87d227457629ba8909b526463 1/1 column families, dataSize=74 B heapSize=408 B 2023-02-09 20:54:03,368 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128c5da950b93bc4fbc90b02ca61b73ed28 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151128c5da950b93bc4fbc90b02ca61b73ed28 2023-02-09 20:54:03,374 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithMonthlyPolicy/2453f3b87d227457629ba8909b526463/.tmp/family1/25cceb3ffdee44adaec443baf82b3399 2023-02-09 20:54:03,380 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithMonthlyPolicy/2453f3b87d227457629ba8909b526463/.tmp/family1/25cceb3ffdee44adaec443baf82b3399 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithMonthlyPolicy/2453f3b87d227457629ba8909b526463/family1/25cceb3ffdee44adaec443baf82b3399 2023-02-09 20:54:03,385 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithMonthlyPolicy/2453f3b87d227457629ba8909b526463/family1/25cceb3ffdee44adaec443baf82b3399, entries=1, sequenceid=9, filesize=5.0 K 2023-02-09 20:54:03,386 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 2453f3b87d227457629ba8909b526463 in 440ms, sequenceid=9, compaction requested=false 2023-02-09 20:54:03,386 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 2453f3b87d227457629ba8909b526463: 2023-02-09 20:54:03,387 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1675976040214.2453f3b87d227457629ba8909b526463. 2023-02-09 20:54:03,387 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 20:54:03,387 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 20:54:03,387 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:03,387 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-02-09 20:54:03,387 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-02-09 20:54:03,389 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:03,389 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:03,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:03,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:54:03,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:54:03,390 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:03,390 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 20:54:03,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:54:03,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:54:03,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:03,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:03,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:54:03,391 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-02-09 20:54:03,392 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@35b0dce3[Count = 0] remaining members to acquire global barrier 2023-02-09 20:54:03,392 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-09 20:54:03,392 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:03,393 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:03,393 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:03,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:03,393 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-09 20:54:03,393 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-02-09 20:54:03,393 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase9.apache.org,40919,1675976022294' in zk 2023-02-09 20:54:03,393 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:03,393 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 20:54:03,394 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-09 20:54:03,394 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:03,394 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:54:03,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:03,394 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-02-09 20:54:03,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:54:03,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:54:03,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:54:03,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:54:03,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:03,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:03,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:54:03,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:03,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:03,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase9.apache.org,40919,1675976022294': 2023-02-09 20:54:03,398 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-09 20:54:03,398 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-02-09 20:54:03,398 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 20:54:03,398 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 20:54:03,398 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:03,398 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 20:54:03,399 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:03,399 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:03,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:03,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:54:03,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:54:03,400 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:03,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:03,400 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:54:03,400 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:54:03,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:54:03,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:54:03,400 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:03,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:03,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:03,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:54:03,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:03,408 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:03,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:03,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:54:03,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:03,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:03,417 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:03,418 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:54:03,418 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:03,418 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:54:03,418 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-09 20:54:03,418 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:03,418 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-02-09 20:54:03,419 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 20:54:03,418 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:54:03,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:54:03,418 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:54:03,419 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:03,419 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:03,419 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:03,419 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:03,419 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-09 20:54:03,419 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 20:54:03,419 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:54:03,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:54:03,519 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 20:54:03,520 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 20:54:03,526 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(933): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-02-09 20:54:03,527 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-09 20:54:03,527 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:03,527 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-02-09 20:54:03,527 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:54:03,528 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-09 20:54:03,528 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-09 20:54:03,528 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:03,528 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:03,530 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:03,530 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:54:03,530 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:54:03,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:54:03,530 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:03,531 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 20:54:03,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:03,531 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:03,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 20:54:03,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:03,532 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:03,532 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-02-09 20:54:03,532 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:03,532 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-09 20:54:03,532 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:54:03,533 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-09 20:54:03,533 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 20:54:03,533 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 20:54:03,533 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1675976040214.2453f3b87d227457629ba8909b526463. 2023-02-09 20:54:03,533 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1675976040214.2453f3b87d227457629ba8909b526463. started... 2023-02-09 20:54:03,533 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 2453f3b87d227457629ba8909b526463 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-09 20:54:03,549 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201ee91801280484d95baec7c8127cfb2c5 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151201ee91801280484d95baec7c8127cfb2c5 2023-02-09 20:54:03,555 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithMonthlyPolicy/2453f3b87d227457629ba8909b526463/.tmp/family1/7258e8b96b294e52ac094a03e7b17d48 2023-02-09 20:54:03,561 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithMonthlyPolicy/2453f3b87d227457629ba8909b526463/.tmp/family1/7258e8b96b294e52ac094a03e7b17d48 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithMonthlyPolicy/2453f3b87d227457629ba8909b526463/family1/7258e8b96b294e52ac094a03e7b17d48 2023-02-09 20:54:03,567 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithMonthlyPolicy/2453f3b87d227457629ba8909b526463/family1/7258e8b96b294e52ac094a03e7b17d48, entries=1, sequenceid=13, filesize=4.9 K 2023-02-09 20:54:03,568 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 2453f3b87d227457629ba8909b526463 in 35ms, sequenceid=13, compaction requested=true 2023-02-09 20:54:03,568 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 2453f3b87d227457629ba8909b526463: 2023-02-09 20:54:03,568 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1675976040214.2453f3b87d227457629ba8909b526463. 2023-02-09 20:54:03,568 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 20:54:03,568 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 20:54:03,568 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:03,568 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-02-09 20:54:03,568 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-02-09 20:54:03,570 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:03,570 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:03,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:03,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:54:03,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:54:03,570 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:03,570 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 20:54:03,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:54:03,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:54:03,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:03,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:03,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:54:03,572 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-02-09 20:54:03,572 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@18a9aaf3[Count = 0] remaining members to acquire global barrier 2023-02-09 20:54:03,572 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-09 20:54:03,572 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:03,573 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:03,573 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:03,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:03,573 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-09 20:54:03,573 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-02-09 20:54:03,573 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase9.apache.org,40919,1675976022294' in zk 2023-02-09 20:54:03,574 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:03,574 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 20:54:03,576 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:03,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:03,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:54:03,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:54:03,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:54:03,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:54:03,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:03,577 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-09 20:54:03,578 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:54:03,578 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-02-09 20:54:03,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:03,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:54:03,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:03,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:03,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase9.apache.org,40919,1675976022294': 2023-02-09 20:54:03,580 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-09 20:54:03,580 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-02-09 20:54:03,580 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 20:54:03,580 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 20:54:03,580 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:03,580 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 20:54:03,582 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:03,582 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:03,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:03,582 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:03,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:54:03,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:03,582 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:54:03,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:54:03,583 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:54:03,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:54:03,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:54:03,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:03,583 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:03,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:03,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:54:03,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:03,585 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:03,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:03,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:54:03,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:03,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:03,587 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:03,587 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:03,587 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:03,587 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:03,588 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:03,588 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:03,588 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:03,588 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:54:03,588 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:54:03,588 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-02-09 20:54:03,589 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 20:54:03,588 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-09 20:54:03,589 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:54:03,589 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-09 20:54:03,589 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:54:03,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:54:03,589 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 20:54:03,589 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:54:03,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:54:03,689 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 20:54:03,691 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 20:54:03,696 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(933): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-02-09 20:54:03,698 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-09 20:54:03,698 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:03,698 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-02-09 20:54:03,698 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:54:03,699 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-09 20:54:03,699 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-09 20:54:03,700 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:03,700 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:03,701 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:03,701 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:54:03,701 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:54:03,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:54:03,701 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:03,701 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 20:54:03,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:03,702 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:03,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 20:54:03,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:03,702 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:03,703 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-02-09 20:54:03,703 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:03,703 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-09 20:54:03,703 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:54:03,703 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-09 20:54:03,703 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 20:54:03,703 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 20:54:03,703 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1675976040214.2453f3b87d227457629ba8909b526463. 2023-02-09 20:54:03,704 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1675976040214.2453f3b87d227457629ba8909b526463. started... 2023-02-09 20:54:03,704 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 2453f3b87d227457629ba8909b526463 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-09 20:54:04,122 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120559bf3687dd8b490a9da88b995a4a4f2e to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015120559bf3687dd8b490a9da88b995a4a4f2e 2023-02-09 20:54:04,134 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithMonthlyPolicy/2453f3b87d227457629ba8909b526463/.tmp/family1/51b8bc9a19fd4cec9fd2710e988ffd1e 2023-02-09 20:54:04,143 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithMonthlyPolicy/2453f3b87d227457629ba8909b526463/.tmp/family1/51b8bc9a19fd4cec9fd2710e988ffd1e as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithMonthlyPolicy/2453f3b87d227457629ba8909b526463/family1/51b8bc9a19fd4cec9fd2710e988ffd1e 2023-02-09 20:54:04,150 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithMonthlyPolicy/2453f3b87d227457629ba8909b526463/family1/51b8bc9a19fd4cec9fd2710e988ffd1e, entries=1, sequenceid=17, filesize=4.9 K 2023-02-09 20:54:04,151 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 2453f3b87d227457629ba8909b526463 in 447ms, sequenceid=17, compaction requested=true 2023-02-09 20:54:04,151 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 2453f3b87d227457629ba8909b526463: 2023-02-09 20:54:04,151 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1675976040214.2453f3b87d227457629ba8909b526463. 2023-02-09 20:54:04,151 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 20:54:04,151 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 20:54:04,151 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:04,151 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-02-09 20:54:04,151 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-02-09 20:54:04,154 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:04,154 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:04,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:04,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:54:04,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:54:04,154 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:04,155 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 20:54:04,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:54:04,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:54:04,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:04,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:04,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:54:04,156 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-02-09 20:54:04,156 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6808095[Count = 0] remaining members to acquire global barrier 2023-02-09 20:54:04,156 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-09 20:54:04,157 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:04,158 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:04,158 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:04,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:04,158 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-09 20:54:04,158 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:04,158 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 20:54:04,158 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-02-09 20:54:04,158 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase9.apache.org,40919,1675976022294' in zk 2023-02-09 20:54:04,159 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-09 20:54:04,159 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:04,159 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:54:04,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:04,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:54:04,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:54:04,159 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-02-09 20:54:04,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:54:04,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:54:04,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:04,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:04,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:54:04,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:04,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:04,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase9.apache.org,40919,1675976022294': 2023-02-09 20:54:04,163 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-09 20:54:04,163 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-02-09 20:54:04,163 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 20:54:04,163 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 20:54:04,163 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:04,163 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 20:54:04,166 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:04,166 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:04,166 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:04,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:04,166 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:54:04,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:04,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:54:04,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:54:04,167 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:54:04,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:54:04,167 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:04,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:54:04,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:04,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:04,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:54:04,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:04,172 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:04,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:04,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:54:04,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:04,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:04,175 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:54:04,175 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:04,175 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:54:04,176 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-09 20:54:04,176 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:54:04,175 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:54:04,176 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-02-09 20:54:04,176 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 20:54:04,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:54:04,176 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:04,177 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:04,177 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:04,177 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:04,177 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-09 20:54:04,177 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 20:54:04,177 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:04,177 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:04,177 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:54:04,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:54:04,277 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 20:54:04,278 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 20:54:04,282 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(933): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-02-09 20:54:04,286 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-09 20:54:04,286 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:04,286 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-02-09 20:54:04,286 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:54:04,286 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-09 20:54:04,287 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-09 20:54:04,287 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:04,287 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:04,288 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:04,288 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:54:04,288 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:54:04,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:54:04,288 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:04,288 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 20:54:04,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:04,289 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:04,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 20:54:04,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:04,289 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:04,290 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-02-09 20:54:04,290 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:04,290 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-09 20:54:04,290 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:54:04,290 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-09 20:54:04,290 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 20:54:04,290 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 20:54:04,290 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1675976040214.2453f3b87d227457629ba8909b526463. 2023-02-09 20:54:04,291 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1675976040214.2453f3b87d227457629ba8909b526463. started... 2023-02-09 20:54:04,291 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 2453f3b87d227457629ba8909b526463 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-09 20:54:04,404 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-09 20:54:04,708 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512287128f44d4b9f4e2183ed2a4ac8ed86a8 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512287128f44d4b9f4e2183ed2a4ac8ed86a8 2023-02-09 20:54:05,115 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithMonthlyPolicy/2453f3b87d227457629ba8909b526463/.tmp/family1/9b3994f4fb1a4776aea4b996a87a62d7 2023-02-09 20:54:05,122 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithMonthlyPolicy/2453f3b87d227457629ba8909b526463/.tmp/family1/9b3994f4fb1a4776aea4b996a87a62d7 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithMonthlyPolicy/2453f3b87d227457629ba8909b526463/family1/9b3994f4fb1a4776aea4b996a87a62d7 2023-02-09 20:54:05,128 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithMonthlyPolicy/2453f3b87d227457629ba8909b526463/family1/9b3994f4fb1a4776aea4b996a87a62d7, entries=1, sequenceid=21, filesize=4.9 K 2023-02-09 20:54:05,129 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 2453f3b87d227457629ba8909b526463 in 838ms, sequenceid=21, compaction requested=true 2023-02-09 20:54:05,129 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 2453f3b87d227457629ba8909b526463: 2023-02-09 20:54:05,129 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1675976040214.2453f3b87d227457629ba8909b526463. 2023-02-09 20:54:05,129 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 20:54:05,129 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 20:54:05,129 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:05,130 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-02-09 20:54:05,130 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-02-09 20:54:05,131 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:05,131 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:05,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:05,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:54:05,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:54:05,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:54:05,132 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:05,132 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 20:54:05,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:54:05,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:05,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:05,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:54:05,133 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-02-09 20:54:05,133 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1bb346b7[Count = 0] remaining members to acquire global barrier 2023-02-09 20:54:05,133 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-09 20:54:05,134 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:05,139 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:05,139 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:05,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:05,139 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-09 20:54:05,139 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-02-09 20:54:05,139 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase9.apache.org,40919,1675976022294' in zk 2023-02-09 20:54:05,139 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:05,139 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 20:54:05,142 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-09 20:54:05,142 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:05,142 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:54:05,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:05,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:54:05,142 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-02-09 20:54:05,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:54:05,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:54:05,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:54:05,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:05,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:05,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:54:05,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:05,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:05,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase9.apache.org,40919,1675976022294': 2023-02-09 20:54:05,145 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-09 20:54:05,145 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-02-09 20:54:05,145 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 20:54:05,145 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 20:54:05,145 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:05,145 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 20:54:05,148 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:05,148 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:05,148 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:54:05,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:05,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:54:05,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:54:05,148 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:05,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:05,149 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:05,149 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:54:05,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:54:05,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:54:05,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:05,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:05,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:54:05,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:05,150 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:05,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:05,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:54:05,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:05,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:05,153 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:54:05,153 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:54:05,153 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:54:05,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:54:05,153 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:54:05,153 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:05,153 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-09 20:54:05,153 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-02-09 20:54:05,154 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 20:54:05,154 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:54:05,154 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:05,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:54:05,155 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:05,155 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:05,155 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:05,155 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-09 20:54:05,155 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 20:54:05,155 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:05,155 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:05,255 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 20:54:05,256 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 20:54:05,261 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(933): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-02-09 20:54:05,263 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-09 20:54:05,263 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:05,263 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-02-09 20:54:05,263 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:54:05,264 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-09 20:54:05,264 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-09 20:54:05,264 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:05,264 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:05,265 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:05,265 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:54:05,265 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:54:05,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:54:05,266 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:05,266 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 20:54:05,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:05,266 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:05,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 20:54:05,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:05,267 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:05,267 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-02-09 20:54:05,267 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:05,267 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-09 20:54:05,267 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:54:05,268 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-09 20:54:05,268 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 20:54:05,268 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 20:54:05,268 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1675976040214.2453f3b87d227457629ba8909b526463. 2023-02-09 20:54:05,268 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1675976040214.2453f3b87d227457629ba8909b526463. started... 2023-02-09 20:54:05,268 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 2453f3b87d227457629ba8909b526463 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-09 20:54:05,286 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231fadc31e551174307aff660427bdd6fe7 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151231fadc31e551174307aff660427bdd6fe7 2023-02-09 20:54:05,292 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithMonthlyPolicy/2453f3b87d227457629ba8909b526463/.tmp/family1/26ec81c7572f40b0a2d317d8764c5d8d 2023-02-09 20:54:05,299 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithMonthlyPolicy/2453f3b87d227457629ba8909b526463/.tmp/family1/26ec81c7572f40b0a2d317d8764c5d8d as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithMonthlyPolicy/2453f3b87d227457629ba8909b526463/family1/26ec81c7572f40b0a2d317d8764c5d8d 2023-02-09 20:54:05,304 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithMonthlyPolicy/2453f3b87d227457629ba8909b526463/family1/26ec81c7572f40b0a2d317d8764c5d8d, entries=1, sequenceid=25, filesize=4.9 K 2023-02-09 20:54:05,305 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 2453f3b87d227457629ba8909b526463 in 37ms, sequenceid=25, compaction requested=true 2023-02-09 20:54:05,305 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 2453f3b87d227457629ba8909b526463: 2023-02-09 20:54:05,305 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1675976040214.2453f3b87d227457629ba8909b526463. 2023-02-09 20:54:05,305 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 20:54:05,305 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 20:54:05,305 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:05,305 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-02-09 20:54:05,305 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-02-09 20:54:05,308 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:05,308 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:05,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:05,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:54:05,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:54:05,308 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:05,308 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 20:54:05,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:54:05,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:54:05,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:05,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:05,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:54:05,310 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-02-09 20:54:05,310 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2857d6e6[Count = 0] remaining members to acquire global barrier 2023-02-09 20:54:05,310 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-09 20:54:05,310 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:05,311 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:05,311 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:05,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:05,311 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-09 20:54:05,311 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-02-09 20:54:05,311 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase9.apache.org,40919,1675976022294' in zk 2023-02-09 20:54:05,311 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:05,311 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 20:54:05,312 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-09 20:54:05,312 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:05,312 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:54:05,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:05,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:54:05,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:54:05,313 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-02-09 20:54:05,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:54:05,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:54:05,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:05,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:05,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:54:05,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:05,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:05,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase9.apache.org,40919,1675976022294': 2023-02-09 20:54:05,316 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-09 20:54:05,316 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-02-09 20:54:05,316 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 20:54:05,316 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 20:54:05,316 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:05,316 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 20:54:05,317 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:05,317 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:05,317 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:05,317 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:54:05,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:05,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:05,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:54:05,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:54:05,318 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:05,318 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:54:05,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:54:05,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:54:05,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:05,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:05,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:54:05,319 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:05,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:05,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:05,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:54:05,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:05,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:05,322 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:05,322 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:05,322 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:05,322 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:54:05,322 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:05,322 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:54:05,322 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:54:05,322 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:54:05,322 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-02-09 20:54:05,323 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 20:54:05,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:54:05,322 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:05,323 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-09 20:54:05,323 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:05,323 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:05,323 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-09 20:54:05,323 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 20:54:05,323 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:54:05,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:54:05,423 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 20:54:05,425 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 20:54:05,430 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(933): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-02-09 20:54:05,432 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-09 20:54:05,432 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:05,432 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-02-09 20:54:05,432 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:54:05,434 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-09 20:54:05,434 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-09 20:54:05,434 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:05,435 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:05,436 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:54:05,436 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:05,436 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:54:05,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:54:05,436 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:05,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:05,437 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 20:54:05,437 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:05,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 20:54:05,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:05,437 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:05,438 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-02-09 20:54:05,438 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:05,438 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-09 20:54:05,438 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:54:05,439 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-09 20:54:05,444 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 20:54:05,444 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 20:54:05,444 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1675976040214.2453f3b87d227457629ba8909b526463. 2023-02-09 20:54:05,445 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1675976040214.2453f3b87d227457629ba8909b526463. started... 2023-02-09 20:54:05,445 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 2453f3b87d227457629ba8909b526463 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-09 20:54:05,872 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101230823c037de4b47896e5828adfe34aa to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160101230823c037de4b47896e5828adfe34aa 2023-02-09 20:54:06,280 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithMonthlyPolicy/2453f3b87d227457629ba8909b526463/.tmp/family1/08b2548d81c544c6820b4fbd2e5a662c 2023-02-09 20:54:06,288 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithMonthlyPolicy/2453f3b87d227457629ba8909b526463/.tmp/family1/08b2548d81c544c6820b4fbd2e5a662c as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithMonthlyPolicy/2453f3b87d227457629ba8909b526463/family1/08b2548d81c544c6820b4fbd2e5a662c 2023-02-09 20:54:06,294 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithMonthlyPolicy/2453f3b87d227457629ba8909b526463/family1/08b2548d81c544c6820b4fbd2e5a662c, entries=1, sequenceid=29, filesize=4.9 K 2023-02-09 20:54:06,295 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 2453f3b87d227457629ba8909b526463 in 850ms, sequenceid=29, compaction requested=true 2023-02-09 20:54:06,296 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 2453f3b87d227457629ba8909b526463: 2023-02-09 20:54:06,296 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1675976040214.2453f3b87d227457629ba8909b526463. 2023-02-09 20:54:06,296 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 20:54:06,296 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 20:54:06,296 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:06,296 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-02-09 20:54:06,296 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-02-09 20:54:06,297 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:06,297 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:06,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:06,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:54:06,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:54:06,298 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:06,298 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 20:54:06,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:54:06,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:54:06,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:06,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:06,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:54:06,299 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-02-09 20:54:06,299 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7d7c0f2d[Count = 0] remaining members to acquire global barrier 2023-02-09 20:54:06,299 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-09 20:54:06,299 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:06,304 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:06,304 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:06,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:06,304 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-09 20:54:06,304 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-02-09 20:54:06,304 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase9.apache.org,40919,1675976022294' in zk 2023-02-09 20:54:06,304 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:06,305 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 20:54:06,307 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:06,307 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-09 20:54:06,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:06,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:54:06,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:54:06,308 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:54:06,308 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-02-09 20:54:06,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:54:06,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:54:06,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:06,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:06,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:54:06,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:06,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:06,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase9.apache.org,40919,1675976022294': 2023-02-09 20:54:06,311 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-09 20:54:06,311 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-02-09 20:54:06,311 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 20:54:06,311 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 20:54:06,311 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:06,311 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 20:54:06,313 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:06,313 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:06,313 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:54:06,313 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:06,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:06,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:06,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:54:06,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:54:06,318 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:54:06,318 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:06,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:54:06,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:54:06,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:06,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:06,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:54:06,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:06,320 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:06,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:06,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:54:06,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:06,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:06,323 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:06,323 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:06,323 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:06,323 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:54:06,323 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:06,323 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:06,323 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:54:06,323 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:54:06,324 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:54:06,323 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-02-09 20:54:06,324 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 20:54:06,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:54:06,323 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:06,324 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:06,325 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-09 20:54:06,325 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:54:06,324 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-09 20:54:06,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:54:06,325 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 20:54:06,425 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 20:54:06,427 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 20:54:06,433 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(933): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-02-09 20:54:06,435 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-09 20:54:06,435 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:06,435 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-02-09 20:54:06,435 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:54:06,435 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-09 20:54:06,435 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-09 20:54:06,436 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:06,436 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:06,438 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:54:06,438 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:06,438 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:54:06,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:54:06,439 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:06,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:06,439 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 20:54:06,439 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:06,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 20:54:06,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:06,439 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:06,440 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-02-09 20:54:06,440 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:06,440 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-09 20:54:06,440 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:54:06,440 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-09 20:54:06,441 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 20:54:06,441 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 20:54:06,441 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1675976040214.2453f3b87d227457629ba8909b526463. 2023-02-09 20:54:06,441 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1675976040214.2453f3b87d227457629ba8909b526463. started... 2023-02-09 20:54:06,441 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 2453f3b87d227457629ba8909b526463 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-09 20:54:06,860 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103a6b5944cfe374553a1dc79c949403fdb to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160103a6b5944cfe374553a1dc79c949403fdb 2023-02-09 20:54:07,266 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithMonthlyPolicy/2453f3b87d227457629ba8909b526463/.tmp/family1/5fb2834e01c84f4fb51075eb03b9a883 2023-02-09 20:54:07,272 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithMonthlyPolicy/2453f3b87d227457629ba8909b526463/.tmp/family1/5fb2834e01c84f4fb51075eb03b9a883 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithMonthlyPolicy/2453f3b87d227457629ba8909b526463/family1/5fb2834e01c84f4fb51075eb03b9a883 2023-02-09 20:54:07,277 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithMonthlyPolicy/2453f3b87d227457629ba8909b526463/family1/5fb2834e01c84f4fb51075eb03b9a883, entries=1, sequenceid=33, filesize=4.9 K 2023-02-09 20:54:07,278 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 2453f3b87d227457629ba8909b526463 in 837ms, sequenceid=33, compaction requested=true 2023-02-09 20:54:07,278 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 2453f3b87d227457629ba8909b526463: 2023-02-09 20:54:07,278 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1675976040214.2453f3b87d227457629ba8909b526463. 2023-02-09 20:54:07,278 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 20:54:07,278 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 20:54:07,278 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:07,278 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-02-09 20:54:07,278 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-02-09 20:54:07,280 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:07,280 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:07,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:07,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:54:07,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:54:07,280 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:07,280 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 20:54:07,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:54:07,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:54:07,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:07,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:07,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:54:07,281 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-02-09 20:54:07,281 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7f7aac3f[Count = 0] remaining members to acquire global barrier 2023-02-09 20:54:07,281 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-09 20:54:07,282 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:07,283 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:07,283 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:07,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:07,283 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-09 20:54:07,283 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-02-09 20:54:07,283 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase9.apache.org,40919,1675976022294' in zk 2023-02-09 20:54:07,283 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:07,283 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 20:54:07,292 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-09 20:54:07,292 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:07,292 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:54:07,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:07,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:54:07,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:54:07,292 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-02-09 20:54:07,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:54:07,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:54:07,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:07,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:07,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:54:07,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:07,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:07,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase9.apache.org,40919,1675976022294': 2023-02-09 20:54:07,295 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-09 20:54:07,295 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-02-09 20:54:07,295 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 20:54:07,295 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 20:54:07,295 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:07,295 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 20:54:07,297 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:07,297 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:07,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:07,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:54:07,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:54:07,297 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:07,297 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:54:07,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:07,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:54:07,298 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:07,298 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:54:07,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:54:07,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:07,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:07,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:54:07,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:07,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:07,299 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:07,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:54:07,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:07,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:07,301 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:07,301 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:54:07,301 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:07,301 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-02-09 20:54:07,301 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 20:54:07,301 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:07,301 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-09 20:54:07,301 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:54:07,301 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:54:07,301 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:54:07,301 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-09 20:54:07,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:54:07,301 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:07,302 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 20:54:07,302 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:07,302 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:07,302 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:07,302 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:54:07,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:54:07,402 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 20:54:07,403 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 20:54:07,408 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(933): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-02-09 20:54:07,409 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-09 20:54:07,411 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:07,411 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-02-09 20:54:07,411 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:54:07,411 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-09 20:54:07,411 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-09 20:54:07,412 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:07,412 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:07,413 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:54:07,413 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:07,413 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:54:07,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:54:07,414 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:07,414 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 20:54:07,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:07,414 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:07,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 20:54:07,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:07,414 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:07,414 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-02-09 20:54:07,415 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:07,415 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-09 20:54:07,415 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:54:07,415 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-09 20:54:07,415 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 20:54:07,415 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 20:54:07,415 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1675976040214.2453f3b87d227457629ba8909b526463. 2023-02-09 20:54:07,415 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1675976040214.2453f3b87d227457629ba8909b526463. started... 2023-02-09 20:54:07,415 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 2453f3b87d227457629ba8909b526463 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-09 20:54:07,445 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201509077b5aa4b3119a4a579165f335ce839b78 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201509077b5aa4b3119a4a579165f335ce839b78 2023-02-09 20:54:07,852 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithMonthlyPolicy/2453f3b87d227457629ba8909b526463/.tmp/family1/49fe42a5af854d4e99b470bdb74419dc 2023-02-09 20:54:07,858 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithMonthlyPolicy/2453f3b87d227457629ba8909b526463/.tmp/family1/49fe42a5af854d4e99b470bdb74419dc as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithMonthlyPolicy/2453f3b87d227457629ba8909b526463/family1/49fe42a5af854d4e99b470bdb74419dc 2023-02-09 20:54:07,864 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithMonthlyPolicy/2453f3b87d227457629ba8909b526463/family1/49fe42a5af854d4e99b470bdb74419dc, entries=1, sequenceid=37, filesize=4.9 K 2023-02-09 20:54:07,865 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 2453f3b87d227457629ba8909b526463 in 450ms, sequenceid=37, compaction requested=true 2023-02-09 20:54:07,865 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 2453f3b87d227457629ba8909b526463: 2023-02-09 20:54:07,865 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1675976040214.2453f3b87d227457629ba8909b526463. 2023-02-09 20:54:07,865 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 20:54:07,865 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 20:54:07,865 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:07,865 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-02-09 20:54:07,865 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-02-09 20:54:07,867 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:07,868 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:07,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:07,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:54:07,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:54:07,868 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:07,868 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 20:54:07,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:54:07,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:54:07,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:07,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:07,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:54:07,869 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-02-09 20:54:07,869 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7e7dcb99[Count = 0] remaining members to acquire global barrier 2023-02-09 20:54:07,869 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-09 20:54:07,869 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:07,871 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:07,871 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:07,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:07,871 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-09 20:54:07,871 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-02-09 20:54:07,871 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase9.apache.org,40919,1675976022294' in zk 2023-02-09 20:54:07,871 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:07,871 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 20:54:07,872 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:07,872 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-09 20:54:07,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:07,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:54:07,872 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:54:07,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:54:07,872 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-02-09 20:54:07,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:54:07,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:54:07,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:07,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:07,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:54:07,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:07,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:07,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase9.apache.org,40919,1675976022294': 2023-02-09 20:54:07,875 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-09 20:54:07,875 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-02-09 20:54:07,875 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 20:54:07,875 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 20:54:07,875 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:07,875 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 20:54:07,877 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:07,877 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:07,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:07,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:54:07,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:54:07,877 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:07,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:07,877 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:54:07,877 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:07,877 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:54:07,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:54:07,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:54:07,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:07,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:07,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:54:07,878 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:07,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:07,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:07,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:54:07,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:07,882 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:07,882 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:54:07,882 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:07,882 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-02-09 20:54:07,882 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 20:54:07,882 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:07,882 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:54:07,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:54:07,882 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:54:07,882 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-09 20:54:07,882 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:07,883 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-09 20:54:07,882 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:54:07,883 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 20:54:07,883 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:07,883 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:54:07,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:54:07,883 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:07,883 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:07,983 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 20:54:07,984 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 20:54:07,989 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(933): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-02-09 20:54:07,991 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-09 20:54:07,991 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:07,991 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-02-09 20:54:07,991 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:54:07,991 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-09 20:54:07,991 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-09 20:54:07,992 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:07,992 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:07,993 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:54:07,993 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:07,993 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:54:07,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:54:07,994 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:07,994 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 20:54:07,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:07,994 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:07,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 20:54:07,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:07,994 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:07,995 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-02-09 20:54:07,995 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:07,995 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-09 20:54:07,995 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:54:07,996 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-09 20:54:07,996 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 20:54:07,996 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 20:54:07,996 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1675976040214.2453f3b87d227457629ba8909b526463. 2023-02-09 20:54:07,996 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1675976040214.2453f3b87d227457629ba8909b526463. started... 2023-02-09 20:54:07,996 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 2453f3b87d227457629ba8909b526463 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-09 20:54:08,418 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120662f535323fc4649ac0e9d95be467794 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151120662f535323fc4649ac0e9d95be467794 2023-02-09 20:54:08,424 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithMonthlyPolicy/2453f3b87d227457629ba8909b526463/.tmp/family1/f3f758fd4e2540079608f9c347f490ce 2023-02-09 20:54:08,430 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithMonthlyPolicy/2453f3b87d227457629ba8909b526463/.tmp/family1/f3f758fd4e2540079608f9c347f490ce as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithMonthlyPolicy/2453f3b87d227457629ba8909b526463/family1/f3f758fd4e2540079608f9c347f490ce 2023-02-09 20:54:08,435 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithMonthlyPolicy/2453f3b87d227457629ba8909b526463/family1/f3f758fd4e2540079608f9c347f490ce, entries=1, sequenceid=41, filesize=4.9 K 2023-02-09 20:54:08,436 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 2453f3b87d227457629ba8909b526463 in 440ms, sequenceid=41, compaction requested=true 2023-02-09 20:54:08,436 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 2453f3b87d227457629ba8909b526463: 2023-02-09 20:54:08,436 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1675976040214.2453f3b87d227457629ba8909b526463. 2023-02-09 20:54:08,436 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 20:54:08,436 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 20:54:08,436 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:08,436 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-02-09 20:54:08,436 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-02-09 20:54:08,438 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:08,438 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:08,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:08,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:54:08,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:54:08,438 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:08,438 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 20:54:08,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:54:08,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:54:08,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:08,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:08,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:54:08,440 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-02-09 20:54:08,440 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@688bc256[Count = 0] remaining members to acquire global barrier 2023-02-09 20:54:08,440 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-09 20:54:08,440 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:08,441 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:08,441 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:08,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:08,441 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-09 20:54:08,441 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-02-09 20:54:08,441 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase9.apache.org,40919,1675976022294' in zk 2023-02-09 20:54:08,441 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:08,441 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 20:54:08,444 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:08,444 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-09 20:54:08,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:08,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:54:08,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:54:08,444 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:54:08,444 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-02-09 20:54:08,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:54:08,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:54:08,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:08,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:08,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:54:08,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:08,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:08,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase9.apache.org,40919,1675976022294': 2023-02-09 20:54:08,447 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-09 20:54:08,447 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-02-09 20:54:08,447 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 20:54:08,447 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 20:54:08,447 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:08,447 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 20:54:08,449 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:08,449 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:08,449 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:54:08,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:08,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:54:08,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:54:08,449 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:08,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:08,450 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:08,450 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:54:08,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:54:08,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:54:08,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:08,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:08,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:54:08,451 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:08,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:08,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:08,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:54:08,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:08,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:08,453 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:54:08,453 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:54:08,453 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:54:08,453 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:54:08,455 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:08,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:54:08,453 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-02-09 20:54:08,455 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 20:54:08,455 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:08,455 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:08,455 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-09 20:54:08,455 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:54:08,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:54:08,455 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:08,456 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-09 20:54:08,456 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 20:54:08,456 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:08,456 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:08,456 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:08,556 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 20:54:08,557 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 20:54:08,558 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=42951] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithMonthlyPolicy 2023-02-09 20:54:08,560 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1675976025848] procedure2.ProcedureExecutor(1029): Stored pid=22, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-02-09 20:54:08,561 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=22, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-02-09 20:54:08,562 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1675976025848] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithMonthlyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-09 20:54:08,562 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=22, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1675976648562 2023-02-09 20:54:08,563 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1675976025848] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-09 20:54:08,565 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1675976025848] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithMonthlyPolicy' and column 'family1' 2023-02-09 20:54:08,565 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1675976025848] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-02-09 20:54:08,565 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1675976025848] zookeeper.ReadOnlyZKClient(139): Connect 0x12282a75 to 127.0.0.1:62089 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 20:54:08,569 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1675976025848] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@408d4afd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 20:54:08,570 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-02-09 20:54:09,412 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601033c2f6f6228e64d998c89a2a72e82a7bd to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201601033c2f6f6228e64d998c89a2a72e82a7bd 2023-02-09 20:54:09,413 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-02-09 20:54:09,427 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 20:54:09,428 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:59514, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 20:54:09,438 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-09 20:54:09,439 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:50272, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-09 20:54:09,460 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/fc75035981804f6688a5830c6ab4a5b5 first=Optional[r5] last=Optional[r6] 2023-02-09 20:54:09,461 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1675976040214.2453f3b87d227457629ba8909b526463., hostname=jenkins-hbase9.apache.org,40919,1675976022294, seqNum=2 for row with hfile group [{family1,hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/fc75035981804f6688a5830c6ab4a5b5}] 2023-02-09 20:54:09,465 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HStore(763): Validating hfile at hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/fc75035981804f6688a5830c6ab4a5b5 for inclusion in 2453f3b87d227457629ba8909b526463/family1 2023-02-09 20:54:09,469 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HStore(775): HFile bounds: first=r5 last=r6 2023-02-09 20:54:09,469 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HStore(777): Region bounds: first= last= 2023-02-09 20:54:09,469 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HRegion(2445): Flush status journal for 2453f3b87d227457629ba8909b526463: 2023-02-09 20:54:09,470 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/fc75035981804f6688a5830c6ab4a5b5 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/staging/jenkins__testMajorCompactionWithMonthlyPolicy__fkgdr9jcqqsnireaugga1i3dpcri8mmskfutm54r6d6hamkh52t5k2d9i8ks389l/family1/fc75035981804f6688a5830c6ab4a5b5 2023-02-09 20:54:09,473 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/staging/jenkins__testMajorCompactionWithMonthlyPolicy__fkgdr9jcqqsnireaugga1i3dpcri8mmskfutm54r6d6hamkh52t5k2d9i8ks389l/family1/fc75035981804f6688a5830c6ab4a5b5 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithMonthlyPolicy/2453f3b87d227457629ba8909b526463/family1/6cc60bc166174126807c1bc53f7647cf_SeqId_44_ 2023-02-09 20:54:09,474 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HStore(849): Loaded HFile hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/staging/jenkins__testMajorCompactionWithMonthlyPolicy__fkgdr9jcqqsnireaugga1i3dpcri8mmskfutm54r6d6hamkh52t5k2d9i8ks389l/family1/fc75035981804f6688a5830c6ab4a5b5 into 2453f3b87d227457629ba8909b526463/family1 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithMonthlyPolicy/2453f3b87d227457629ba8909b526463/family1/6cc60bc166174126807c1bc53f7647cf_SeqId_44_ - updating store file list. 2023-02-09 20:54:09,479 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HStore(882): Loaded HFile hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithMonthlyPolicy/2453f3b87d227457629ba8909b526463/family1/6cc60bc166174126807c1bc53f7647cf_SeqId_44_ into 2453f3b87d227457629ba8909b526463/family1 2023-02-09 20:54:09,479 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HStore(855): Successfully loaded hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/staging/jenkins__testMajorCompactionWithMonthlyPolicy__fkgdr9jcqqsnireaugga1i3dpcri8mmskfutm54r6d6hamkh52t5k2d9i8ks389l/family1/fc75035981804f6688a5830c6ab4a5b5 into 2453f3b87d227457629ba8909b526463/family1 (new location: hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithMonthlyPolicy/2453f3b87d227457629ba8909b526463/family1/6cc60bc166174126807c1bc53f7647cf_SeqId_44_) 2023-02-09 20:54:09,480 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/staging/jenkins__testMajorCompactionWithMonthlyPolicy__fkgdr9jcqqsnireaugga1i3dpcri8mmskfutm54r6d6hamkh52t5k2d9i8ks389l/family1/fc75035981804f6688a5830c6ab4a5b5 2023-02-09 20:54:09,480 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-02-09 20:54:09,484 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 50903 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-02-09 20:54:09,484 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HStore(1912): 2453f3b87d227457629ba8909b526463/family1 is initiating minor compaction 2023-02-09 20:54:09,484 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@44de4de7; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-09 20:54:09,484 INFO [RS:0;jenkins-hbase9:40919-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 2453f3b87d227457629ba8909b526463/family1 in testMajorCompactionWithMonthlyPolicy,,1675976040214.2453f3b87d227457629ba8909b526463. 2023-02-09 20:54:09,484 INFO [RS:0;jenkins-hbase9:40919-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithMonthlyPolicy/2453f3b87d227457629ba8909b526463/family1/25cceb3ffdee44adaec443baf82b3399, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithMonthlyPolicy/2453f3b87d227457629ba8909b526463/family1/7258e8b96b294e52ac094a03e7b17d48, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithMonthlyPolicy/2453f3b87d227457629ba8909b526463/family1/51b8bc9a19fd4cec9fd2710e988ffd1e, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithMonthlyPolicy/2453f3b87d227457629ba8909b526463/family1/9b3994f4fb1a4776aea4b996a87a62d7, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithMonthlyPolicy/2453f3b87d227457629ba8909b526463/family1/26ec81c7572f40b0a2d317d8764c5d8d, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithMonthlyPolicy/2453f3b87d227457629ba8909b526463/family1/08b2548d81c544c6820b4fbd2e5a662c, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithMonthlyPolicy/2453f3b87d227457629ba8909b526463/family1/5fb2834e01c84f4fb51075eb03b9a883, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithMonthlyPolicy/2453f3b87d227457629ba8909b526463/family1/49fe42a5af854d4e99b470bdb74419dc, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithMonthlyPolicy/2453f3b87d227457629ba8909b526463/family1/f3f758fd4e2540079608f9c347f490ce, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithMonthlyPolicy/2453f3b87d227457629ba8909b526463/family1/6cc60bc166174126807c1bc53f7647cf_SeqId_44_] into tmpdir=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithMonthlyPolicy/2453f3b87d227457629ba8909b526463/.tmp, totalSize=49.7 K 2023-02-09 20:54:09,485 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] compactions.Compactor(207): Compacting 25cceb3ffdee44adaec443baf82b3399, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-02-09 20:54:09,485 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] compactions.Compactor(207): Compacting 7258e8b96b294e52ac094a03e7b17d48, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-02-09 20:54:09,485 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] compactions.Compactor(207): Compacting 51b8bc9a19fd4cec9fd2710e988ffd1e, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-02-09 20:54:09,485 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] compactions.Compactor(207): Compacting 9b3994f4fb1a4776aea4b996a87a62d7, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-02-09 20:54:09,485 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] compactions.Compactor(207): Compacting 26ec81c7572f40b0a2d317d8764c5d8d, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-02-09 20:54:09,485 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] compactions.Compactor(207): Compacting 08b2548d81c544c6820b4fbd2e5a662c, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-02-09 20:54:09,485 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] compactions.Compactor(207): Compacting 5fb2834e01c84f4fb51075eb03b9a883, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-02-09 20:54:09,485 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] compactions.Compactor(207): Compacting 49fe42a5af854d4e99b470bdb74419dc, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-02-09 20:54:09,485 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] compactions.Compactor(207): Compacting f3f758fd4e2540079608f9c347f490ce, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-02-09 20:54:09,485 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] compactions.Compactor(207): Compacting 6cc60bc166174126807c1bc53f7647cf_SeqId_44_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=45 2023-02-09 20:54:09,487 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-02-09 20:54:09,488 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 20:54:09,491 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160101230823c037de4b47896e5828adfe34aa to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160101230823c037de4b47896e5828adfe34aa 2023-02-09 20:54:09,497 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160103a6b5944cfe374553a1dc79c949403fdb to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160103a6b5944cfe374553a1dc79c949403fdb 2023-02-09 20:54:09,498 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 2 expired mob files are deleted 2023-02-09 20:54:09,498 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101' 2023-02-09 20:54:09,499 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-02-09 20:54:09,499 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-02-09 20:54:09,541 INFO [RS:0;jenkins-hbase9:40919-shortCompactions-0] throttle.PressureAwareThroughputController(145): 2453f3b87d227457629ba8909b526463#family1#compaction#22 average throughput is 0.68 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-09 20:54:09,583 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231ee1c22318c2e4ad6a5a114c9d60f7238 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151231ee1c22318c2e4ad6a5a114c9d60f7238 2023-02-09 20:54:09,584 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-02-09 20:54:09,619 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/bff4456f2f6645bab4a8371dd64daeff first=Optional[r1] last=Optional[r4] 2023-02-09 20:54:09,620 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1675976040214.2453f3b87d227457629ba8909b526463., hostname=jenkins-hbase9.apache.org,40919,1675976022294, seqNum=2 for row with hfile group [{family1,hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/bff4456f2f6645bab4a8371dd64daeff}] 2023-02-09 20:54:09,623 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HStore(763): Validating hfile at hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/bff4456f2f6645bab4a8371dd64daeff for inclusion in 2453f3b87d227457629ba8909b526463/family1 2023-02-09 20:54:09,626 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HStore(775): HFile bounds: first=r1 last=r4 2023-02-09 20:54:09,626 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HStore(777): Region bounds: first= last= 2023-02-09 20:54:09,627 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HRegion(2445): Flush status journal for 2453f3b87d227457629ba8909b526463: 2023-02-09 20:54:09,627 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/bff4456f2f6645bab4a8371dd64daeff to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/staging/jenkins__testMajorCompactionWithMonthlyPolicy__ljlmtc7v4voh41q6969sslphm3msmj589nikkatc0pno3qiifhrsefu37h8m60j/family1/bff4456f2f6645bab4a8371dd64daeff 2023-02-09 20:54:09,630 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/staging/jenkins__testMajorCompactionWithMonthlyPolicy__ljlmtc7v4voh41q6969sslphm3msmj589nikkatc0pno3qiifhrsefu37h8m60j/family1/bff4456f2f6645bab4a8371dd64daeff as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithMonthlyPolicy/2453f3b87d227457629ba8909b526463/family1/1fddf6610d654fa2a70883a956a9abed_SeqId_46_ 2023-02-09 20:54:09,631 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HStore(849): Loaded HFile hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/staging/jenkins__testMajorCompactionWithMonthlyPolicy__ljlmtc7v4voh41q6969sslphm3msmj589nikkatc0pno3qiifhrsefu37h8m60j/family1/bff4456f2f6645bab4a8371dd64daeff into 2453f3b87d227457629ba8909b526463/family1 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithMonthlyPolicy/2453f3b87d227457629ba8909b526463/family1/1fddf6610d654fa2a70883a956a9abed_SeqId_46_ - updating store file list. 2023-02-09 20:54:09,636 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HStore(882): Loaded HFile hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithMonthlyPolicy/2453f3b87d227457629ba8909b526463/family1/1fddf6610d654fa2a70883a956a9abed_SeqId_46_ into 2453f3b87d227457629ba8909b526463/family1 2023-02-09 20:54:09,636 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HStore(855): Successfully loaded hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/staging/jenkins__testMajorCompactionWithMonthlyPolicy__ljlmtc7v4voh41q6969sslphm3msmj589nikkatc0pno3qiifhrsefu37h8m60j/family1/bff4456f2f6645bab4a8371dd64daeff into 2453f3b87d227457629ba8909b526463/family1 (new location: hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithMonthlyPolicy/2453f3b87d227457629ba8909b526463/family1/1fddf6610d654fa2a70883a956a9abed_SeqId_46_) 2023-02-09 20:54:09,636 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/staging/jenkins__testMajorCompactionWithMonthlyPolicy__ljlmtc7v4voh41q6969sslphm3msmj589nikkatc0pno3qiifhrsefu37h8m60j/family1/bff4456f2f6645bab4a8371dd64daeff 2023-02-09 20:54:09,638 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-02-09 20:54:09,639 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 20:54:09,641 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151201ee91801280484d95baec7c8127cfb2c5 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151201ee91801280484d95baec7c8127cfb2c5 2023-02-09 20:54:09,642 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015120559bf3687dd8b490a9da88b995a4a4f2e to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015120559bf3687dd8b490a9da88b995a4a4f2e 2023-02-09 20:54:09,643 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512287128f44d4b9f4e2183ed2a4ac8ed86a8 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512287128f44d4b9f4e2183ed2a4ac8ed86a8 2023-02-09 20:54:09,644 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151231fadc31e551174307aff660427bdd6fe7 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151231fadc31e551174307aff660427bdd6fe7 2023-02-09 20:54:09,644 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 4 expired mob files are deleted 2023-02-09 20:54:09,644 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201' 2023-02-09 20:54:09,645 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-02-09 20:54:09,645 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-02-09 20:54:09,976 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithMonthlyPolicy/2453f3b87d227457629ba8909b526463/.tmp/family1/f5cfee18d7ff4cf0a97808049c3f7105 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithMonthlyPolicy/2453f3b87d227457629ba8909b526463/family1/f5cfee18d7ff4cf0a97808049c3f7105 2023-02-09 20:54:09,984 INFO [RS:0;jenkins-hbase9:40919-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 2453f3b87d227457629ba8909b526463/family1 of 2453f3b87d227457629ba8909b526463 into f5cfee18d7ff4cf0a97808049c3f7105(size=6.6 K), total size for store is 178.1 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-09 20:54:09,984 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 2453f3b87d227457629ba8909b526463: 2023-02-09 20:54:09,984 INFO [RS:0;jenkins-hbase9:40919-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithMonthlyPolicy,,1675976040214.2453f3b87d227457629ba8909b526463., storeName=family1, fileCount=10, fileSize=49.7 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.2 K), priority=2, time=1675976049484; duration=0sec 2023-02-09 20:54:09,984 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-09 20:54:10,060 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithMonthlyPolicy/2453f3b87d227457629ba8909b526463/family1/25cceb3ffdee44adaec443baf82b3399, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithMonthlyPolicy/2453f3b87d227457629ba8909b526463/family1/7258e8b96b294e52ac094a03e7b17d48, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithMonthlyPolicy/2453f3b87d227457629ba8909b526463/family1/51b8bc9a19fd4cec9fd2710e988ffd1e, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithMonthlyPolicy/2453f3b87d227457629ba8909b526463/family1/9b3994f4fb1a4776aea4b996a87a62d7, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithMonthlyPolicy/2453f3b87d227457629ba8909b526463/family1/26ec81c7572f40b0a2d317d8764c5d8d, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithMonthlyPolicy/2453f3b87d227457629ba8909b526463/family1/08b2548d81c544c6820b4fbd2e5a662c, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithMonthlyPolicy/2453f3b87d227457629ba8909b526463/family1/5fb2834e01c84f4fb51075eb03b9a883, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithMonthlyPolicy/2453f3b87d227457629ba8909b526463/family1/49fe42a5af854d4e99b470bdb74419dc, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithMonthlyPolicy/2453f3b87d227457629ba8909b526463/family1/f3f758fd4e2540079608f9c347f490ce, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithMonthlyPolicy/2453f3b87d227457629ba8909b526463/family1/6cc60bc166174126807c1bc53f7647cf_SeqId_44_] to archive 2023-02-09 20:54:10,061 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 20:54:10,064 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithMonthlyPolicy/2453f3b87d227457629ba8909b526463/family1/25cceb3ffdee44adaec443baf82b3399 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMajorCompactionWithMonthlyPolicy/2453f3b87d227457629ba8909b526463/family1/25cceb3ffdee44adaec443baf82b3399 2023-02-09 20:54:10,066 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithMonthlyPolicy/2453f3b87d227457629ba8909b526463/family1/7258e8b96b294e52ac094a03e7b17d48 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMajorCompactionWithMonthlyPolicy/2453f3b87d227457629ba8909b526463/family1/7258e8b96b294e52ac094a03e7b17d48 2023-02-09 20:54:10,067 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithMonthlyPolicy/2453f3b87d227457629ba8909b526463/family1/51b8bc9a19fd4cec9fd2710e988ffd1e to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMajorCompactionWithMonthlyPolicy/2453f3b87d227457629ba8909b526463/family1/51b8bc9a19fd4cec9fd2710e988ffd1e 2023-02-09 20:54:10,069 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithMonthlyPolicy/2453f3b87d227457629ba8909b526463/family1/9b3994f4fb1a4776aea4b996a87a62d7 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMajorCompactionWithMonthlyPolicy/2453f3b87d227457629ba8909b526463/family1/9b3994f4fb1a4776aea4b996a87a62d7 2023-02-09 20:54:10,071 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithMonthlyPolicy/2453f3b87d227457629ba8909b526463/family1/26ec81c7572f40b0a2d317d8764c5d8d to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMajorCompactionWithMonthlyPolicy/2453f3b87d227457629ba8909b526463/family1/26ec81c7572f40b0a2d317d8764c5d8d 2023-02-09 20:54:10,072 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithMonthlyPolicy/2453f3b87d227457629ba8909b526463/family1/08b2548d81c544c6820b4fbd2e5a662c to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMajorCompactionWithMonthlyPolicy/2453f3b87d227457629ba8909b526463/family1/08b2548d81c544c6820b4fbd2e5a662c 2023-02-09 20:54:10,074 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithMonthlyPolicy/2453f3b87d227457629ba8909b526463/family1/5fb2834e01c84f4fb51075eb03b9a883 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMajorCompactionWithMonthlyPolicy/2453f3b87d227457629ba8909b526463/family1/5fb2834e01c84f4fb51075eb03b9a883 2023-02-09 20:54:10,076 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithMonthlyPolicy/2453f3b87d227457629ba8909b526463/family1/49fe42a5af854d4e99b470bdb74419dc to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMajorCompactionWithMonthlyPolicy/2453f3b87d227457629ba8909b526463/family1/49fe42a5af854d4e99b470bdb74419dc 2023-02-09 20:54:10,077 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithMonthlyPolicy/2453f3b87d227457629ba8909b526463/family1/f3f758fd4e2540079608f9c347f490ce to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMajorCompactionWithMonthlyPolicy/2453f3b87d227457629ba8909b526463/family1/f3f758fd4e2540079608f9c347f490ce 2023-02-09 20:54:10,079 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithMonthlyPolicy/2453f3b87d227457629ba8909b526463/family1/6cc60bc166174126807c1bc53f7647cf_SeqId_44_ to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMajorCompactionWithMonthlyPolicy/2453f3b87d227457629ba8909b526463/family1/6cc60bc166174126807c1bc53f7647cf_SeqId_44_ 2023-02-09 20:54:10,504 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511304a804abed811429189dde619013215dd to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511304a804abed811429189dde619013215dd 2023-02-09 20:54:10,505 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-02-09 20:54:10,534 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/8cf3c574578645b6b3b639b02b4919b0 first=Optional[r00] last=Optional[r8] 2023-02-09 20:54:10,538 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1675976040214.2453f3b87d227457629ba8909b526463., hostname=jenkins-hbase9.apache.org,40919,1675976022294, seqNum=2 for row with hfile group [{family1,hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/8cf3c574578645b6b3b639b02b4919b0}] 2023-02-09 20:54:10,541 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HStore(763): Validating hfile at hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/8cf3c574578645b6b3b639b02b4919b0 for inclusion in 2453f3b87d227457629ba8909b526463/family1 2023-02-09 20:54:10,546 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HStore(775): HFile bounds: first=r00 last=r8 2023-02-09 20:54:10,546 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HStore(777): Region bounds: first= last= 2023-02-09 20:54:10,546 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HRegion(2445): Flush status journal for 2453f3b87d227457629ba8909b526463: 2023-02-09 20:54:10,547 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/8cf3c574578645b6b3b639b02b4919b0 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/staging/jenkins__testMajorCompactionWithMonthlyPolicy__kk8tilv6qu26po2r4mld5k2i4gjv9iq4pf2vgetgsps892ovammiv1bjg29ts6al/family1/8cf3c574578645b6b3b639b02b4919b0 2023-02-09 20:54:10,551 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/staging/jenkins__testMajorCompactionWithMonthlyPolicy__kk8tilv6qu26po2r4mld5k2i4gjv9iq4pf2vgetgsps892ovammiv1bjg29ts6al/family1/8cf3c574578645b6b3b639b02b4919b0 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithMonthlyPolicy/2453f3b87d227457629ba8909b526463/family1/b2a466be9faa4a65b2847ae9d5101cec_SeqId_49_ 2023-02-09 20:54:10,552 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HStore(849): Loaded HFile hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/staging/jenkins__testMajorCompactionWithMonthlyPolicy__kk8tilv6qu26po2r4mld5k2i4gjv9iq4pf2vgetgsps892ovammiv1bjg29ts6al/family1/8cf3c574578645b6b3b639b02b4919b0 into 2453f3b87d227457629ba8909b526463/family1 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithMonthlyPolicy/2453f3b87d227457629ba8909b526463/family1/b2a466be9faa4a65b2847ae9d5101cec_SeqId_49_ - updating store file list. 2023-02-09 20:54:10,557 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HStore(882): Loaded HFile hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithMonthlyPolicy/2453f3b87d227457629ba8909b526463/family1/b2a466be9faa4a65b2847ae9d5101cec_SeqId_49_ into 2453f3b87d227457629ba8909b526463/family1 2023-02-09 20:54:10,557 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HStore(855): Successfully loaded hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/staging/jenkins__testMajorCompactionWithMonthlyPolicy__kk8tilv6qu26po2r4mld5k2i4gjv9iq4pf2vgetgsps892ovammiv1bjg29ts6al/family1/8cf3c574578645b6b3b639b02b4919b0 into 2453f3b87d227457629ba8909b526463/family1 (new location: hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithMonthlyPolicy/2453f3b87d227457629ba8909b526463/family1/b2a466be9faa4a65b2847ae9d5101cec_SeqId_49_) 2023-02-09 20:54:10,558 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/staging/jenkins__testMajorCompactionWithMonthlyPolicy__kk8tilv6qu26po2r4mld5k2i4gjv9iq4pf2vgetgsps892ovammiv1bjg29ts6al/family1/8cf3c574578645b6b3b639b02b4919b0 2023-02-09 20:54:10,558 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-02-09 20:54:10,560 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 352581 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-02-09 20:54:10,560 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HStore(1912): 2453f3b87d227457629ba8909b526463/family1 is initiating minor compaction (all files) 2023-02-09 20:54:10,560 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@7160e712; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-09 20:54:10,560 INFO [RS:0;jenkins-hbase9:40919-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 2453f3b87d227457629ba8909b526463/family1 in testMajorCompactionWithMonthlyPolicy,,1675976040214.2453f3b87d227457629ba8909b526463. 2023-02-09 20:54:10,560 INFO [RS:0;jenkins-hbase9:40919-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithMonthlyPolicy/2453f3b87d227457629ba8909b526463/family1/d7c24654ee8649a9a1a725ddd3b970f7, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithMonthlyPolicy/2453f3b87d227457629ba8909b526463/family1/f5cfee18d7ff4cf0a97808049c3f7105, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithMonthlyPolicy/2453f3b87d227457629ba8909b526463/family1/1fddf6610d654fa2a70883a956a9abed_SeqId_46_, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithMonthlyPolicy/2453f3b87d227457629ba8909b526463/family1/b2a466be9faa4a65b2847ae9d5101cec_SeqId_49_] into tmpdir=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithMonthlyPolicy/2453f3b87d227457629ba8909b526463/.tmp, totalSize=344.3 K 2023-02-09 20:54:10,561 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] compactions.Compactor(207): Compacting d7c24654ee8649a9a1a725ddd3b970f7, keycount=1000, bloomtype=ROW, size=166.0 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878845982 2023-02-09 20:54:10,561 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] compactions.Compactor(207): Compacting f5cfee18d7ff4cf0a97808049c3f7105, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621245982 2023-02-09 20:54:10,562 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] compactions.Compactor(207): Compacting 1fddf6610d654fa2a70883a956a9abed_SeqId_46_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=47, earliestPutTs=1448965245982 2023-02-09 20:54:10,562 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] compactions.Compactor(207): Compacting b2a466be9faa4a65b2847ae9d5101cec_SeqId_49_, keycount=1001, bloomtype=ROW, size=166.2 K, encoding=NONE, compression=NONE, seqNum=50, earliestPutTs=1448014845982 2023-02-09 20:54:10,563 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-02-09 20:54:10,563 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 20:54:10,565 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151120662f535323fc4649ac0e9d95be467794 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151120662f535323fc4649ac0e9d95be467794 2023-02-09 20:54:10,567 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151128c5da950b93bc4fbc90b02ca61b73ed28 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151128c5da950b93bc4fbc90b02ca61b73ed28 2023-02-09 20:54:10,568 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015113021c5051e1976468787d88e6c82d6f6e5 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015113021c5051e1976468787d88e6c82d6f6e5 2023-02-09 20:54:10,568 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 3 expired mob files are deleted 2023-02-09 20:54:10,568 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-02-09 20:54:10,569 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-02-09 20:54:10,569 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-02-09 20:54:10,569 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-02-09 20:54:10,569 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1675976025848] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-02-09 20:54:10,570 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1675976025848] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithMonthlyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-09 20:54:10,571 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=22, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-02-09 20:54:10,573 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=22, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE in 2.0120 sec 2023-02-09 20:54:10,594 INFO [RS:0;jenkins-hbase9:40919-shortCompactions-0] throttle.PressureAwareThroughputController(145): 2453f3b87d227457629ba8909b526463#family1#compaction#23 average throughput is 10.37 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-09 20:54:10,689 INFO [Listener at localhost/46855] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithMonthlyPolicy Thread=262 (was 245) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1937004114_15 at /127.0.0.1:57128 [Waiting for operation #11] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:62089@0x12282a75-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: hconnection-0x19fe5622-shared-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1937004114_15 at /127.0.0.1:57192 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1937004114_15 at /127.0.0.1:57258 [Waiting for operation #16] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: PacketResponder: BP-1461392624-172.31.2.10-1675976018075:blk_1073741900_1076, type=LAST_IN_PIPELINE java.lang.Object.wait(Native Method) java.lang.Object.wait(Object.java:502) org.apache.hadoop.hdfs.server.datanode.BlockReceiver$PacketResponder.waitForAckHead(BlockReceiver.java:1327) org.apache.hadoop.hdfs.server.datanode.BlockReceiver$PacketResponder.run(BlockReceiver.java:1399) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1937004114_15 at /127.0.0.1:57200 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1937004114_15 at /127.0.0.1:57204 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1937004114_15 at /127.0.0.1:57136 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ResponseProcessor for block BP-1461392624-172.31.2.10-1675976018075:blk_1073741900_1076 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:118) java.io.FilterInputStream.read(FilterInputStream.java:83) java.io.FilterInputStream.read(FilterInputStream.java:83) org.apache.hadoop.hdfs.protocolPB.PBHelperClient.vintPrefixed(PBHelperClient.java:454) org.apache.hadoop.hdfs.protocol.datatransfer.PipelineAck.readFields(PipelineAck.java:213) org.apache.hadoop.hdfs.DataStreamer$ResponseProcessor.run(DataStreamer.java:1080) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1937004114_15 at /127.0.0.1:57212 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1937004114_15 at /127.0.0.1:57220 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:62089@0x12282a75-SendThread(127.0.0.1:62089) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:345) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1223) Potentially hanging thread: DataStreamer for file /user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511303559c2e3244c4ce89799fdace775a55c java.lang.Object.wait(Native Method) org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:678) Potentially hanging thread: hconnection-0x19fe5622-shared-pool-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1937004114_15 at /127.0.0.1:57068 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1937004114_15 at /127.0.0.1:57152 [Waiting for operation #15] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1937004114_15 at /127.0.0.1:57118 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x19fe5622-shared-pool-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x728232e6-shared-pool-23 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1937004114_15 at /127.0.0.1:57184 [Waiting for operation #10] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataStreamer for file /user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithMonthlyPolicy/2453f3b87d227457629ba8909b526463/.tmp/family1/4f60ee8f741943fd8b4fb2b40ab29cd7 block BP-1461392624-172.31.2.10-1675976018075:blk_1073741900_1076 java.lang.Object.wait(Native Method) org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:678) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1937004114_15 at /127.0.0.1:57088 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1937004114_15 at /127.0.0.1:57248 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x19fe5622-shared-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_225982754_15 at /127.0.0.1:56302 [Receiving block BP-1461392624-172.31.2.10-1675976018075:blk_1073741900_1076] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read1(BufferedInputStream.java:286) java.io.BufferedInputStream.read(BufferedInputStream.java:345) java.io.DataInputStream.read(DataInputStream.java:149) org.apache.hadoop.io.IOUtils.readFully(IOUtils.java:209) org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doReadFully(PacketReceiver.java:211) org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doRead(PacketReceiver.java:134) org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.receiveNextPacket(PacketReceiver.java:109) org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receivePacket(BlockReceiver.java:528) org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receiveBlock(BlockReceiver.java:968) org.apache.hadoop.hdfs.server.datanode.DataXceiver.writeBlock(DataXceiver.java:877) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.opWriteBlock(Receiver.java:166) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.processOp(Receiver.java:103) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:290) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:62089@0x12282a75 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$45/635576566.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c2e7a7e1-d76d-10d1-eb7e-79dd8ea5a0ce/cluster_fa6f1a2e-f8e7-684c-e5cc-577d8df2e8bf/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x19fe5622-shared-pool-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1937004114_15 at /127.0.0.1:56280 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c2e7a7e1-d76d-10d1-eb7e-79dd8ea5a0ce/cluster_fa6f1a2e-f8e7-684c-e5cc-577d8df2e8bf/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1937004114_15 at /127.0.0.1:57230 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x19fe5622-shared-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_225982754_15 at /127.0.0.1:56288 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x19fe5622-metaLookup-shared--pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=617 (was 584) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=278 (was 274) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 168), AvailableMemoryMB=11118 (was 11508) 2023-02-09 20:54:10,707 INFO [Listener at localhost/46855] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompactionWithWeeklyPolicy Thread=262, OpenFileDescriptor=617, MaxFileDescriptor=60000, SystemLoadAverage=278, ProcessCount=168, AvailableMemoryMB=11116 2023-02-09 20:54:10,710 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.HMaster$4(2102): Client=jenkins//172.31.2.10 create 'testMinorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-02-09 20:54:10,712 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure2.ProcedureExecutor(1029): Stored pid=23, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:10,714 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-02-09 20:54:10,714 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(697): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testMinorCompactionWithWeeklyPolicy" procId is: 23 2023-02-09 20:54:10,715 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-09 20:54:10,716 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1227): Checking to see if procedure is done pid=23 2023-02-09 20:54:10,717 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/e45b0667ca59a312bd230beb34d49fe9 2023-02-09 20:54:10,718 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/e45b0667ca59a312bd230beb34d49fe9 empty. 2023-02-09 20:54:10,718 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/e45b0667ca59a312bd230beb34d49fe9 2023-02-09 20:54:10,718 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testMinorCompactionWithWeeklyPolicy regions 2023-02-09 20:54:10,762 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-09 20:54:10,767 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x12282a75 to 127.0.0.1:62089 2023-02-09 20:54:10,767 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 20:54:10,771 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-09 20:54:10,771 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x24124008 to 127.0.0.1:62089 2023-02-09 20:54:10,771 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 20:54:10,774 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-09 20:54:10,775 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3b67ed6c to 127.0.0.1:62089 2023-02-09 20:54:10,775 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 20:54:10,818 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1227): Checking to see if procedure is done pid=23 2023-02-09 20:54:11,019 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1227): Checking to see if procedure is done pid=23 2023-02-09 20:54:11,168 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/.tabledesc/.tableinfo.0000000001 2023-02-09 20:54:11,169 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(7671): creating {ENCODED => e45b0667ca59a312bd230beb34d49fe9, NAME => 'testMinorCompactionWithWeeklyPolicy,,1675976050709.e45b0667ca59a312bd230beb34d49fe9.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMinorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/.tmp 2023-02-09 20:54:11,320 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1227): Checking to see if procedure is done pid=23 2023-02-09 20:54:11,419 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithMonthlyPolicy/2453f3b87d227457629ba8909b526463/.tmp/family1/4f60ee8f741943fd8b4fb2b40ab29cd7 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithMonthlyPolicy/2453f3b87d227457629ba8909b526463/family1/4f60ee8f741943fd8b4fb2b40ab29cd7 2023-02-09 20:54:11,425 INFO [RS:0;jenkins-hbase9:40919-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in 2453f3b87d227457629ba8909b526463/family1 of 2453f3b87d227457629ba8909b526463 into 4f60ee8f741943fd8b4fb2b40ab29cd7(size=167.4 K), total size for store is 167.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-09 20:54:11,425 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 2453f3b87d227457629ba8909b526463: 2023-02-09 20:54:11,425 INFO [RS:0;jenkins-hbase9:40919-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithMonthlyPolicy,,1675976040214.2453f3b87d227457629ba8909b526463., storeName=family1, fileCount=4, fileSize=344.3 K (166.0 K, 6.6 K, 5.5 K, 166.2 K), priority=2, time=1675976050560; duration=0sec 2023-02-09 20:54:11,425 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-09 20:54:11,460 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithMonthlyPolicy/2453f3b87d227457629ba8909b526463/family1/d7c24654ee8649a9a1a725ddd3b970f7, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithMonthlyPolicy/2453f3b87d227457629ba8909b526463/family1/f5cfee18d7ff4cf0a97808049c3f7105, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithMonthlyPolicy/2453f3b87d227457629ba8909b526463/family1/1fddf6610d654fa2a70883a956a9abed_SeqId_46_, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithMonthlyPolicy/2453f3b87d227457629ba8909b526463/family1/b2a466be9faa4a65b2847ae9d5101cec_SeqId_49_] to archive 2023-02-09 20:54:11,460 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 20:54:11,462 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithMonthlyPolicy/2453f3b87d227457629ba8909b526463/family1/d7c24654ee8649a9a1a725ddd3b970f7 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMajorCompactionWithMonthlyPolicy/2453f3b87d227457629ba8909b526463/family1/d7c24654ee8649a9a1a725ddd3b970f7 2023-02-09 20:54:11,463 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithMonthlyPolicy/2453f3b87d227457629ba8909b526463/family1/f5cfee18d7ff4cf0a97808049c3f7105 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMajorCompactionWithMonthlyPolicy/2453f3b87d227457629ba8909b526463/family1/f5cfee18d7ff4cf0a97808049c3f7105 2023-02-09 20:54:11,465 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithMonthlyPolicy/2453f3b87d227457629ba8909b526463/family1/1fddf6610d654fa2a70883a956a9abed_SeqId_46_ to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMajorCompactionWithMonthlyPolicy/2453f3b87d227457629ba8909b526463/family1/1fddf6610d654fa2a70883a956a9abed_SeqId_46_ 2023-02-09 20:54:11,466 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithMonthlyPolicy/2453f3b87d227457629ba8909b526463/family1/b2a466be9faa4a65b2847ae9d5101cec_SeqId_49_ to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMajorCompactionWithMonthlyPolicy/2453f3b87d227457629ba8909b526463/family1/b2a466be9faa4a65b2847ae9d5101cec_SeqId_49_ 2023-02-09 20:54:11,576 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(865): Instantiated testMinorCompactionWithWeeklyPolicy,,1675976050709.e45b0667ca59a312bd230beb34d49fe9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 20:54:11,576 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1603): Closing e45b0667ca59a312bd230beb34d49fe9, disabling compactions & flushes 2023-02-09 20:54:11,576 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1625): Closing region testMinorCompactionWithWeeklyPolicy,,1675976050709.e45b0667ca59a312bd230beb34d49fe9. 2023-02-09 20:54:11,576 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMinorCompactionWithWeeklyPolicy,,1675976050709.e45b0667ca59a312bd230beb34d49fe9. 2023-02-09 20:54:11,576 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1713): Acquired close lock on testMinorCompactionWithWeeklyPolicy,,1675976050709.e45b0667ca59a312bd230beb34d49fe9. after waiting 0 ms 2023-02-09 20:54:11,576 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1723): Updates disabled for region testMinorCompactionWithWeeklyPolicy,,1675976050709.e45b0667ca59a312bd230beb34d49fe9. 2023-02-09 20:54:11,576 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1837): Closed testMinorCompactionWithWeeklyPolicy,,1675976050709.e45b0667ca59a312bd230beb34d49fe9. 2023-02-09 20:54:11,576 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1557): Region close journal for e45b0667ca59a312bd230beb34d49fe9: Waiting for close lock at 1675976051576Disabling compacts and flushes for region at 1675976051576Disabling writes for close at 1675976051576Writing region close event to WAL at 1675976051576Closed at 1675976051576 2023-02-09 20:54:11,579 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-02-09 20:54:11,580 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMinorCompactionWithWeeklyPolicy,,1675976050709.e45b0667ca59a312bd230beb34d49fe9.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1675976051580"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675976051580"}]},"ts":"1675976051580"} 2023-02-09 20:54:11,581 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-09 20:54:11,582 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-09 20:54:11,582 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675976051582"}]},"ts":"1675976051582"} 2023-02-09 20:54:11,584 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithWeeklyPolicy, state=ENABLING in hbase:meta 2023-02-09 20:54:11,588 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=e45b0667ca59a312bd230beb34d49fe9, ASSIGN}] 2023-02-09 20:54:11,590 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=e45b0667ca59a312bd230beb34d49fe9, ASSIGN 2023-02-09 20:54:11,591 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=e45b0667ca59a312bd230beb34d49fe9, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,40919,1675976022294; forceNewPlan=false, retain=false 2023-02-09 20:54:11,742 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=e45b0667ca59a312bd230beb34d49fe9, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:11,742 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMinorCompactionWithWeeklyPolicy,,1675976050709.e45b0667ca59a312bd230beb34d49fe9.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1675976051742"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675976051742"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675976051742"}]},"ts":"1675976051742"} 2023-02-09 20:54:11,745 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=24, state=RUNNABLE; OpenRegionProcedure e45b0667ca59a312bd230beb34d49fe9, server=jenkins-hbase9.apache.org,40919,1675976022294}] 2023-02-09 20:54:11,821 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1227): Checking to see if procedure is done pid=23 2023-02-09 20:54:11,900 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open testMinorCompactionWithWeeklyPolicy,,1675976050709.e45b0667ca59a312bd230beb34d49fe9. 2023-02-09 20:54:11,900 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => e45b0667ca59a312bd230beb34d49fe9, NAME => 'testMinorCompactionWithWeeklyPolicy,,1675976050709.e45b0667ca59a312bd230beb34d49fe9.', STARTKEY => '', ENDKEY => ''} 2023-02-09 20:54:11,900 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompactionWithWeeklyPolicy e45b0667ca59a312bd230beb34d49fe9 2023-02-09 20:54:11,900 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated testMinorCompactionWithWeeklyPolicy,,1675976050709.e45b0667ca59a312bd230beb34d49fe9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 20:54:11,900 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for e45b0667ca59a312bd230beb34d49fe9 2023-02-09 20:54:11,901 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for e45b0667ca59a312bd230beb34d49fe9 2023-02-09 20:54:11,902 INFO [StoreOpener-e45b0667ca59a312bd230beb34d49fe9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region e45b0667ca59a312bd230beb34d49fe9 2023-02-09 20:54:11,903 DEBUG [StoreOpener-e45b0667ca59a312bd230beb34d49fe9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithWeeklyPolicy/e45b0667ca59a312bd230beb34d49fe9/family1 2023-02-09 20:54:11,903 DEBUG [StoreOpener-e45b0667ca59a312bd230beb34d49fe9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithWeeklyPolicy/e45b0667ca59a312bd230beb34d49fe9/family1 2023-02-09 20:54:11,904 INFO [StoreOpener-e45b0667ca59a312bd230beb34d49fe9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e45b0667ca59a312bd230beb34d49fe9 columnFamilyName family1 2023-02-09 20:54:11,905 INFO [StoreOpener-e45b0667ca59a312bd230beb34d49fe9-1] regionserver.HStore(310): Store=e45b0667ca59a312bd230beb34d49fe9/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 20:54:11,906 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithWeeklyPolicy/e45b0667ca59a312bd230beb34d49fe9 2023-02-09 20:54:11,906 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithWeeklyPolicy/e45b0667ca59a312bd230beb34d49fe9 2023-02-09 20:54:11,909 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for e45b0667ca59a312bd230beb34d49fe9 2023-02-09 20:54:11,911 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithWeeklyPolicy/e45b0667ca59a312bd230beb34d49fe9/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 20:54:11,911 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened e45b0667ca59a312bd230beb34d49fe9; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69257978, jitterRate=0.03202429413795471}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-09 20:54:11,911 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for e45b0667ca59a312bd230beb34d49fe9: Running coprocessor pre-open hook at 1675976051901Writing region info on filesystem at 1675976051901Initializing all the Stores at 1675976051901Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} at 1675976051901Cleaning up temporary data from old regions at 1675976051906 (+5 ms)Cleaning up detritus from prior splits at 1675976051907 (+1 ms)Running coprocessor post-open hooks at 1675976051911 (+4 ms)Region opened successfully at 1675976051911 2023-02-09 20:54:11,912 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMinorCompactionWithWeeklyPolicy,,1675976050709.e45b0667ca59a312bd230beb34d49fe9., pid=25, masterSystemTime=1675976051897 2023-02-09 20:54:11,914 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMinorCompactionWithWeeklyPolicy,,1675976050709.e45b0667ca59a312bd230beb34d49fe9. 2023-02-09 20:54:11,914 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened testMinorCompactionWithWeeklyPolicy,,1675976050709.e45b0667ca59a312bd230beb34d49fe9. 2023-02-09 20:54:11,915 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=e45b0667ca59a312bd230beb34d49fe9, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:11,915 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMinorCompactionWithWeeklyPolicy,,1675976050709.e45b0667ca59a312bd230beb34d49fe9.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1675976051915"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675976051915"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675976051915"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675976051915"}]},"ts":"1675976051915"} 2023-02-09 20:54:11,919 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=24 2023-02-09 20:54:11,919 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=24, state=SUCCESS; OpenRegionProcedure e45b0667ca59a312bd230beb34d49fe9, server=jenkins-hbase9.apache.org,40919,1675976022294 in 172 msec 2023-02-09 20:54:11,921 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=23 2023-02-09 20:54:11,921 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=23, state=SUCCESS; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=e45b0667ca59a312bd230beb34d49fe9, ASSIGN in 331 msec 2023-02-09 20:54:11,922 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-09 20:54:11,922 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675976051922"}]},"ts":"1675976051922"} 2023-02-09 20:54:11,923 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithWeeklyPolicy, state=ENABLED in hbase:meta 2023-02-09 20:54:11,925 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-02-09 20:54:11,927 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=23, state=SUCCESS; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy in 1.2150 sec 2023-02-09 20:54:12,823 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1227): Checking to see if procedure is done pid=23 2023-02-09 20:54:12,823 INFO [Listener at localhost/46855] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMinorCompactionWithWeeklyPolicy, procId: 23 completed 2023-02-09 20:54:12,847 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(933): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-02-09 20:54:12,848 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:12,849 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-02-09 20:54:12,849 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:54:12,849 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-09 20:54:12,849 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-09 20:54:12,849 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:12,849 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:12,850 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:54:12,850 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:12,850 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:54:12,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:54:12,851 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:12,851 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 20:54:12,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:12,851 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:12,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 20:54:12,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:12,851 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:12,852 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:12,852 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-09 20:54:12,852 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:54:12,852 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-09 20:54:12,852 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 20:54:12,852 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 20:54:12,852 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1675976050709.e45b0667ca59a312bd230beb34d49fe9. 2023-02-09 20:54:12,852 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1675976050709.e45b0667ca59a312bd230beb34d49fe9. started... 2023-02-09 20:54:12,853 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing e45b0667ca59a312bd230beb34d49fe9 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-02-09 20:54:13,280 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015113041e1bbb275374cccb4d917c47b696f1f to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015113041e1bbb275374cccb4d917c47b696f1f 2023-02-09 20:54:13,420 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMinorCompactionWithWeeklyPolicy' 2023-02-09 20:54:13,684 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithWeeklyPolicy/e45b0667ca59a312bd230beb34d49fe9/.tmp/family1/dff48a1a9efb409eaa704c128b9f6b0f 2023-02-09 20:54:13,691 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithWeeklyPolicy/e45b0667ca59a312bd230beb34d49fe9/.tmp/family1/dff48a1a9efb409eaa704c128b9f6b0f as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithWeeklyPolicy/e45b0667ca59a312bd230beb34d49fe9/family1/dff48a1a9efb409eaa704c128b9f6b0f 2023-02-09 20:54:13,696 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithWeeklyPolicy/e45b0667ca59a312bd230beb34d49fe9/family1/dff48a1a9efb409eaa704c128b9f6b0f, entries=1000, sequenceid=5, filesize=165.1 K 2023-02-09 20:54:13,697 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for e45b0667ca59a312bd230beb34d49fe9 in 844ms, sequenceid=5, compaction requested=false 2023-02-09 20:54:13,698 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for e45b0667ca59a312bd230beb34d49fe9: 2023-02-09 20:54:13,698 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1675976050709.e45b0667ca59a312bd230beb34d49fe9. 2023-02-09 20:54:13,698 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 20:54:13,698 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 20:54:13,698 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:13,698 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-02-09 20:54:13,698 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-02-09 20:54:13,700 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:13,700 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:13,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:13,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:54:13,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:54:13,700 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:13,700 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 20:54:13,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:54:13,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:54:13,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:13,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:13,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:54:13,702 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-02-09 20:54:13,702 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7513ad0d[Count = 0] remaining members to acquire global barrier 2023-02-09 20:54:13,702 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-09 20:54:13,702 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:13,703 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:13,703 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:13,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:13,703 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-09 20:54:13,703 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-02-09 20:54:13,703 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase9.apache.org,40919,1675976022294' in zk 2023-02-09 20:54:13,703 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:13,703 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 20:54:13,705 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-09 20:54:13,705 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:13,705 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:54:13,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:13,705 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-02-09 20:54:13,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:54:13,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:54:13,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:54:13,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:54:13,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:13,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:13,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:54:13,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:13,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:13,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase9.apache.org,40919,1675976022294': 2023-02-09 20:54:13,708 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-09 20:54:13,708 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-02-09 20:54:13,708 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 20:54:13,708 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 20:54:13,708 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:13,708 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 20:54:13,711 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:13,711 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:13,711 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:54:13,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:13,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:54:13,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:54:13,711 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:13,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:13,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:54:13,715 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:54:13,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:54:13,715 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:13,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:13,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:13,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:54:13,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:13,716 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:13,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:13,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:54:13,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:13,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:13,719 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:13,719 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:54:13,719 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:13,719 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-02-09 20:54:13,719 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 20:54:13,719 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:13,719 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:54:13,719 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:54:13,719 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:54:13,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:54:13,719 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-09 20:54:13,719 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:13,720 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 20:54:13,720 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:13,720 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:54:13,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:54:13,720 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:13,720 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:13,820 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 20:54:13,821 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 20:54:13,826 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(933): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-02-09 20:54:13,828 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-09 20:54:13,828 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:13,828 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-02-09 20:54:13,828 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:54:13,828 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-09 20:54:13,828 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-09 20:54:13,828 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:13,828 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:13,830 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:54:13,830 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:13,830 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:54:13,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:54:13,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:13,830 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:13,831 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 20:54:13,831 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:13,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 20:54:13,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:13,831 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:13,832 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-02-09 20:54:13,832 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:13,832 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-09 20:54:13,832 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:54:13,832 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-09 20:54:13,832 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 20:54:13,832 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 20:54:13,832 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1675976050709.e45b0667ca59a312bd230beb34d49fe9. 2023-02-09 20:54:13,832 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1675976050709.e45b0667ca59a312bd230beb34d49fe9. started... 2023-02-09 20:54:13,832 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing e45b0667ca59a312bd230beb34d49fe9 1/1 column families, dataSize=74 B heapSize=408 B 2023-02-09 20:54:14,247 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128e49b34b3be494f11975e3a2b587036fd to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151128e49b34b3be494f11975e3a2b587036fd 2023-02-09 20:54:14,256 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithWeeklyPolicy/e45b0667ca59a312bd230beb34d49fe9/.tmp/family1/3d95eba818654e499756a69dc684d975 2023-02-09 20:54:14,266 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithWeeklyPolicy/e45b0667ca59a312bd230beb34d49fe9/.tmp/family1/3d95eba818654e499756a69dc684d975 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithWeeklyPolicy/e45b0667ca59a312bd230beb34d49fe9/family1/3d95eba818654e499756a69dc684d975 2023-02-09 20:54:14,271 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithWeeklyPolicy/e45b0667ca59a312bd230beb34d49fe9/family1/3d95eba818654e499756a69dc684d975, entries=1, sequenceid=9, filesize=5.0 K 2023-02-09 20:54:14,272 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for e45b0667ca59a312bd230beb34d49fe9 in 440ms, sequenceid=9, compaction requested=false 2023-02-09 20:54:14,272 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for e45b0667ca59a312bd230beb34d49fe9: 2023-02-09 20:54:14,274 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1675976050709.e45b0667ca59a312bd230beb34d49fe9. 2023-02-09 20:54:14,274 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 20:54:14,274 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 20:54:14,274 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:14,274 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-02-09 20:54:14,274 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-02-09 20:54:14,276 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:14,276 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:14,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:14,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:54:14,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:54:14,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:54:14,277 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:14,278 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 20:54:14,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:54:14,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:14,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:14,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:54:14,280 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-02-09 20:54:14,280 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5f22fcc4[Count = 0] remaining members to acquire global barrier 2023-02-09 20:54:14,280 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-09 20:54:14,280 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:14,283 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:14,283 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:14,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:14,284 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:14,284 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 20:54:14,284 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-09 20:54:14,284 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-02-09 20:54:14,284 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase9.apache.org,40919,1675976022294' in zk 2023-02-09 20:54:14,286 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:14,286 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-09 20:54:14,286 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:54:14,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:14,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:54:14,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:54:14,286 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-02-09 20:54:14,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:54:14,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:54:14,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:14,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:14,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:54:14,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:14,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:14,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase9.apache.org,40919,1675976022294': 2023-02-09 20:54:14,289 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-09 20:54:14,289 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-02-09 20:54:14,289 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 20:54:14,289 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 20:54:14,289 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:14,289 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 20:54:14,291 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:14,291 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:14,291 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:14,291 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:54:14,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:14,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:14,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:54:14,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:54:14,292 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:54:14,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:54:14,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:54:14,292 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:14,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:14,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:14,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:54:14,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:14,293 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:14,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:14,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:54:14,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:14,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:14,296 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:14,296 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:14,296 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:14,296 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:54:14,296 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:54:14,296 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:54:14,296 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:14,296 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-02-09 20:54:14,296 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 20:54:14,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:54:14,296 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:54:14,297 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-09 20:54:14,296 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:14,297 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-09 20:54:14,297 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 20:54:14,297 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:54:14,297 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:14,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:54:14,297 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:14,397 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 20:54:14,398 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 20:54:14,403 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(933): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-02-09 20:54:14,405 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-09 20:54:14,405 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:14,405 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-02-09 20:54:14,405 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:54:14,405 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-09 20:54:14,405 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-09 20:54:14,406 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:14,406 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:14,407 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:54:14,408 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:14,408 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:54:14,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:54:14,408 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:14,408 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 20:54:14,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:14,408 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:14,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 20:54:14,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:14,409 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:14,409 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-02-09 20:54:14,409 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:14,409 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-09 20:54:14,409 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:54:14,409 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-09 20:54:14,409 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 20:54:14,409 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 20:54:14,409 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1675976050709.e45b0667ca59a312bd230beb34d49fe9. 2023-02-09 20:54:14,409 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1675976050709.e45b0667ca59a312bd230beb34d49fe9. started... 2023-02-09 20:54:14,409 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing e45b0667ca59a312bd230beb34d49fe9 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-09 20:54:14,825 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120169b8379d13fd414dad6059b4934b9e95 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015120169b8379d13fd414dad6059b4934b9e95 2023-02-09 20:54:14,830 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithWeeklyPolicy/e45b0667ca59a312bd230beb34d49fe9/.tmp/family1/854197aa27b9430b8568679b28afa934 2023-02-09 20:54:14,835 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithWeeklyPolicy/e45b0667ca59a312bd230beb34d49fe9/.tmp/family1/854197aa27b9430b8568679b28afa934 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithWeeklyPolicy/e45b0667ca59a312bd230beb34d49fe9/family1/854197aa27b9430b8568679b28afa934 2023-02-09 20:54:14,840 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithWeeklyPolicy/e45b0667ca59a312bd230beb34d49fe9/family1/854197aa27b9430b8568679b28afa934, entries=1, sequenceid=13, filesize=4.9 K 2023-02-09 20:54:14,841 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e45b0667ca59a312bd230beb34d49fe9 in 432ms, sequenceid=13, compaction requested=true 2023-02-09 20:54:14,841 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for e45b0667ca59a312bd230beb34d49fe9: 2023-02-09 20:54:14,841 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1675976050709.e45b0667ca59a312bd230beb34d49fe9. 2023-02-09 20:54:14,841 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 20:54:14,841 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 20:54:14,841 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:14,841 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-02-09 20:54:14,842 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-02-09 20:54:14,843 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:14,843 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:14,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:14,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:54:14,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:54:14,843 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:14,843 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 20:54:14,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:54:14,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:54:14,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:14,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:14,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:54:14,845 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-02-09 20:54:14,845 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4f93c5ba[Count = 0] remaining members to acquire global barrier 2023-02-09 20:54:14,845 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-09 20:54:14,845 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:14,846 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:14,846 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:14,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:14,846 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-09 20:54:14,846 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-02-09 20:54:14,846 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase9.apache.org,40919,1675976022294' in zk 2023-02-09 20:54:14,847 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:14,847 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 20:54:14,848 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-09 20:54:14,848 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:14,848 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:54:14,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:14,848 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-02-09 20:54:14,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:54:14,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:54:14,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:54:14,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:54:14,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:14,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:14,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:54:14,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:14,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:14,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase9.apache.org,40919,1675976022294': 2023-02-09 20:54:14,851 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-09 20:54:14,851 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-02-09 20:54:14,851 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 20:54:14,851 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 20:54:14,851 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:14,851 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 20:54:14,858 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:14,858 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:14,858 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:14,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:14,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:54:14,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:54:14,858 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:54:14,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:14,858 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:14,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:54:14,859 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:54:14,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:54:14,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:14,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:14,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:54:14,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:14,860 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:14,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:14,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:54:14,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:14,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:14,861 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:14,861 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:14,861 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:14,861 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:14,861 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:14,861 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:54:14,861 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-02-09 20:54:14,862 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 20:54:14,861 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:14,862 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:14,862 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:54:14,862 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-09 20:54:14,862 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:54:14,862 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-09 20:54:14,862 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:54:14,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:54:14,862 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 20:54:14,863 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:54:14,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:54:14,962 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 20:54:14,964 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 20:54:14,968 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(933): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-02-09 20:54:14,969 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-09 20:54:14,969 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:14,969 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-02-09 20:54:14,969 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:54:14,970 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-09 20:54:14,970 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-09 20:54:14,970 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:14,970 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:14,971 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:14,971 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:54:14,971 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:54:14,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:54:14,971 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:14,972 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 20:54:14,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:14,972 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:14,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 20:54:14,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:14,972 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:14,972 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-02-09 20:54:14,972 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:14,973 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-09 20:54:14,973 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:54:14,973 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-09 20:54:14,973 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 20:54:14,973 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 20:54:14,973 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1675976050709.e45b0667ca59a312bd230beb34d49fe9. 2023-02-09 20:54:14,973 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1675976050709.e45b0667ca59a312bd230beb34d49fe9. started... 2023-02-09 20:54:14,973 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing e45b0667ca59a312bd230beb34d49fe9 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-09 20:54:15,389 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512051b511c6bf2dd47b6912be89981e78e0a to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512051b511c6bf2dd47b6912be89981e78e0a 2023-02-09 20:54:15,795 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithWeeklyPolicy/e45b0667ca59a312bd230beb34d49fe9/.tmp/family1/acc0c413526548cca9a86dafec719595 2023-02-09 20:54:15,803 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithWeeklyPolicy/e45b0667ca59a312bd230beb34d49fe9/.tmp/family1/acc0c413526548cca9a86dafec719595 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithWeeklyPolicy/e45b0667ca59a312bd230beb34d49fe9/family1/acc0c413526548cca9a86dafec719595 2023-02-09 20:54:15,811 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithWeeklyPolicy/e45b0667ca59a312bd230beb34d49fe9/family1/acc0c413526548cca9a86dafec719595, entries=1, sequenceid=17, filesize=4.9 K 2023-02-09 20:54:15,813 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e45b0667ca59a312bd230beb34d49fe9 in 840ms, sequenceid=17, compaction requested=true 2023-02-09 20:54:15,813 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for e45b0667ca59a312bd230beb34d49fe9: 2023-02-09 20:54:15,813 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1675976050709.e45b0667ca59a312bd230beb34d49fe9. 2023-02-09 20:54:15,813 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 20:54:15,813 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 20:54:15,813 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:15,813 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-02-09 20:54:15,813 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-02-09 20:54:15,815 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:15,815 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:15,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:15,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:54:15,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:54:15,815 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:15,816 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 20:54:15,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:54:15,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:54:15,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:15,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:15,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:54:15,818 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-02-09 20:54:15,818 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@793c276c[Count = 0] remaining members to acquire global barrier 2023-02-09 20:54:15,818 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-09 20:54:15,818 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:15,825 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:15,825 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:15,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:15,825 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-09 20:54:15,825 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:15,825 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 20:54:15,825 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-02-09 20:54:15,825 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase9.apache.org,40919,1675976022294' in zk 2023-02-09 20:54:15,827 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:15,827 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-09 20:54:15,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:15,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:54:15,827 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:54:15,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:54:15,827 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-02-09 20:54:15,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:54:15,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:54:15,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:15,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:15,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:54:15,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:15,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:15,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase9.apache.org,40919,1675976022294': 2023-02-09 20:54:15,830 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-09 20:54:15,830 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-02-09 20:54:15,830 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 20:54:15,830 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 20:54:15,830 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:15,830 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 20:54:15,832 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:15,832 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:15,832 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:54:15,832 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:15,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:15,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:15,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:54:15,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:54:15,832 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:15,832 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:54:15,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:54:15,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:54:15,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:15,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:15,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:54:15,834 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:15,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:15,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:15,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:54:15,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:15,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:15,836 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:15,836 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:15,836 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:15,836 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:15,836 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:15,836 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:15,836 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:15,836 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:54:15,836 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:54:15,836 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:54:15,836 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:54:15,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:54:15,836 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-02-09 20:54:15,837 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 20:54:15,837 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-09 20:54:15,837 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:54:15,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:54:15,837 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-09 20:54:15,837 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 20:54:15,937 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 20:54:15,938 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 20:54:15,942 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(933): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-02-09 20:54:15,944 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-09 20:54:15,944 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:15,944 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-02-09 20:54:15,944 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:54:15,944 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-09 20:54:15,944 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-09 20:54:15,944 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:15,944 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:15,946 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:54:15,946 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:15,946 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:54:15,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:54:15,947 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:15,947 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 20:54:15,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:15,947 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:15,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 20:54:15,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:15,948 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:15,948 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-02-09 20:54:15,948 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:15,948 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-09 20:54:15,948 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:54:15,948 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-09 20:54:15,948 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 20:54:15,948 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 20:54:15,948 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1675976050709.e45b0667ca59a312bd230beb34d49fe9. 2023-02-09 20:54:15,948 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1675976050709.e45b0667ca59a312bd230beb34d49fe9. started... 2023-02-09 20:54:15,948 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing e45b0667ca59a312bd230beb34d49fe9 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-09 20:54:16,362 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228864300bb1c024ad8971536deff4323c8 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151228864300bb1c024ad8971536deff4323c8 2023-02-09 20:54:16,768 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithWeeklyPolicy/e45b0667ca59a312bd230beb34d49fe9/.tmp/family1/7039b4d8a0974bfb8e7f5ae9907cc7ad 2023-02-09 20:54:16,773 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithWeeklyPolicy/e45b0667ca59a312bd230beb34d49fe9/.tmp/family1/7039b4d8a0974bfb8e7f5ae9907cc7ad as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithWeeklyPolicy/e45b0667ca59a312bd230beb34d49fe9/family1/7039b4d8a0974bfb8e7f5ae9907cc7ad 2023-02-09 20:54:16,778 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithWeeklyPolicy/e45b0667ca59a312bd230beb34d49fe9/family1/7039b4d8a0974bfb8e7f5ae9907cc7ad, entries=1, sequenceid=21, filesize=4.9 K 2023-02-09 20:54:16,779 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e45b0667ca59a312bd230beb34d49fe9 in 831ms, sequenceid=21, compaction requested=true 2023-02-09 20:54:16,779 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for e45b0667ca59a312bd230beb34d49fe9: 2023-02-09 20:54:16,779 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1675976050709.e45b0667ca59a312bd230beb34d49fe9. 2023-02-09 20:54:16,779 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 20:54:16,779 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 20:54:16,779 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:16,779 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-02-09 20:54:16,779 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-02-09 20:54:16,781 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:16,781 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:16,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:16,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:54:16,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:54:16,781 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:16,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:54:16,781 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 20:54:16,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:54:16,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:16,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:16,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:54:16,782 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-02-09 20:54:16,782 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@112f9683[Count = 0] remaining members to acquire global barrier 2023-02-09 20:54:16,782 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-09 20:54:16,783 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:16,784 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:16,784 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:16,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:16,784 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-09 20:54:16,784 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-02-09 20:54:16,784 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase9.apache.org,40919,1675976022294' in zk 2023-02-09 20:54:16,784 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:16,784 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 20:54:16,785 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-09 20:54:16,785 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:54:16,785 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:16,785 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-02-09 20:54:16,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:16,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:54:16,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:54:16,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:54:16,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:54:16,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:16,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:16,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:54:16,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:16,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:16,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase9.apache.org,40919,1675976022294': 2023-02-09 20:54:16,787 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-09 20:54:16,787 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-02-09 20:54:16,787 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 20:54:16,787 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 20:54:16,787 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:16,787 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 20:54:16,790 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:16,790 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:16,790 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:16,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:16,790 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:54:16,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:16,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:54:16,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:54:16,790 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:54:16,790 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:16,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:54:16,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:54:16,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:16,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:16,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:54:16,791 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:16,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:16,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:16,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:54:16,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:16,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:16,793 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:16,793 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:16,793 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:54:16,793 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:16,793 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-02-09 20:54:16,793 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 20:54:16,793 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:16,793 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:54:16,793 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-09 20:54:16,793 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:54:16,793 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:54:16,794 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-09 20:54:16,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:54:16,793 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:16,794 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 20:54:16,794 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:16,794 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:16,794 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:54:16,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:54:16,894 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 20:54:16,895 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 20:54:16,900 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(933): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-02-09 20:54:16,902 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-09 20:54:16,902 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:16,902 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-02-09 20:54:16,902 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:54:16,902 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-09 20:54:16,902 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-09 20:54:16,911 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:16,911 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:16,912 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:54:16,912 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:16,912 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:54:16,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:54:16,913 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:16,913 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 20:54:16,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:16,913 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:16,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 20:54:16,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:16,914 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:16,914 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-02-09 20:54:16,914 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:16,914 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-09 20:54:16,914 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:54:16,914 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-09 20:54:16,914 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 20:54:16,915 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 20:54:16,915 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1675976050709.e45b0667ca59a312bd230beb34d49fe9. 2023-02-09 20:54:16,915 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1675976050709.e45b0667ca59a312bd230beb34d49fe9. started... 2023-02-09 20:54:16,915 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing e45b0667ca59a312bd230beb34d49fe9 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-09 20:54:17,330 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231c30c66572a2947d79c9759c557b0a376 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151231c30c66572a2947d79c9759c557b0a376 2023-02-09 20:54:17,434 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-09 20:54:17,736 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithWeeklyPolicy/e45b0667ca59a312bd230beb34d49fe9/.tmp/family1/88359fcb83fe4651ac273459320cec57 2023-02-09 20:54:17,742 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithWeeklyPolicy/e45b0667ca59a312bd230beb34d49fe9/.tmp/family1/88359fcb83fe4651ac273459320cec57 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithWeeklyPolicy/e45b0667ca59a312bd230beb34d49fe9/family1/88359fcb83fe4651ac273459320cec57 2023-02-09 20:54:17,748 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithWeeklyPolicy/e45b0667ca59a312bd230beb34d49fe9/family1/88359fcb83fe4651ac273459320cec57, entries=1, sequenceid=25, filesize=4.9 K 2023-02-09 20:54:17,749 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e45b0667ca59a312bd230beb34d49fe9 in 834ms, sequenceid=25, compaction requested=true 2023-02-09 20:54:17,749 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for e45b0667ca59a312bd230beb34d49fe9: 2023-02-09 20:54:17,749 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1675976050709.e45b0667ca59a312bd230beb34d49fe9. 2023-02-09 20:54:17,749 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 20:54:17,749 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 20:54:17,749 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:17,749 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-02-09 20:54:17,749 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-02-09 20:54:17,751 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:17,751 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:17,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:17,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:54:17,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:54:17,751 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:17,751 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 20:54:17,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:54:17,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:54:17,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:17,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:17,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:54:17,753 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-02-09 20:54:17,753 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@59238cbe[Count = 0] remaining members to acquire global barrier 2023-02-09 20:54:17,753 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-09 20:54:17,753 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:17,755 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:17,755 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:17,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:17,755 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-09 20:54:17,755 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:17,755 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 20:54:17,755 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-02-09 20:54:17,755 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase9.apache.org,40919,1675976022294' in zk 2023-02-09 20:54:17,759 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:17,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:17,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:54:17,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:54:17,759 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-09 20:54:17,759 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:54:17,759 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-02-09 20:54:17,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:54:17,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:54:17,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:17,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:17,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:54:17,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:17,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:17,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase9.apache.org,40919,1675976022294': 2023-02-09 20:54:17,762 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-09 20:54:17,762 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-02-09 20:54:17,762 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 20:54:17,762 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 20:54:17,762 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:17,762 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 20:54:17,764 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:17,764 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:17,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:17,764 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:17,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:17,764 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:54:17,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:54:17,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:54:17,765 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:54:17,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:54:17,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:54:17,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:17,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:17,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:54:17,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:17,766 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:17,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:17,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:54:17,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:17,767 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:17,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:17,770 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:54:17,770 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:54:17,770 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:54:17,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:54:17,771 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:54:17,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:54:17,773 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:17,773 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:17,773 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:17,773 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-02-09 20:54:17,773 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 20:54:17,773 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:17,773 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:54:17,773 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:17,773 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:17,773 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:17,773 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-09 20:54:17,773 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 20:54:17,874 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 20:54:17,875 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 20:54:17,879 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(933): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-02-09 20:54:17,881 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-09 20:54:17,881 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:17,881 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-02-09 20:54:17,881 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:54:17,881 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-09 20:54:17,881 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-09 20:54:17,881 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:17,881 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:17,883 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:54:17,883 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:17,883 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:54:17,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:54:17,883 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:17,883 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 20:54:17,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:17,884 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:17,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 20:54:17,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:17,885 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:17,885 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-02-09 20:54:17,885 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:17,885 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-09 20:54:17,885 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:54:17,885 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-09 20:54:17,885 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 20:54:17,885 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 20:54:17,885 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1675976050709.e45b0667ca59a312bd230beb34d49fe9. 2023-02-09 20:54:17,885 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1675976050709.e45b0667ca59a312bd230beb34d49fe9. started... 2023-02-09 20:54:17,885 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing e45b0667ca59a312bd230beb34d49fe9 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-09 20:54:18,302 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601010c1c4408aafe49c5aa010a407024015f to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201601010c1c4408aafe49c5aa010a407024015f 2023-02-09 20:54:18,709 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithWeeklyPolicy/e45b0667ca59a312bd230beb34d49fe9/.tmp/family1/d107882eae9c4658b0f079045418f2e7 2023-02-09 20:54:18,715 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithWeeklyPolicy/e45b0667ca59a312bd230beb34d49fe9/.tmp/family1/d107882eae9c4658b0f079045418f2e7 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithWeeklyPolicy/e45b0667ca59a312bd230beb34d49fe9/family1/d107882eae9c4658b0f079045418f2e7 2023-02-09 20:54:18,720 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithWeeklyPolicy/e45b0667ca59a312bd230beb34d49fe9/family1/d107882eae9c4658b0f079045418f2e7, entries=1, sequenceid=29, filesize=4.9 K 2023-02-09 20:54:18,721 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e45b0667ca59a312bd230beb34d49fe9 in 836ms, sequenceid=29, compaction requested=true 2023-02-09 20:54:18,721 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for e45b0667ca59a312bd230beb34d49fe9: 2023-02-09 20:54:18,721 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1675976050709.e45b0667ca59a312bd230beb34d49fe9. 2023-02-09 20:54:18,721 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 20:54:18,721 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 20:54:18,721 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:18,722 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-02-09 20:54:18,722 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-02-09 20:54:18,723 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:18,723 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:18,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:18,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:54:18,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:54:18,724 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:18,724 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 20:54:18,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:54:18,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:54:18,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:18,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:18,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:54:18,725 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-02-09 20:54:18,725 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@84c3c35[Count = 0] remaining members to acquire global barrier 2023-02-09 20:54:18,725 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-09 20:54:18,725 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:18,727 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:18,727 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:18,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:18,727 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-09 20:54:18,727 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-02-09 20:54:18,727 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase9.apache.org,40919,1675976022294' in zk 2023-02-09 20:54:18,727 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:18,727 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 20:54:18,729 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-09 20:54:18,729 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:18,729 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:54:18,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:18,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:54:18,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:54:18,730 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-02-09 20:54:18,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:54:18,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:54:18,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:18,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:18,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:54:18,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:18,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:18,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase9.apache.org,40919,1675976022294': 2023-02-09 20:54:18,732 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-09 20:54:18,732 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-02-09 20:54:18,733 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 20:54:18,733 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 20:54:18,733 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:18,733 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 20:54:18,734 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:18,734 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:54:18,734 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:18,734 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:18,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:18,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:18,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:54:18,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:54:18,735 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:54:18,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:54:18,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:54:18,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:18,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:18,736 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:18,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:54:18,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:18,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:18,737 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:18,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:54:18,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:18,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:18,739 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:18,739 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:54:18,739 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:18,739 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:54:18,739 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-02-09 20:54:18,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:54:18,739 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:54:18,739 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:18,739 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:18,739 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:18,739 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:54:18,739 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:18,739 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 20:54:18,739 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:54:18,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:54:18,739 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:18,740 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-09 20:54:18,740 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 20:54:18,840 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 20:54:18,841 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 20:54:18,845 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(933): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-02-09 20:54:18,847 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-09 20:54:18,847 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:18,847 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-02-09 20:54:18,847 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:54:18,847 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-09 20:54:18,847 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-09 20:54:18,847 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:18,848 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:18,849 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:18,849 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:54:18,849 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:54:18,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:54:18,849 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:18,849 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 20:54:18,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:18,850 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:18,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 20:54:18,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:18,850 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:18,850 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-02-09 20:54:18,850 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:18,850 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-09 20:54:18,850 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:54:18,850 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-09 20:54:18,851 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 20:54:18,851 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 20:54:18,851 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1675976050709.e45b0667ca59a312bd230beb34d49fe9. 2023-02-09 20:54:18,851 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1675976050709.e45b0667ca59a312bd230beb34d49fe9. started... 2023-02-09 20:54:18,851 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing e45b0667ca59a312bd230beb34d49fe9 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-09 20:54:19,265 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601036c3e86fa4017434cafc649077ace78a8 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201601036c3e86fa4017434cafc649077ace78a8 2023-02-09 20:54:19,670 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithWeeklyPolicy/e45b0667ca59a312bd230beb34d49fe9/.tmp/family1/54f08c4b04c74a698509e25017e591a9 2023-02-09 20:54:19,676 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithWeeklyPolicy/e45b0667ca59a312bd230beb34d49fe9/.tmp/family1/54f08c4b04c74a698509e25017e591a9 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithWeeklyPolicy/e45b0667ca59a312bd230beb34d49fe9/family1/54f08c4b04c74a698509e25017e591a9 2023-02-09 20:54:19,681 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithWeeklyPolicy/e45b0667ca59a312bd230beb34d49fe9/family1/54f08c4b04c74a698509e25017e591a9, entries=1, sequenceid=33, filesize=4.9 K 2023-02-09 20:54:19,682 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e45b0667ca59a312bd230beb34d49fe9 in 831ms, sequenceid=33, compaction requested=true 2023-02-09 20:54:19,682 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for e45b0667ca59a312bd230beb34d49fe9: 2023-02-09 20:54:19,682 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1675976050709.e45b0667ca59a312bd230beb34d49fe9. 2023-02-09 20:54:19,682 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 20:54:19,682 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 20:54:19,682 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:19,682 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-02-09 20:54:19,682 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-02-09 20:54:19,685 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:19,685 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:19,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:19,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:54:19,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:54:19,686 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:19,686 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 20:54:19,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:54:19,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:54:19,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:19,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:19,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:54:19,687 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-02-09 20:54:19,687 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@10d37d17[Count = 0] remaining members to acquire global barrier 2023-02-09 20:54:19,687 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-09 20:54:19,687 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:19,688 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:19,688 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:19,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:19,688 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-09 20:54:19,689 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-02-09 20:54:19,689 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase9.apache.org,40919,1675976022294' in zk 2023-02-09 20:54:19,689 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:19,689 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 20:54:19,690 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-09 20:54:19,690 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:19,690 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:54:19,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:19,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:54:19,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:54:19,690 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-02-09 20:54:19,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:54:19,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:54:19,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:19,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:19,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:54:19,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:19,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:19,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase9.apache.org,40919,1675976022294': 2023-02-09 20:54:19,692 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-09 20:54:19,692 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-02-09 20:54:19,692 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 20:54:19,692 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 20:54:19,692 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:19,692 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 20:54:19,693 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:19,694 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:19,694 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:54:19,694 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:19,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:19,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:54:19,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:54:19,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:19,694 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:19,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:54:19,694 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:54:19,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:54:19,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:19,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:19,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:54:19,698 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:19,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:19,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:19,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:54:19,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:19,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:19,701 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:19,701 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:54:19,701 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-02-09 20:54:19,702 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 20:54:19,702 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:54:19,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:54:19,702 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:54:19,701 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:54:19,702 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-09 20:54:19,702 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:54:19,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:54:19,701 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:19,702 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 20:54:19,702 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-09 20:54:19,702 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:19,702 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:19,702 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:19,702 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:19,702 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:19,802 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 20:54:19,803 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 20:54:19,807 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(933): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-02-09 20:54:19,809 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-09 20:54:19,809 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:19,809 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-02-09 20:54:19,809 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:54:19,809 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-09 20:54:19,809 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-09 20:54:19,809 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:19,809 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:19,810 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:19,810 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:54:19,811 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:54:19,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:54:19,811 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:19,811 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 20:54:19,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:19,811 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:19,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 20:54:19,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:19,812 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:19,812 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-02-09 20:54:19,812 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:19,812 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-09 20:54:19,812 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:54:19,812 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-09 20:54:19,812 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 20:54:19,812 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 20:54:19,812 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1675976050709.e45b0667ca59a312bd230beb34d49fe9. 2023-02-09 20:54:19,812 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1675976050709.e45b0667ca59a312bd230beb34d49fe9. started... 2023-02-09 20:54:19,812 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing e45b0667ca59a312bd230beb34d49fe9 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-09 20:54:20,226 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201509074a5853091ea94c33aec8e0b9996b6903 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201509074a5853091ea94c33aec8e0b9996b6903 2023-02-09 20:54:20,231 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithWeeklyPolicy/e45b0667ca59a312bd230beb34d49fe9/.tmp/family1/fad07efddbbe41f8bcd23d6232b3d4ec 2023-02-09 20:54:20,237 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithWeeklyPolicy/e45b0667ca59a312bd230beb34d49fe9/.tmp/family1/fad07efddbbe41f8bcd23d6232b3d4ec as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithWeeklyPolicy/e45b0667ca59a312bd230beb34d49fe9/family1/fad07efddbbe41f8bcd23d6232b3d4ec 2023-02-09 20:54:20,242 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithWeeklyPolicy/e45b0667ca59a312bd230beb34d49fe9/family1/fad07efddbbe41f8bcd23d6232b3d4ec, entries=1, sequenceid=37, filesize=4.9 K 2023-02-09 20:54:20,243 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e45b0667ca59a312bd230beb34d49fe9 in 431ms, sequenceid=37, compaction requested=true 2023-02-09 20:54:20,243 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for e45b0667ca59a312bd230beb34d49fe9: 2023-02-09 20:54:20,243 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1675976050709.e45b0667ca59a312bd230beb34d49fe9. 2023-02-09 20:54:20,243 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 20:54:20,243 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 20:54:20,243 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:20,243 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-02-09 20:54:20,243 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-02-09 20:54:20,245 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:20,245 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:20,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:20,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:54:20,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:54:20,245 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:20,245 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 20:54:20,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:54:20,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:54:20,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:20,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:20,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:54:20,247 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-02-09 20:54:20,247 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7d257a00[Count = 0] remaining members to acquire global barrier 2023-02-09 20:54:20,247 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-09 20:54:20,247 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:20,252 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:20,252 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:20,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:20,252 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-09 20:54:20,252 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-02-09 20:54:20,252 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:20,252 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase9.apache.org,40919,1675976022294' in zk 2023-02-09 20:54:20,252 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 20:54:20,254 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-09 20:54:20,254 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:20,254 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:54:20,254 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-02-09 20:54:20,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:20,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:54:20,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:54:20,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:54:20,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:54:20,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:20,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:20,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:54:20,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:20,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:20,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase9.apache.org,40919,1675976022294': 2023-02-09 20:54:20,257 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-09 20:54:20,257 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-02-09 20:54:20,257 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 20:54:20,257 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 20:54:20,257 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:20,257 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 20:54:20,259 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:20,259 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:20,259 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:20,259 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:54:20,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:20,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:20,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:54:20,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:54:20,259 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:54:20,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:54:20,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:54:20,259 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:20,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:20,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:20,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:54:20,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:20,261 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:20,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:20,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:54:20,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:20,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:20,263 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:20,263 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:20,263 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:54:20,263 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:20,263 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:54:20,263 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-02-09 20:54:20,263 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 20:54:20,263 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:54:20,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:54:20,263 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:54:20,263 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:20,263 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:20,263 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:20,264 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:20,264 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-09 20:54:20,264 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:54:20,264 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 20:54:20,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:54:20,364 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 20:54:20,365 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 20:54:20,369 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(933): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-02-09 20:54:20,370 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-09 20:54:20,370 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:20,371 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-02-09 20:54:20,371 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:54:20,371 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-09 20:54:20,371 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-09 20:54:20,371 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:20,371 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:20,373 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:20,373 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:54:20,373 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:54:20,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:54:20,373 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:20,374 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 20:54:20,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:20,374 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:20,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 20:54:20,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:20,374 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:20,375 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-02-09 20:54:20,375 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:20,375 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-09 20:54:20,375 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:54:20,375 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-09 20:54:20,375 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 20:54:20,375 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 20:54:20,375 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1675976050709.e45b0667ca59a312bd230beb34d49fe9. 2023-02-09 20:54:20,375 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1675976050709.e45b0667ca59a312bd230beb34d49fe9. started... 2023-02-09 20:54:20,375 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing e45b0667ca59a312bd230beb34d49fe9 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-09 20:54:20,790 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511208d0ea03bfd2f458ba77ed2242bedf4ef to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201511208d0ea03bfd2f458ba77ed2242bedf4ef 2023-02-09 20:54:21,195 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithWeeklyPolicy/e45b0667ca59a312bd230beb34d49fe9/.tmp/family1/24657e7e85d4420aa8a81de9f30a93df 2023-02-09 20:54:21,201 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithWeeklyPolicy/e45b0667ca59a312bd230beb34d49fe9/.tmp/family1/24657e7e85d4420aa8a81de9f30a93df as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithWeeklyPolicy/e45b0667ca59a312bd230beb34d49fe9/family1/24657e7e85d4420aa8a81de9f30a93df 2023-02-09 20:54:21,206 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithWeeklyPolicy/e45b0667ca59a312bd230beb34d49fe9/family1/24657e7e85d4420aa8a81de9f30a93df, entries=1, sequenceid=41, filesize=4.9 K 2023-02-09 20:54:21,207 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for e45b0667ca59a312bd230beb34d49fe9 in 832ms, sequenceid=41, compaction requested=true 2023-02-09 20:54:21,207 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for e45b0667ca59a312bd230beb34d49fe9: 2023-02-09 20:54:21,207 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1675976050709.e45b0667ca59a312bd230beb34d49fe9. 2023-02-09 20:54:21,207 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 20:54:21,207 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 20:54:21,207 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:21,207 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-02-09 20:54:21,207 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-02-09 20:54:21,209 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:21,209 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:21,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:21,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:54:21,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:54:21,210 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:21,210 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 20:54:21,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:54:21,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:54:21,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:21,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:21,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:54:21,211 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-02-09 20:54:21,211 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@38a65f66[Count = 0] remaining members to acquire global barrier 2023-02-09 20:54:21,211 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-09 20:54:21,211 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:21,212 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:21,212 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:21,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:21,212 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-09 20:54:21,212 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-02-09 20:54:21,212 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase9.apache.org,40919,1675976022294' in zk 2023-02-09 20:54:21,212 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:21,212 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 20:54:21,214 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-09 20:54:21,214 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:21,214 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:54:21,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:21,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:54:21,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:54:21,214 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-02-09 20:54:21,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:54:21,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:54:21,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:21,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:21,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:54:21,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:21,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:21,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase9.apache.org,40919,1675976022294': 2023-02-09 20:54:21,216 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-09 20:54:21,216 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-02-09 20:54:21,216 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 20:54:21,217 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 20:54:21,217 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:21,217 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 20:54:21,219 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:21,219 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:21,219 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:21,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:21,219 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:54:21,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:21,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:54:21,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:54:21,219 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:54:21,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:54:21,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:54:21,220 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:21,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:21,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:21,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:54:21,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:21,221 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:21,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:21,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:54:21,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:21,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:21,223 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:21,223 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:21,223 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:54:21,223 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:21,223 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-09 20:54:21,223 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:21,223 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-02-09 20:54:21,223 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 20:54:21,223 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:54:21,223 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:54:21,223 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:54:21,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:54:21,223 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:21,223 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-09 20:54:21,224 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 20:54:21,223 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:21,224 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:54:21,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:54:21,224 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:21,324 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 20:54:21,325 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 20:54:21,326 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=42951] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMinorCompactionWithWeeklyPolicy 2023-02-09 20:54:21,328 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1675976025848] procedure2.ProcedureExecutor(1029): Stored pid=26, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-02-09 20:54:21,329 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=26, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-02-09 20:54:21,330 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1675976025848] mob.MobUtils(833): start MOB compaction of files for table='testMinorCompactionWithWeeklyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-09 20:54:21,330 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=26, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1675976661330 2023-02-09 20:54:21,331 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1675976025848] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-02-09 20:54:21,332 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1675976025848] compactions.PartitionedMobCompactor(306): The compaction type is PART_FILES, the request has 0 del files, 9 selected files, and 0 irrelevant files table 'testMinorCompactionWithWeeklyPolicy' and column 'family1' 2023-02-09 20:54:21,332 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1675976025848] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-02-09 20:54:21,332 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1675976025848] zookeeper.ReadOnlyZKClient(139): Connect 0x05939af8 to 127.0.0.1:62089 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 20:54:21,337 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1675976025848] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2fe3e215, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 20:54:21,337 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-02-09 20:54:22,192 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103b05916d36ff4440abc86a47bf65236d1 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160103b05916d36ff4440abc86a47bf65236d1 2023-02-09 20:54:22,193 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-02-09 20:54:22,205 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 20:54:22,206 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:45652, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 20:54:22,213 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-09 20:54:22,215 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:49822, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-09 20:54:22,223 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/c39f660f99d9403683a5d358d3e271fa first=Optional[r3] last=Optional[r6] 2023-02-09 20:54:22,224 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMinorCompactionWithWeeklyPolicy,,1675976050709.e45b0667ca59a312bd230beb34d49fe9., hostname=jenkins-hbase9.apache.org,40919,1675976022294, seqNum=2 for row with hfile group [{family1,hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/c39f660f99d9403683a5d358d3e271fa}] 2023-02-09 20:54:22,228 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HStore(763): Validating hfile at hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/c39f660f99d9403683a5d358d3e271fa for inclusion in e45b0667ca59a312bd230beb34d49fe9/family1 2023-02-09 20:54:22,231 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-02-09 20:54:22,232 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HStore(777): Region bounds: first= last= 2023-02-09 20:54:22,232 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HRegion(2445): Flush status journal for e45b0667ca59a312bd230beb34d49fe9: 2023-02-09 20:54:22,233 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/c39f660f99d9403683a5d358d3e271fa to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/staging/jenkins__testMinorCompactionWithWeeklyPolicy__8p4k1s0oa3kifb8pmvbkrg9kbrvg930uffaqtjucn9kts950ojvo59g32sl9qrbm/family1/c39f660f99d9403683a5d358d3e271fa 2023-02-09 20:54:22,236 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/staging/jenkins__testMinorCompactionWithWeeklyPolicy__8p4k1s0oa3kifb8pmvbkrg9kbrvg930uffaqtjucn9kts950ojvo59g32sl9qrbm/family1/c39f660f99d9403683a5d358d3e271fa as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithWeeklyPolicy/e45b0667ca59a312bd230beb34d49fe9/family1/3ef9c9400cfb4539a05c126e3bb26df7_SeqId_44_ 2023-02-09 20:54:22,236 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HStore(849): Loaded HFile hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/staging/jenkins__testMinorCompactionWithWeeklyPolicy__8p4k1s0oa3kifb8pmvbkrg9kbrvg930uffaqtjucn9kts950ojvo59g32sl9qrbm/family1/c39f660f99d9403683a5d358d3e271fa into e45b0667ca59a312bd230beb34d49fe9/family1 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithWeeklyPolicy/e45b0667ca59a312bd230beb34d49fe9/family1/3ef9c9400cfb4539a05c126e3bb26df7_SeqId_44_ - updating store file list. 2023-02-09 20:54:22,240 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HStore(882): Loaded HFile hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithWeeklyPolicy/e45b0667ca59a312bd230beb34d49fe9/family1/3ef9c9400cfb4539a05c126e3bb26df7_SeqId_44_ into e45b0667ca59a312bd230beb34d49fe9/family1 2023-02-09 20:54:22,240 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HStore(855): Successfully loaded hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/staging/jenkins__testMinorCompactionWithWeeklyPolicy__8p4k1s0oa3kifb8pmvbkrg9kbrvg930uffaqtjucn9kts950ojvo59g32sl9qrbm/family1/c39f660f99d9403683a5d358d3e271fa into e45b0667ca59a312bd230beb34d49fe9/family1 (new location: hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithWeeklyPolicy/e45b0667ca59a312bd230beb34d49fe9/family1/3ef9c9400cfb4539a05c126e3bb26df7_SeqId_44_) 2023-02-09 20:54:22,241 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/staging/jenkins__testMinorCompactionWithWeeklyPolicy__8p4k1s0oa3kifb8pmvbkrg9kbrvg930uffaqtjucn9kts950ojvo59g32sl9qrbm/family1/c39f660f99d9403683a5d358d3e271fa 2023-02-09 20:54:22,241 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-02-09 20:54:22,245 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51214 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-02-09 20:54:22,245 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HStore(1912): e45b0667ca59a312bd230beb34d49fe9/family1 is initiating minor compaction 2023-02-09 20:54:22,245 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@626651ec; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-09 20:54:22,245 INFO [RS:0;jenkins-hbase9:40919-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of e45b0667ca59a312bd230beb34d49fe9/family1 in testMinorCompactionWithWeeklyPolicy,,1675976050709.e45b0667ca59a312bd230beb34d49fe9. 2023-02-09 20:54:22,245 INFO [RS:0;jenkins-hbase9:40919-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithWeeklyPolicy/e45b0667ca59a312bd230beb34d49fe9/family1/3d95eba818654e499756a69dc684d975, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithWeeklyPolicy/e45b0667ca59a312bd230beb34d49fe9/family1/854197aa27b9430b8568679b28afa934, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithWeeklyPolicy/e45b0667ca59a312bd230beb34d49fe9/family1/acc0c413526548cca9a86dafec719595, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithWeeklyPolicy/e45b0667ca59a312bd230beb34d49fe9/family1/7039b4d8a0974bfb8e7f5ae9907cc7ad, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithWeeklyPolicy/e45b0667ca59a312bd230beb34d49fe9/family1/88359fcb83fe4651ac273459320cec57, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithWeeklyPolicy/e45b0667ca59a312bd230beb34d49fe9/family1/d107882eae9c4658b0f079045418f2e7, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithWeeklyPolicy/e45b0667ca59a312bd230beb34d49fe9/family1/54f08c4b04c74a698509e25017e591a9, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithWeeklyPolicy/e45b0667ca59a312bd230beb34d49fe9/family1/fad07efddbbe41f8bcd23d6232b3d4ec, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithWeeklyPolicy/e45b0667ca59a312bd230beb34d49fe9/family1/24657e7e85d4420aa8a81de9f30a93df, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithWeeklyPolicy/e45b0667ca59a312bd230beb34d49fe9/family1/3ef9c9400cfb4539a05c126e3bb26df7_SeqId_44_] into tmpdir=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithWeeklyPolicy/e45b0667ca59a312bd230beb34d49fe9/.tmp, totalSize=50.0 K 2023-02-09 20:54:22,245 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] compactions.Compactor(207): Compacting 3d95eba818654e499756a69dc684d975, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-02-09 20:54:22,245 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] compactions.Compactor(207): Compacting 854197aa27b9430b8568679b28afa934, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-02-09 20:54:22,246 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] compactions.Compactor(207): Compacting acc0c413526548cca9a86dafec719595, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-02-09 20:54:22,246 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] compactions.Compactor(207): Compacting 7039b4d8a0974bfb8e7f5ae9907cc7ad, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-02-09 20:54:22,246 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] compactions.Compactor(207): Compacting 88359fcb83fe4651ac273459320cec57, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-02-09 20:54:22,246 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] compactions.Compactor(207): Compacting d107882eae9c4658b0f079045418f2e7, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-02-09 20:54:22,246 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] compactions.Compactor(207): Compacting 54f08c4b04c74a698509e25017e591a9, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-02-09 20:54:22,246 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] compactions.Compactor(207): Compacting fad07efddbbe41f8bcd23d6232b3d4ec, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-02-09 20:54:22,246 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] compactions.Compactor(207): Compacting 24657e7e85d4420aa8a81de9f30a93df, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-02-09 20:54:22,246 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] compactions.Compactor(207): Compacting 3ef9c9400cfb4539a05c126e3bb26df7_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-02-09 20:54:22,247 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-02-09 20:54:22,248 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 20:54:22,250 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151228864300bb1c024ad8971536deff4323c8 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151228864300bb1c024ad8971536deff4323c8 2023-02-09 20:54:22,251 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151231c30c66572a2947d79c9759c557b0a376 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151231c30c66572a2947d79c9759c557b0a376 2023-02-09 20:54:22,252 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201601010c1c4408aafe49c5aa010a407024015f to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201601010c1c4408aafe49c5aa010a407024015f 2023-02-09 20:54:22,254 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201601036c3e86fa4017434cafc649077ace78a8 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201601036c3e86fa4017434cafc649077ace78a8 2023-02-09 20:54:22,254 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithWeeklyPolicy 4 expired mob files are deleted 2023-02-09 20:54:22,254 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-02-09 20:54:22,254 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-02-09 20:54:22,255 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-02-09 20:54:22,255 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-02-09 20:54:22,255 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-02-09 20:54:22,255 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-02-09 20:54:22,255 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-02-09 20:54:22,255 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-02-09 20:54:22,255 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-02-09 20:54:22,277 INFO [RS:0;jenkins-hbase9:40919-shortCompactions-0] throttle.PressureAwareThroughputController(145): e45b0667ca59a312bd230beb34d49fe9#family1#compaction#34 average throughput is 0.68 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-09 20:54:22,700 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512055fd33c3f87894c929a490ec13b438ec8 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512055fd33c3f87894c929a490ec13b438ec8 2023-02-09 20:54:22,701 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-02-09 20:54:22,736 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/3c2d0c04959c4ee2bfd177518ba66e22 first=Optional[r1] last=Optional[r2] 2023-02-09 20:54:22,737 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMinorCompactionWithWeeklyPolicy,,1675976050709.e45b0667ca59a312bd230beb34d49fe9., hostname=jenkins-hbase9.apache.org,40919,1675976022294, seqNum=2 for row with hfile group [{family1,hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/3c2d0c04959c4ee2bfd177518ba66e22}] 2023-02-09 20:54:22,740 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HStore(763): Validating hfile at hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/3c2d0c04959c4ee2bfd177518ba66e22 for inclusion in e45b0667ca59a312bd230beb34d49fe9/family1 2023-02-09 20:54:22,743 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HStore(775): HFile bounds: first=r1 last=r2 2023-02-09 20:54:22,743 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HStore(777): Region bounds: first= last= 2023-02-09 20:54:22,743 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HRegion(2445): Flush status journal for e45b0667ca59a312bd230beb34d49fe9: 2023-02-09 20:54:22,746 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/3c2d0c04959c4ee2bfd177518ba66e22 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/staging/jenkins__testMinorCompactionWithWeeklyPolicy__m1iu5ndfuhr0p4e6g4fj50mnua5ir3urg5ve9maorltphb0c2rhvs7r2bt4tmijk/family1/3c2d0c04959c4ee2bfd177518ba66e22 2023-02-09 20:54:22,748 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/staging/jenkins__testMinorCompactionWithWeeklyPolicy__m1iu5ndfuhr0p4e6g4fj50mnua5ir3urg5ve9maorltphb0c2rhvs7r2bt4tmijk/family1/3c2d0c04959c4ee2bfd177518ba66e22 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithWeeklyPolicy/e45b0667ca59a312bd230beb34d49fe9/family1/ad3a70ab20a64ae4924d413e78d1ba13_SeqId_46_ 2023-02-09 20:54:22,750 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HStore(849): Loaded HFile hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/staging/jenkins__testMinorCompactionWithWeeklyPolicy__m1iu5ndfuhr0p4e6g4fj50mnua5ir3urg5ve9maorltphb0c2rhvs7r2bt4tmijk/family1/3c2d0c04959c4ee2bfd177518ba66e22 into e45b0667ca59a312bd230beb34d49fe9/family1 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithWeeklyPolicy/e45b0667ca59a312bd230beb34d49fe9/family1/ad3a70ab20a64ae4924d413e78d1ba13_SeqId_46_ - updating store file list. 2023-02-09 20:54:22,755 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HStore(882): Loaded HFile hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithWeeklyPolicy/e45b0667ca59a312bd230beb34d49fe9/family1/ad3a70ab20a64ae4924d413e78d1ba13_SeqId_46_ into e45b0667ca59a312bd230beb34d49fe9/family1 2023-02-09 20:54:22,755 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HStore(855): Successfully loaded hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/staging/jenkins__testMinorCompactionWithWeeklyPolicy__m1iu5ndfuhr0p4e6g4fj50mnua5ir3urg5ve9maorltphb0c2rhvs7r2bt4tmijk/family1/3c2d0c04959c4ee2bfd177518ba66e22 into e45b0667ca59a312bd230beb34d49fe9/family1 (new location: hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithWeeklyPolicy/e45b0667ca59a312bd230beb34d49fe9/family1/ad3a70ab20a64ae4924d413e78d1ba13_SeqId_46_) 2023-02-09 20:54:22,756 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/staging/jenkins__testMinorCompactionWithWeeklyPolicy__m1iu5ndfuhr0p4e6g4fj50mnua5ir3urg5ve9maorltphb0c2rhvs7r2bt4tmijk/family1/3c2d0c04959c4ee2bfd177518ba66e22 2023-02-09 20:54:22,758 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-02-09 20:54:22,759 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 20:54:22,761 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015120169b8379d13fd414dad6059b4934b9e95 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015120169b8379d13fd414dad6059b4934b9e95 2023-02-09 20:54:22,762 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512051b511c6bf2dd47b6912be89981e78e0a to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512051b511c6bf2dd47b6912be89981e78e0a 2023-02-09 20:54:22,762 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithWeeklyPolicy 2 expired mob files are deleted 2023-02-09 20:54:22,762 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-02-09 20:54:22,763 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-02-09 20:54:22,763 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1675976025848] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-02-09 20:54:22,763 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1675976025848] mob.MobUtils(840): end MOB compaction of files for table='testMinorCompactionWithWeeklyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-09 20:54:22,764 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=26, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-02-09 20:54:22,766 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=26, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE in 1.4370 sec 2023-02-09 20:54:22,924 INFO [Listener at localhost/46855] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompactionWithWeeklyPolicy Thread=248 (was 262), OpenFileDescriptor=592 (was 617), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=235 (was 278), ProcessCount=168 (was 168), AvailableMemoryMB=10828 (was 11116) 2023-02-09 20:54:22,938 INFO [Listener at localhost/46855] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testScannerOnBulkLoadRefHFiles Thread=248, OpenFileDescriptor=592, MaxFileDescriptor=60000, SystemLoadAverage=235, ProcessCount=168, AvailableMemoryMB=10826 2023-02-09 20:54:22,941 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.HMaster$4(2102): Client=jenkins//172.31.2.10 create 'testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-02-09 20:54:22,942 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure2.ProcedureExecutor(1029): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles 2023-02-09 20:54:22,944 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_PRE_OPERATION 2023-02-09 20:54:22,944 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(697): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testScannerOnBulkLoadRefHFiles" procId is: 27 2023-02-09 20:54:22,945 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-09 20:54:22,945 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-02-09 20:54:22,947 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/.tmp/data/default/testScannerOnBulkLoadRefHFiles/c77a33661b401b5917147f4c5d4a93f8 2023-02-09 20:54:22,947 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/.tmp/data/default/testScannerOnBulkLoadRefHFiles/534ed4e0950fb6e77e8b28dd7e0eebb4 2023-02-09 20:54:22,947 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/.tmp/data/default/testScannerOnBulkLoadRefHFiles/8118d0623b8f6e97dbcdc1af278e0072 2023-02-09 20:54:22,948 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/.tmp/data/default/testScannerOnBulkLoadRefHFiles/534ed4e0950fb6e77e8b28dd7e0eebb4 empty. 2023-02-09 20:54:22,948 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/.tmp/data/default/testScannerOnBulkLoadRefHFiles/8118d0623b8f6e97dbcdc1af278e0072 empty. 2023-02-09 20:54:22,948 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/.tmp/data/default/testScannerOnBulkLoadRefHFiles/c77a33661b401b5917147f4c5d4a93f8 empty. 2023-02-09 20:54:22,948 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/.tmp/data/default/testScannerOnBulkLoadRefHFiles/534ed4e0950fb6e77e8b28dd7e0eebb4 2023-02-09 20:54:22,949 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/.tmp/data/default/testScannerOnBulkLoadRefHFiles/c77a33661b401b5917147f4c5d4a93f8 2023-02-09 20:54:22,949 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/.tmp/data/default/testScannerOnBulkLoadRefHFiles/8118d0623b8f6e97dbcdc1af278e0072 2023-02-09 20:54:22,949 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testScannerOnBulkLoadRefHFiles regions 2023-02-09 20:54:22,957 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/.tmp/data/default/testScannerOnBulkLoadRefHFiles/.tabledesc/.tableinfo.0000000001 2023-02-09 20:54:22,966 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(7671): creating {ENCODED => 534ed4e0950fb6e77e8b28dd7e0eebb4, NAME => 'testScannerOnBulkLoadRefHFiles,2,1675976062940.534ed4e0950fb6e77e8b28dd7e0eebb4.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/.tmp 2023-02-09 20:54:22,966 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(7671): creating {ENCODED => c77a33661b401b5917147f4c5d4a93f8, NAME => 'testScannerOnBulkLoadRefHFiles,,1675976062940.c77a33661b401b5917147f4c5d4a93f8.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/.tmp 2023-02-09 20:54:22,966 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(7671): creating {ENCODED => 8118d0623b8f6e97dbcdc1af278e0072, NAME => 'testScannerOnBulkLoadRefHFiles,1,1675976062940.8118d0623b8f6e97dbcdc1af278e0072.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/.tmp 2023-02-09 20:54:22,976 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(865): Instantiated testScannerOnBulkLoadRefHFiles,1,1675976062940.8118d0623b8f6e97dbcdc1af278e0072.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 20:54:22,977 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1603): Closing 8118d0623b8f6e97dbcdc1af278e0072, disabling compactions & flushes 2023-02-09 20:54:22,977 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1625): Closing region testScannerOnBulkLoadRefHFiles,1,1675976062940.8118d0623b8f6e97dbcdc1af278e0072. 2023-02-09 20:54:22,977 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,1,1675976062940.8118d0623b8f6e97dbcdc1af278e0072. 2023-02-09 20:54:22,977 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1713): Acquired close lock on testScannerOnBulkLoadRefHFiles,1,1675976062940.8118d0623b8f6e97dbcdc1af278e0072. after waiting 0 ms 2023-02-09 20:54:22,977 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1723): Updates disabled for region testScannerOnBulkLoadRefHFiles,1,1675976062940.8118d0623b8f6e97dbcdc1af278e0072. 2023-02-09 20:54:22,977 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1837): Closed testScannerOnBulkLoadRefHFiles,1,1675976062940.8118d0623b8f6e97dbcdc1af278e0072. 2023-02-09 20:54:22,977 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1557): Region close journal for 8118d0623b8f6e97dbcdc1af278e0072: Waiting for close lock at 1675976062977Disabling compacts and flushes for region at 1675976062977Disabling writes for close at 1675976062977Writing region close event to WAL at 1675976062977Closed at 1675976062977 2023-02-09 20:54:23,046 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-02-09 20:54:23,101 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithWeeklyPolicy/e45b0667ca59a312bd230beb34d49fe9/.tmp/family1/33c3cf1c3773421f9e53d7370bab2fef as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithWeeklyPolicy/e45b0667ca59a312bd230beb34d49fe9/family1/33c3cf1c3773421f9e53d7370bab2fef 2023-02-09 20:54:23,107 INFO [RS:0;jenkins-hbase9:40919-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in e45b0667ca59a312bd230beb34d49fe9/family1 of e45b0667ca59a312bd230beb34d49fe9 into 33c3cf1c3773421f9e53d7370bab2fef(size=6.6 K), total size for store is 176.8 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-09 20:54:23,107 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for e45b0667ca59a312bd230beb34d49fe9: 2023-02-09 20:54:23,107 INFO [RS:0;jenkins-hbase9:40919-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithWeeklyPolicy,,1675976050709.e45b0667ca59a312bd230beb34d49fe9., storeName=family1, fileCount=10, fileSize=50.0 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.5 K), priority=2, time=1675976062245; duration=0sec 2023-02-09 20:54:23,107 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-09 20:54:23,164 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithWeeklyPolicy/e45b0667ca59a312bd230beb34d49fe9/family1/3d95eba818654e499756a69dc684d975, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithWeeklyPolicy/e45b0667ca59a312bd230beb34d49fe9/family1/854197aa27b9430b8568679b28afa934, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithWeeklyPolicy/e45b0667ca59a312bd230beb34d49fe9/family1/acc0c413526548cca9a86dafec719595, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithWeeklyPolicy/e45b0667ca59a312bd230beb34d49fe9/family1/7039b4d8a0974bfb8e7f5ae9907cc7ad, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithWeeklyPolicy/e45b0667ca59a312bd230beb34d49fe9/family1/88359fcb83fe4651ac273459320cec57, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithWeeklyPolicy/e45b0667ca59a312bd230beb34d49fe9/family1/d107882eae9c4658b0f079045418f2e7, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithWeeklyPolicy/e45b0667ca59a312bd230beb34d49fe9/family1/54f08c4b04c74a698509e25017e591a9, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithWeeklyPolicy/e45b0667ca59a312bd230beb34d49fe9/family1/fad07efddbbe41f8bcd23d6232b3d4ec, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithWeeklyPolicy/e45b0667ca59a312bd230beb34d49fe9/family1/24657e7e85d4420aa8a81de9f30a93df, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithWeeklyPolicy/e45b0667ca59a312bd230beb34d49fe9/family1/3ef9c9400cfb4539a05c126e3bb26df7_SeqId_44_] to archive 2023-02-09 20:54:23,165 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 20:54:23,167 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithWeeklyPolicy/e45b0667ca59a312bd230beb34d49fe9/family1/3d95eba818654e499756a69dc684d975 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMinorCompactionWithWeeklyPolicy/e45b0667ca59a312bd230beb34d49fe9/family1/3d95eba818654e499756a69dc684d975 2023-02-09 20:54:23,169 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithWeeklyPolicy/e45b0667ca59a312bd230beb34d49fe9/family1/854197aa27b9430b8568679b28afa934 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMinorCompactionWithWeeklyPolicy/e45b0667ca59a312bd230beb34d49fe9/family1/854197aa27b9430b8568679b28afa934 2023-02-09 20:54:23,170 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithWeeklyPolicy/e45b0667ca59a312bd230beb34d49fe9/family1/acc0c413526548cca9a86dafec719595 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMinorCompactionWithWeeklyPolicy/e45b0667ca59a312bd230beb34d49fe9/family1/acc0c413526548cca9a86dafec719595 2023-02-09 20:54:23,171 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithWeeklyPolicy/e45b0667ca59a312bd230beb34d49fe9/family1/7039b4d8a0974bfb8e7f5ae9907cc7ad to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMinorCompactionWithWeeklyPolicy/e45b0667ca59a312bd230beb34d49fe9/family1/7039b4d8a0974bfb8e7f5ae9907cc7ad 2023-02-09 20:54:23,172 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithWeeklyPolicy/e45b0667ca59a312bd230beb34d49fe9/family1/88359fcb83fe4651ac273459320cec57 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMinorCompactionWithWeeklyPolicy/e45b0667ca59a312bd230beb34d49fe9/family1/88359fcb83fe4651ac273459320cec57 2023-02-09 20:54:23,173 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithWeeklyPolicy/e45b0667ca59a312bd230beb34d49fe9/family1/d107882eae9c4658b0f079045418f2e7 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMinorCompactionWithWeeklyPolicy/e45b0667ca59a312bd230beb34d49fe9/family1/d107882eae9c4658b0f079045418f2e7 2023-02-09 20:54:23,174 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithWeeklyPolicy/e45b0667ca59a312bd230beb34d49fe9/family1/54f08c4b04c74a698509e25017e591a9 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMinorCompactionWithWeeklyPolicy/e45b0667ca59a312bd230beb34d49fe9/family1/54f08c4b04c74a698509e25017e591a9 2023-02-09 20:54:23,176 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithWeeklyPolicy/e45b0667ca59a312bd230beb34d49fe9/family1/fad07efddbbe41f8bcd23d6232b3d4ec to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMinorCompactionWithWeeklyPolicy/e45b0667ca59a312bd230beb34d49fe9/family1/fad07efddbbe41f8bcd23d6232b3d4ec 2023-02-09 20:54:23,177 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithWeeklyPolicy/e45b0667ca59a312bd230beb34d49fe9/family1/24657e7e85d4420aa8a81de9f30a93df to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMinorCompactionWithWeeklyPolicy/e45b0667ca59a312bd230beb34d49fe9/family1/24657e7e85d4420aa8a81de9f30a93df 2023-02-09 20:54:23,179 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithWeeklyPolicy/e45b0667ca59a312bd230beb34d49fe9/family1/3ef9c9400cfb4539a05c126e3bb26df7_SeqId_44_ to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMinorCompactionWithWeeklyPolicy/e45b0667ca59a312bd230beb34d49fe9/family1/3ef9c9400cfb4539a05c126e3bb26df7_SeqId_44_ 2023-02-09 20:54:23,248 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-02-09 20:54:23,378 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(865): Instantiated testScannerOnBulkLoadRefHFiles,,1675976062940.c77a33661b401b5917147f4c5d4a93f8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 20:54:23,378 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1603): Closing c77a33661b401b5917147f4c5d4a93f8, disabling compactions & flushes 2023-02-09 20:54:23,378 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1625): Closing region testScannerOnBulkLoadRefHFiles,,1675976062940.c77a33661b401b5917147f4c5d4a93f8. 2023-02-09 20:54:23,378 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,,1675976062940.c77a33661b401b5917147f4c5d4a93f8. 2023-02-09 20:54:23,378 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1713): Acquired close lock on testScannerOnBulkLoadRefHFiles,,1675976062940.c77a33661b401b5917147f4c5d4a93f8. after waiting 0 ms 2023-02-09 20:54:23,378 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1723): Updates disabled for region testScannerOnBulkLoadRefHFiles,,1675976062940.c77a33661b401b5917147f4c5d4a93f8. 2023-02-09 20:54:23,378 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1837): Closed testScannerOnBulkLoadRefHFiles,,1675976062940.c77a33661b401b5917147f4c5d4a93f8. 2023-02-09 20:54:23,378 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(865): Instantiated testScannerOnBulkLoadRefHFiles,2,1675976062940.534ed4e0950fb6e77e8b28dd7e0eebb4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 20:54:23,378 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1557): Region close journal for c77a33661b401b5917147f4c5d4a93f8: Waiting for close lock at 1675976063378Disabling compacts and flushes for region at 1675976063378Disabling writes for close at 1675976063378Writing region close event to WAL at 1675976063378Closed at 1675976063378 2023-02-09 20:54:23,379 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1603): Closing 534ed4e0950fb6e77e8b28dd7e0eebb4, disabling compactions & flushes 2023-02-09 20:54:23,379 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1625): Closing region testScannerOnBulkLoadRefHFiles,2,1675976062940.534ed4e0950fb6e77e8b28dd7e0eebb4. 2023-02-09 20:54:23,379 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,2,1675976062940.534ed4e0950fb6e77e8b28dd7e0eebb4. 2023-02-09 20:54:23,379 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1713): Acquired close lock on testScannerOnBulkLoadRefHFiles,2,1675976062940.534ed4e0950fb6e77e8b28dd7e0eebb4. after waiting 0 ms 2023-02-09 20:54:23,379 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1723): Updates disabled for region testScannerOnBulkLoadRefHFiles,2,1675976062940.534ed4e0950fb6e77e8b28dd7e0eebb4. 2023-02-09 20:54:23,379 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1837): Closed testScannerOnBulkLoadRefHFiles,2,1675976062940.534ed4e0950fb6e77e8b28dd7e0eebb4. 2023-02-09 20:54:23,379 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1557): Region close journal for 534ed4e0950fb6e77e8b28dd7e0eebb4: Waiting for close lock at 1675976063379Disabling compacts and flushes for region at 1675976063379Disabling writes for close at 1675976063379Writing region close event to WAL at 1675976063379Closed at 1675976063379 2023-02-09 20:54:23,381 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_ADD_TO_META 2023-02-09 20:54:23,382 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,1,1675976062940.8118d0623b8f6e97dbcdc1af278e0072.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1675976063382"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675976063382"}]},"ts":"1675976063382"} 2023-02-09 20:54:23,382 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,,1675976062940.c77a33661b401b5917147f4c5d4a93f8.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1675976063382"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675976063382"}]},"ts":"1675976063382"} 2023-02-09 20:54:23,382 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,2,1675976062940.534ed4e0950fb6e77e8b28dd7e0eebb4.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1675976063382"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675976063382"}]},"ts":"1675976063382"} 2023-02-09 20:54:23,385 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-02-09 20:54:23,386 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-09 20:54:23,386 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testScannerOnBulkLoadRefHFiles","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675976063386"}]},"ts":"1675976063386"} 2023-02-09 20:54:23,387 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testScannerOnBulkLoadRefHFiles, state=ENABLING in hbase:meta 2023-02-09 20:54:23,391 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=c77a33661b401b5917147f4c5d4a93f8, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=8118d0623b8f6e97dbcdc1af278e0072, ASSIGN}, {pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=534ed4e0950fb6e77e8b28dd7e0eebb4, ASSIGN}] 2023-02-09 20:54:23,393 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=534ed4e0950fb6e77e8b28dd7e0eebb4, ASSIGN 2023-02-09 20:54:23,393 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=c77a33661b401b5917147f4c5d4a93f8, ASSIGN 2023-02-09 20:54:23,393 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=8118d0623b8f6e97dbcdc1af278e0072, ASSIGN 2023-02-09 20:54:23,393 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=534ed4e0950fb6e77e8b28dd7e0eebb4, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,40919,1675976022294; forceNewPlan=false, retain=false 2023-02-09 20:54:23,394 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=c77a33661b401b5917147f4c5d4a93f8, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,40919,1675976022294; forceNewPlan=false, retain=false 2023-02-09 20:54:23,394 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=8118d0623b8f6e97dbcdc1af278e0072, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,40919,1675976022294; forceNewPlan=false, retain=false 2023-02-09 20:54:23,545 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=8118d0623b8f6e97dbcdc1af278e0072, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:23,545 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=c77a33661b401b5917147f4c5d4a93f8, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:23,545 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=30 updating hbase:meta row=534ed4e0950fb6e77e8b28dd7e0eebb4, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:23,545 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,1,1675976062940.8118d0623b8f6e97dbcdc1af278e0072.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1675976063545"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675976063545"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675976063545"}]},"ts":"1675976063545"} 2023-02-09 20:54:23,545 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,,1675976062940.c77a33661b401b5917147f4c5d4a93f8.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1675976063545"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675976063545"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675976063545"}]},"ts":"1675976063545"} 2023-02-09 20:54:23,545 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,2,1675976062940.534ed4e0950fb6e77e8b28dd7e0eebb4.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1675976063545"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675976063545"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675976063545"}]},"ts":"1675976063545"} 2023-02-09 20:54:23,547 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=31, ppid=29, state=RUNNABLE; OpenRegionProcedure 8118d0623b8f6e97dbcdc1af278e0072, server=jenkins-hbase9.apache.org,40919,1675976022294}] 2023-02-09 20:54:23,548 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=32, ppid=28, state=RUNNABLE; OpenRegionProcedure c77a33661b401b5917147f4c5d4a93f8, server=jenkins-hbase9.apache.org,40919,1675976022294}] 2023-02-09 20:54:23,549 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-02-09 20:54:23,549 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=33, ppid=30, state=RUNNABLE; OpenRegionProcedure 534ed4e0950fb6e77e8b28dd7e0eebb4, server=jenkins-hbase9.apache.org,40919,1675976022294}] 2023-02-09 20:54:23,703 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open testScannerOnBulkLoadRefHFiles,1,1675976062940.8118d0623b8f6e97dbcdc1af278e0072. 2023-02-09 20:54:23,703 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 8118d0623b8f6e97dbcdc1af278e0072, NAME => 'testScannerOnBulkLoadRefHFiles,1,1675976062940.8118d0623b8f6e97dbcdc1af278e0072.', STARTKEY => '1', ENDKEY => '2'} 2023-02-09 20:54:23,703 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles 8118d0623b8f6e97dbcdc1af278e0072 2023-02-09 20:54:23,703 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated testScannerOnBulkLoadRefHFiles,1,1675976062940.8118d0623b8f6e97dbcdc1af278e0072.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 20:54:23,704 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for 8118d0623b8f6e97dbcdc1af278e0072 2023-02-09 20:54:23,704 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for 8118d0623b8f6e97dbcdc1af278e0072 2023-02-09 20:54:23,705 INFO [StoreOpener-8118d0623b8f6e97dbcdc1af278e0072-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 8118d0623b8f6e97dbcdc1af278e0072 2023-02-09 20:54:23,706 DEBUG [StoreOpener-8118d0623b8f6e97dbcdc1af278e0072-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testScannerOnBulkLoadRefHFiles/8118d0623b8f6e97dbcdc1af278e0072/family1 2023-02-09 20:54:23,706 DEBUG [StoreOpener-8118d0623b8f6e97dbcdc1af278e0072-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testScannerOnBulkLoadRefHFiles/8118d0623b8f6e97dbcdc1af278e0072/family1 2023-02-09 20:54:23,707 INFO [StoreOpener-8118d0623b8f6e97dbcdc1af278e0072-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8118d0623b8f6e97dbcdc1af278e0072 columnFamilyName family1 2023-02-09 20:54:23,709 INFO [StoreOpener-8118d0623b8f6e97dbcdc1af278e0072-1] regionserver.HStore(310): Store=8118d0623b8f6e97dbcdc1af278e0072/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 20:54:23,709 INFO [StoreOpener-8118d0623b8f6e97dbcdc1af278e0072-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 8118d0623b8f6e97dbcdc1af278e0072 2023-02-09 20:54:23,710 DEBUG [StoreOpener-8118d0623b8f6e97dbcdc1af278e0072-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testScannerOnBulkLoadRefHFiles/8118d0623b8f6e97dbcdc1af278e0072/family2 2023-02-09 20:54:23,710 DEBUG [StoreOpener-8118d0623b8f6e97dbcdc1af278e0072-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testScannerOnBulkLoadRefHFiles/8118d0623b8f6e97dbcdc1af278e0072/family2 2023-02-09 20:54:23,711 INFO [StoreOpener-8118d0623b8f6e97dbcdc1af278e0072-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8118d0623b8f6e97dbcdc1af278e0072 columnFamilyName family2 2023-02-09 20:54:23,712 INFO [StoreOpener-8118d0623b8f6e97dbcdc1af278e0072-1] regionserver.HStore(310): Store=8118d0623b8f6e97dbcdc1af278e0072/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 20:54:23,713 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testScannerOnBulkLoadRefHFiles/8118d0623b8f6e97dbcdc1af278e0072 2023-02-09 20:54:23,713 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testScannerOnBulkLoadRefHFiles/8118d0623b8f6e97dbcdc1af278e0072 2023-02-09 20:54:23,715 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 20:54:23,716 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for 8118d0623b8f6e97dbcdc1af278e0072 2023-02-09 20:54:23,717 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testScannerOnBulkLoadRefHFiles/8118d0623b8f6e97dbcdc1af278e0072/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 20:54:23,718 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened 8118d0623b8f6e97dbcdc1af278e0072; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66083994, jitterRate=-0.015271753072738647}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 20:54:23,718 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for 8118d0623b8f6e97dbcdc1af278e0072: Running coprocessor pre-open hook at 1675976063704Writing region info on filesystem at 1675976063704Initializing all the Stores at 1675976063704Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675976063705 (+1 ms)Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675976063705Cleaning up temporary data from old regions at 1675976063714 (+9 ms)Cleaning up detritus from prior splits at 1675976063714Running coprocessor post-open hooks at 1675976063718 (+4 ms)Region opened successfully at 1675976063718 2023-02-09 20:54:23,719 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,1,1675976062940.8118d0623b8f6e97dbcdc1af278e0072., pid=31, masterSystemTime=1675976063699 2023-02-09 20:54:23,721 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,1,1675976062940.8118d0623b8f6e97dbcdc1af278e0072. 2023-02-09 20:54:23,721 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened testScannerOnBulkLoadRefHFiles,1,1675976062940.8118d0623b8f6e97dbcdc1af278e0072. 2023-02-09 20:54:23,721 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open testScannerOnBulkLoadRefHFiles,,1675976062940.c77a33661b401b5917147f4c5d4a93f8. 2023-02-09 20:54:23,721 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => c77a33661b401b5917147f4c5d4a93f8, NAME => 'testScannerOnBulkLoadRefHFiles,,1675976062940.c77a33661b401b5917147f4c5d4a93f8.', STARTKEY => '', ENDKEY => '1'} 2023-02-09 20:54:23,721 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles c77a33661b401b5917147f4c5d4a93f8 2023-02-09 20:54:23,721 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=8118d0623b8f6e97dbcdc1af278e0072, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:23,722 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated testScannerOnBulkLoadRefHFiles,,1675976062940.c77a33661b401b5917147f4c5d4a93f8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 20:54:23,722 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,1,1675976062940.8118d0623b8f6e97dbcdc1af278e0072.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1675976063721"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675976063721"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675976063721"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675976063721"}]},"ts":"1675976063721"} 2023-02-09 20:54:23,722 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for c77a33661b401b5917147f4c5d4a93f8 2023-02-09 20:54:23,722 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for c77a33661b401b5917147f4c5d4a93f8 2023-02-09 20:54:23,723 INFO [StoreOpener-c77a33661b401b5917147f4c5d4a93f8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region c77a33661b401b5917147f4c5d4a93f8 2023-02-09 20:54:23,725 DEBUG [StoreOpener-c77a33661b401b5917147f4c5d4a93f8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testScannerOnBulkLoadRefHFiles/c77a33661b401b5917147f4c5d4a93f8/family1 2023-02-09 20:54:23,725 DEBUG [StoreOpener-c77a33661b401b5917147f4c5d4a93f8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testScannerOnBulkLoadRefHFiles/c77a33661b401b5917147f4c5d4a93f8/family1 2023-02-09 20:54:23,725 INFO [StoreOpener-c77a33661b401b5917147f4c5d4a93f8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c77a33661b401b5917147f4c5d4a93f8 columnFamilyName family1 2023-02-09 20:54:23,725 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=31, resume processing ppid=29 2023-02-09 20:54:23,726 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=31, ppid=29, state=SUCCESS; OpenRegionProcedure 8118d0623b8f6e97dbcdc1af278e0072, server=jenkins-hbase9.apache.org,40919,1675976022294 in 176 msec 2023-02-09 20:54:23,726 INFO [StoreOpener-c77a33661b401b5917147f4c5d4a93f8-1] regionserver.HStore(310): Store=c77a33661b401b5917147f4c5d4a93f8/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 20:54:23,727 INFO [StoreOpener-c77a33661b401b5917147f4c5d4a93f8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region c77a33661b401b5917147f4c5d4a93f8 2023-02-09 20:54:23,727 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=8118d0623b8f6e97dbcdc1af278e0072, ASSIGN in 335 msec 2023-02-09 20:54:23,729 DEBUG [StoreOpener-c77a33661b401b5917147f4c5d4a93f8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testScannerOnBulkLoadRefHFiles/c77a33661b401b5917147f4c5d4a93f8/family2 2023-02-09 20:54:23,729 DEBUG [StoreOpener-c77a33661b401b5917147f4c5d4a93f8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testScannerOnBulkLoadRefHFiles/c77a33661b401b5917147f4c5d4a93f8/family2 2023-02-09 20:54:23,729 INFO [StoreOpener-c77a33661b401b5917147f4c5d4a93f8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c77a33661b401b5917147f4c5d4a93f8 columnFamilyName family2 2023-02-09 20:54:23,730 INFO [StoreOpener-c77a33661b401b5917147f4c5d4a93f8-1] regionserver.HStore(310): Store=c77a33661b401b5917147f4c5d4a93f8/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 20:54:23,731 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testScannerOnBulkLoadRefHFiles/c77a33661b401b5917147f4c5d4a93f8 2023-02-09 20:54:23,732 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testScannerOnBulkLoadRefHFiles/c77a33661b401b5917147f4c5d4a93f8 2023-02-09 20:54:23,734 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 20:54:23,735 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for c77a33661b401b5917147f4c5d4a93f8 2023-02-09 20:54:23,737 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testScannerOnBulkLoadRefHFiles/c77a33661b401b5917147f4c5d4a93f8/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 20:54:23,738 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened c77a33661b401b5917147f4c5d4a93f8; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74624179, jitterRate=0.1119869202375412}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 20:54:23,738 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for c77a33661b401b5917147f4c5d4a93f8: Running coprocessor pre-open hook at 1675976063722Writing region info on filesystem at 1675976063722Initializing all the Stores at 1675976063723 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675976063723Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675976063723Cleaning up temporary data from old regions at 1675976063732 (+9 ms)Cleaning up detritus from prior splits at 1675976063733 (+1 ms)Running coprocessor post-open hooks at 1675976063738 (+5 ms)Region opened successfully at 1675976063738 2023-02-09 20:54:23,739 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,,1675976062940.c77a33661b401b5917147f4c5d4a93f8., pid=32, masterSystemTime=1675976063699 2023-02-09 20:54:23,741 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,,1675976062940.c77a33661b401b5917147f4c5d4a93f8. 2023-02-09 20:54:23,741 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened testScannerOnBulkLoadRefHFiles,,1675976062940.c77a33661b401b5917147f4c5d4a93f8. 2023-02-09 20:54:23,741 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open testScannerOnBulkLoadRefHFiles,2,1675976062940.534ed4e0950fb6e77e8b28dd7e0eebb4. 2023-02-09 20:54:23,741 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 534ed4e0950fb6e77e8b28dd7e0eebb4, NAME => 'testScannerOnBulkLoadRefHFiles,2,1675976062940.534ed4e0950fb6e77e8b28dd7e0eebb4.', STARTKEY => '2', ENDKEY => ''} 2023-02-09 20:54:23,741 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles 534ed4e0950fb6e77e8b28dd7e0eebb4 2023-02-09 20:54:23,741 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=c77a33661b401b5917147f4c5d4a93f8, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:23,741 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated testScannerOnBulkLoadRefHFiles,2,1675976062940.534ed4e0950fb6e77e8b28dd7e0eebb4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 20:54:23,742 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for 534ed4e0950fb6e77e8b28dd7e0eebb4 2023-02-09 20:54:23,742 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for 534ed4e0950fb6e77e8b28dd7e0eebb4 2023-02-09 20:54:23,742 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,,1675976062940.c77a33661b401b5917147f4c5d4a93f8.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1675976063741"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675976063741"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675976063741"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675976063741"}]},"ts":"1675976063741"} 2023-02-09 20:54:23,744 INFO [StoreOpener-534ed4e0950fb6e77e8b28dd7e0eebb4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 534ed4e0950fb6e77e8b28dd7e0eebb4 2023-02-09 20:54:23,746 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=32, resume processing ppid=28 2023-02-09 20:54:23,746 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=32, ppid=28, state=SUCCESS; OpenRegionProcedure c77a33661b401b5917147f4c5d4a93f8, server=jenkins-hbase9.apache.org,40919,1675976022294 in 196 msec 2023-02-09 20:54:23,746 DEBUG [StoreOpener-534ed4e0950fb6e77e8b28dd7e0eebb4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testScannerOnBulkLoadRefHFiles/534ed4e0950fb6e77e8b28dd7e0eebb4/family1 2023-02-09 20:54:23,747 DEBUG [StoreOpener-534ed4e0950fb6e77e8b28dd7e0eebb4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testScannerOnBulkLoadRefHFiles/534ed4e0950fb6e77e8b28dd7e0eebb4/family1 2023-02-09 20:54:23,747 INFO [StoreOpener-534ed4e0950fb6e77e8b28dd7e0eebb4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 534ed4e0950fb6e77e8b28dd7e0eebb4 columnFamilyName family1 2023-02-09 20:54:23,748 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=c77a33661b401b5917147f4c5d4a93f8, ASSIGN in 355 msec 2023-02-09 20:54:23,752 INFO [StoreOpener-534ed4e0950fb6e77e8b28dd7e0eebb4-1] regionserver.HStore(310): Store=534ed4e0950fb6e77e8b28dd7e0eebb4/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 20:54:23,753 INFO [StoreOpener-534ed4e0950fb6e77e8b28dd7e0eebb4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 534ed4e0950fb6e77e8b28dd7e0eebb4 2023-02-09 20:54:23,755 DEBUG [StoreOpener-534ed4e0950fb6e77e8b28dd7e0eebb4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testScannerOnBulkLoadRefHFiles/534ed4e0950fb6e77e8b28dd7e0eebb4/family2 2023-02-09 20:54:23,755 DEBUG [StoreOpener-534ed4e0950fb6e77e8b28dd7e0eebb4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testScannerOnBulkLoadRefHFiles/534ed4e0950fb6e77e8b28dd7e0eebb4/family2 2023-02-09 20:54:23,755 INFO [StoreOpener-534ed4e0950fb6e77e8b28dd7e0eebb4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 534ed4e0950fb6e77e8b28dd7e0eebb4 columnFamilyName family2 2023-02-09 20:54:23,756 INFO [StoreOpener-534ed4e0950fb6e77e8b28dd7e0eebb4-1] regionserver.HStore(310): Store=534ed4e0950fb6e77e8b28dd7e0eebb4/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 20:54:23,758 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testScannerOnBulkLoadRefHFiles/534ed4e0950fb6e77e8b28dd7e0eebb4 2023-02-09 20:54:23,758 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testScannerOnBulkLoadRefHFiles/534ed4e0950fb6e77e8b28dd7e0eebb4 2023-02-09 20:54:23,761 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 20:54:23,762 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for 534ed4e0950fb6e77e8b28dd7e0eebb4 2023-02-09 20:54:23,765 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testScannerOnBulkLoadRefHFiles/534ed4e0950fb6e77e8b28dd7e0eebb4/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 20:54:23,765 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened 534ed4e0950fb6e77e8b28dd7e0eebb4; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73509038, jitterRate=0.09537002444267273}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 20:54:23,765 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for 534ed4e0950fb6e77e8b28dd7e0eebb4: Running coprocessor pre-open hook at 1675976063742Writing region info on filesystem at 1675976063742Initializing all the Stores at 1675976063744 (+2 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675976063744Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675976063744Cleaning up temporary data from old regions at 1675976063759 (+15 ms)Cleaning up detritus from prior splits at 1675976063760 (+1 ms)Running coprocessor post-open hooks at 1675976063765 (+5 ms)Region opened successfully at 1675976063765 2023-02-09 20:54:23,766 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,2,1675976062940.534ed4e0950fb6e77e8b28dd7e0eebb4., pid=33, masterSystemTime=1675976063699 2023-02-09 20:54:23,768 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,2,1675976062940.534ed4e0950fb6e77e8b28dd7e0eebb4. 2023-02-09 20:54:23,768 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened testScannerOnBulkLoadRefHFiles,2,1675976062940.534ed4e0950fb6e77e8b28dd7e0eebb4. 2023-02-09 20:54:23,769 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=30 updating hbase:meta row=534ed4e0950fb6e77e8b28dd7e0eebb4, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:23,769 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,2,1675976062940.534ed4e0950fb6e77e8b28dd7e0eebb4.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1675976063769"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675976063769"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675976063769"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675976063769"}]},"ts":"1675976063769"} 2023-02-09 20:54:23,773 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=33, resume processing ppid=30 2023-02-09 20:54:23,773 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=33, ppid=30, state=SUCCESS; OpenRegionProcedure 534ed4e0950fb6e77e8b28dd7e0eebb4, server=jenkins-hbase9.apache.org,40919,1675976022294 in 221 msec 2023-02-09 20:54:23,775 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=27 2023-02-09 20:54:23,776 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=534ed4e0950fb6e77e8b28dd7e0eebb4, ASSIGN in 382 msec 2023-02-09 20:54:23,776 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-09 20:54:23,776 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testScannerOnBulkLoadRefHFiles","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675976063776"}]},"ts":"1675976063776"} 2023-02-09 20:54:23,778 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testScannerOnBulkLoadRefHFiles, state=ENABLED in hbase:meta 2023-02-09 20:54:23,780 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_POST_OPERATION 2023-02-09 20:54:23,781 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles in 839 msec 2023-02-09 20:54:24,050 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-02-09 20:54:24,050 INFO [Listener at localhost/46855] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testScannerOnBulkLoadRefHFiles, procId: 27 completed 2023-02-09 20:54:24,057 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(933): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-02-09 20:54:24,058 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure.ProcedureCoordinator(165): Submitting procedure testScannerOnBulkLoadRefHFiles 2023-02-09 20:54:24,058 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testScannerOnBulkLoadRefHFiles' 2023-02-09 20:54:24,058 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:54:24,058 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' 2023-02-09 20:54:24,058 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testScannerOnBulkLoadRefHFiles', kicking off acquire phase on members. 2023-02-09 20:54:24,059 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-09 20:54:24,059 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-02-09 20:54:24,060 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:24,060 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:54:24,060 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:54:24,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:54:24,060 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:24,060 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 20:54:24,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-02-09 20:54:24,061 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-09 20:54:24,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 20:54:24,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-02-09 20:54:24,061 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testScannerOnBulkLoadRefHFiles 2023-02-09 20:54:24,061 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testScannerOnBulkLoadRefHFiles 2023-02-09 20:54:24,061 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testScannerOnBulkLoadRefHFiles' with timeout 60000ms 2023-02-09 20:54:24,062 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:54:24,062 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' stage 2023-02-09 20:54:24,062 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,,1675976062940.c77a33661b401b5917147f4c5d4a93f8. 2023-02-09 20:54:24,062 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,,1675976062940.c77a33661b401b5917147f4c5d4a93f8. started... 2023-02-09 20:54:24,062 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,2,1675976062940.534ed4e0950fb6e77e8b28dd7e0eebb4. 2023-02-09 20:54:24,062 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-09 20:54:24,063 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 20:54:24,063 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,1,1675976062940.8118d0623b8f6e97dbcdc1af278e0072. 2023-02-09 20:54:24,063 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,1,1675976062940.8118d0623b8f6e97dbcdc1af278e0072. started... 2023-02-09 20:54:24,063 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for c77a33661b401b5917147f4c5d4a93f8: 2023-02-09 20:54:24,063 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,2,1675976062940.534ed4e0950fb6e77e8b28dd7e0eebb4. started... 2023-02-09 20:54:24,063 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 8118d0623b8f6e97dbcdc1af278e0072: 2023-02-09 20:54:24,063 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,,1675976062940.c77a33661b401b5917147f4c5d4a93f8. 2023-02-09 20:54:24,064 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 534ed4e0950fb6e77e8b28dd7e0eebb4 2/2 column families, dataSize=48 B heapSize=632 B 2023-02-09 20:54:24,064 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,1,1675976062940.8118d0623b8f6e97dbcdc1af278e0072. 2023-02-09 20:54:24,064 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-09 20:54:24,064 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-09 20:54:24,480 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230209ff4cda5909ea4df3818b45a124938de4 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20230209ff4cda5909ea4df3818b45a124938de4 2023-02-09 20:54:24,886 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=48, hasBloomFilter=true, into tmp file hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testScannerOnBulkLoadRefHFiles/534ed4e0950fb6e77e8b28dd7e0eebb4/.tmp/family1/bfa76c1384934bf2a37eb2b634d71381 2023-02-09 20:54:24,891 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testScannerOnBulkLoadRefHFiles/534ed4e0950fb6e77e8b28dd7e0eebb4/.tmp/family1/bfa76c1384934bf2a37eb2b634d71381 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testScannerOnBulkLoadRefHFiles/534ed4e0950fb6e77e8b28dd7e0eebb4/family1/bfa76c1384934bf2a37eb2b634d71381 2023-02-09 20:54:24,897 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testScannerOnBulkLoadRefHFiles/534ed4e0950fb6e77e8b28dd7e0eebb4/family1/bfa76c1384934bf2a37eb2b634d71381, entries=1, sequenceid=5, filesize=4.9 K 2023-02-09 20:54:24,898 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~48 B/48, heapSize ~360 B/360, currentSize=0 B/0 for 534ed4e0950fb6e77e8b28dd7e0eebb4 in 834ms, sequenceid=5, compaction requested=false 2023-02-09 20:54:24,898 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testScannerOnBulkLoadRefHFiles' 2023-02-09 20:54:24,899 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 534ed4e0950fb6e77e8b28dd7e0eebb4: 2023-02-09 20:54:24,899 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,2,1675976062940.534ed4e0950fb6e77e8b28dd7e0eebb4. 2023-02-09 20:54:24,899 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-09 20:54:24,899 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-09 20:54:24,899 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:24,899 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally acquired 2023-02-09 20:54:24,899 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure (testScannerOnBulkLoadRefHFiles) in zk 2023-02-09 20:54:24,901 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-09 20:54:24,901 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:24,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:24,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:54:24,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:54:24,901 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-09 20:54:24,901 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testScannerOnBulkLoadRefHFiles' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 20:54:24,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:54:24,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:54:24,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-09 20:54:24,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:24,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:54:24,902 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure 'testScannerOnBulkLoadRefHFiles' on coordinator 2023-02-09 20:54:24,902 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@516261d3[Count = 0] remaining members to acquire global barrier 2023-02-09 20:54:24,902 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'in-barrier' execution. 2023-02-09 20:54:24,903 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-09 20:54:24,904 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-09 20:54:24,904 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-09 20:54:24,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-09 20:54:24,904 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testScannerOnBulkLoadRefHFiles' received 'reached' from coordinator. 2023-02-09 20:54:24,904 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:24,904 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 20:54:24,904 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally completed 2023-02-09 20:54:24,904 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testScannerOnBulkLoadRefHFiles' completed for member 'jenkins-hbase9.apache.org,40919,1675976022294' in zk 2023-02-09 20:54:24,906 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:24,906 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testScannerOnBulkLoadRefHFiles' has notified controller of completion 2023-02-09 20:54:24,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:24,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:54:24,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:54:24,906 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:54:24,906 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testScannerOnBulkLoadRefHFiles' completed. 2023-02-09 20:54:24,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:54:24,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:54:24,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-09 20:54:24,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:24,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:54:24,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-09 20:54:24,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:24,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testScannerOnBulkLoadRefHFiles' member 'jenkins-hbase9.apache.org,40919,1675976022294': 2023-02-09 20:54:24,909 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' released barrier for procedure'testScannerOnBulkLoadRefHFiles', counting down latch. Waiting for 0 more 2023-02-09 20:54:24,909 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testScannerOnBulkLoadRefHFiles' execution completed 2023-02-09 20:54:24,909 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 20:54:24,909 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 20:54:24,909 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testScannerOnBulkLoadRefHFiles 2023-02-09 20:54:24,909 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testScannerOnBulkLoadRefHFilesincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 20:54:24,910 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-09 20:54:24,910 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-09 20:54:24,911 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-09 20:54:24,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-09 20:54:24,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:54:24,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:54:24,911 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:54:24,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-09 20:54:24,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:54:24,911 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:54:24,911 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:24,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:54:24,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-09 20:54:24,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-09 20:54:24,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:54:24,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-09 20:54:24,912 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:24,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:24,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:54:24,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-09 20:54:24,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:24,918 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:24,918 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-02-09 20:54:24,918 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-02-09 20:54:24,918 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:54:24,918 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:54:24,918 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:24,918 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles because node does not exist (not an error) 2023-02-09 20:54:24,918 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testScannerOnBulkLoadRefHFiles' 2023-02-09 20:54:24,918 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 20:54:24,918 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:54:24,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:54:24,918 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:54:24,918 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-09 20:54:24,919 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-09 20:54:24,919 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-09 20:54:24,919 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testScannerOnBulkLoadRefHFiles'' to complete. (max 300000 ms per retry) 2023-02-09 20:54:24,919 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:54:24,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:54:24,919 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 20:54:25,019 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 20:54:25,020 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 20:54:25,025 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(933): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-02-09 20:54:25,027 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure.ProcedureCoordinator(143): Procedure testScannerOnBulkLoadRefHFiles was in running list but was completed. Accepting new attempt. 2023-02-09 20:54:25,027 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure.ProcedureCoordinator(165): Submitting procedure testScannerOnBulkLoadRefHFiles 2023-02-09 20:54:25,027 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testScannerOnBulkLoadRefHFiles' 2023-02-09 20:54:25,028 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:54:25,028 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' 2023-02-09 20:54:25,028 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testScannerOnBulkLoadRefHFiles', kicking off acquire phase on members. 2023-02-09 20:54:25,028 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-09 20:54:25,028 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-02-09 20:54:25,029 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:54:25,029 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:25,029 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:54:25,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:54:25,030 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:25,030 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 20:54:25,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-02-09 20:54:25,030 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-09 20:54:25,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 20:54:25,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-02-09 20:54:25,031 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testScannerOnBulkLoadRefHFiles 2023-02-09 20:54:25,031 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testScannerOnBulkLoadRefHFiles is still present, removing 2023-02-09 20:54:25,031 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testScannerOnBulkLoadRefHFiles 2023-02-09 20:54:25,031 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testScannerOnBulkLoadRefHFiles' with timeout 60000ms 2023-02-09 20:54:25,031 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:54:25,031 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' stage 2023-02-09 20:54:25,031 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,,1675976062940.c77a33661b401b5917147f4c5d4a93f8. 2023-02-09 20:54:25,031 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,2,1675976062940.534ed4e0950fb6e77e8b28dd7e0eebb4. 2023-02-09 20:54:25,031 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,,1675976062940.c77a33661b401b5917147f4c5d4a93f8. started... 2023-02-09 20:54:25,031 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-09 20:54:25,032 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 20:54:25,031 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,2,1675976062940.534ed4e0950fb6e77e8b28dd7e0eebb4. started... 2023-02-09 20:54:25,031 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,1,1675976062940.8118d0623b8f6e97dbcdc1af278e0072. 2023-02-09 20:54:25,032 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 534ed4e0950fb6e77e8b28dd7e0eebb4 2/2 column families, dataSize=90 B heapSize=752 B 2023-02-09 20:54:25,032 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for c77a33661b401b5917147f4c5d4a93f8: 2023-02-09 20:54:25,032 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,1,1675976062940.8118d0623b8f6e97dbcdc1af278e0072. started... 2023-02-09 20:54:25,032 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,,1675976062940.c77a33661b401b5917147f4c5d4a93f8. 2023-02-09 20:54:25,032 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-09 20:54:25,032 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 8118d0623b8f6e97dbcdc1af278e0072: 2023-02-09 20:54:25,032 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,1,1675976062940.8118d0623b8f6e97dbcdc1af278e0072. 2023-02-09 20:54:25,032 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-09 20:54:25,446 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230209fe012b4d7e2f4b9aa2a7466f2b314632 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20230209fe012b4d7e2f4b9aa2a7466f2b314632 2023-02-09 20:54:25,852 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=90, hasBloomFilter=true, into tmp file hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testScannerOnBulkLoadRefHFiles/534ed4e0950fb6e77e8b28dd7e0eebb4/.tmp/family1/4fcfb1bd4a7244b780e07e78b1e7413b 2023-02-09 20:54:25,857 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testScannerOnBulkLoadRefHFiles/534ed4e0950fb6e77e8b28dd7e0eebb4/.tmp/family1/4fcfb1bd4a7244b780e07e78b1e7413b as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testScannerOnBulkLoadRefHFiles/534ed4e0950fb6e77e8b28dd7e0eebb4/family1/4fcfb1bd4a7244b780e07e78b1e7413b 2023-02-09 20:54:25,861 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testScannerOnBulkLoadRefHFiles/534ed4e0950fb6e77e8b28dd7e0eebb4/family1/4fcfb1bd4a7244b780e07e78b1e7413b, entries=2, sequenceid=9, filesize=5.0 K 2023-02-09 20:54:25,862 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~90 B/90, heapSize ~480 B/480, currentSize=0 B/0 for 534ed4e0950fb6e77e8b28dd7e0eebb4 in 830ms, sequenceid=9, compaction requested=false 2023-02-09 20:54:25,862 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 534ed4e0950fb6e77e8b28dd7e0eebb4: 2023-02-09 20:54:25,862 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,2,1675976062940.534ed4e0950fb6e77e8b28dd7e0eebb4. 2023-02-09 20:54:25,862 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-09 20:54:25,862 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-09 20:54:25,862 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:25,862 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally acquired 2023-02-09 20:54:25,862 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure (testScannerOnBulkLoadRefHFiles) in zk 2023-02-09 20:54:25,864 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:25,864 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-09 20:54:25,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:25,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:54:25,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:54:25,865 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-09 20:54:25,865 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testScannerOnBulkLoadRefHFiles' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 20:54:25,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:54:25,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:54:25,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-09 20:54:25,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:25,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:54:25,866 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure 'testScannerOnBulkLoadRefHFiles' on coordinator 2023-02-09 20:54:25,866 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5a52952d[Count = 0] remaining members to acquire global barrier 2023-02-09 20:54:25,866 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'in-barrier' execution. 2023-02-09 20:54:25,866 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-09 20:54:25,867 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-09 20:54:25,867 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-09 20:54:25,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-09 20:54:25,868 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testScannerOnBulkLoadRefHFiles' received 'reached' from coordinator. 2023-02-09 20:54:25,868 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally completed 2023-02-09 20:54:25,868 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testScannerOnBulkLoadRefHFiles' completed for member 'jenkins-hbase9.apache.org,40919,1675976022294' in zk 2023-02-09 20:54:25,868 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:25,868 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 20:54:25,870 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:25,870 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testScannerOnBulkLoadRefHFiles' has notified controller of completion 2023-02-09 20:54:25,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:25,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:54:25,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:54:25,870 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:54:25,870 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testScannerOnBulkLoadRefHFiles' completed. 2023-02-09 20:54:25,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:54:25,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:54:25,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-09 20:54:25,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:25,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:54:25,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-09 20:54:25,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:25,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testScannerOnBulkLoadRefHFiles' member 'jenkins-hbase9.apache.org,40919,1675976022294': 2023-02-09 20:54:25,874 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' released barrier for procedure'testScannerOnBulkLoadRefHFiles', counting down latch. Waiting for 0 more 2023-02-09 20:54:25,874 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testScannerOnBulkLoadRefHFiles' execution completed 2023-02-09 20:54:25,874 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 20:54:25,874 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 20:54:25,874 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testScannerOnBulkLoadRefHFiles 2023-02-09 20:54:25,874 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testScannerOnBulkLoadRefHFilesincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 20:54:25,876 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-09 20:54:25,876 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:54:25,876 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-09 20:54:25,876 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-09 20:54:25,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-09 20:54:25,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:54:25,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:54:25,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-09 20:54:25,877 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:54:25,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:54:25,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:54:25,877 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:25,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-09 20:54:25,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-09 20:54:25,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:54:25,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-09 20:54:25,878 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:25,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:25,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:54:25,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-09 20:54:25,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:25,881 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:25,881 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-02-09 20:54:25,881 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:54:25,881 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-02-09 20:54:25,881 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:54:25,881 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles because node does not exist (not an error) 2023-02-09 20:54:25,881 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:25,881 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:54:25,881 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:54:25,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:54:25,881 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-09 20:54:25,881 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-09 20:54:25,881 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-09 20:54:25,882 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:54:25,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:54:25,882 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testScannerOnBulkLoadRefHFiles' 2023-02-09 20:54:25,882 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 20:54:25,882 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testScannerOnBulkLoadRefHFiles'' to complete. (max 300000 ms per retry) 2023-02-09 20:54:25,882 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 20:54:25,983 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 20:54:25,984 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 20:54:25,991 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=42951] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testScannerOnBulkLoadRefHFiles 2023-02-09 20:54:25,992 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1675976025848] procedure2.ProcedureExecutor(1029): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-02-09 20:54:25,993 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-02-09 20:54:25,994 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1675976025848] mob.MobUtils(833): start MOB compaction of files for table='testScannerOnBulkLoadRefHFiles', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-09 20:54:25,994 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1675976665994 2023-02-09 20:54:25,994 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1675976025848] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-09 20:54:25,995 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1675976025848] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 2 selected files, and 0 irrelevant files table 'testScannerOnBulkLoadRefHFiles' and column 'family1' 2023-02-09 20:54:25,995 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1675976025848] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-02-09 20:54:25,995 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1675976025848] zookeeper.ReadOnlyZKClient(139): Connect 0x50622d61 to 127.0.0.1:62089 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 20:54:25,999 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1675976025848] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@60218e32, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 20:54:25,999 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20230209 for table='testScannerOnBulkLoadRefHFiles' and column='family1' 2023-02-09 20:54:26,826 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302090ad12d1ce8c8446cbdf8fae354d05080 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c202302090ad12d1ce8c8446cbdf8fae354d05080 2023-02-09 20:54:26,827 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230209 table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-02-09 20:54:26,841 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 20:54:26,842 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:45660, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 20:54:26,850 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-09 20:54:26,852 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:49830, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-09 20:54:26,862 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20230209/family1/1a84013c81f944e4b4632ae02d575c4e first=Optional[k0] last=Optional[k1] 2023-02-09 20:54:26,863 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testScannerOnBulkLoadRefHFiles,2,1675976062940.534ed4e0950fb6e77e8b28dd7e0eebb4., hostname=jenkins-hbase9.apache.org,40919,1675976022294, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20230209/family1/1a84013c81f944e4b4632ae02d575c4e}] 2023-02-09 20:54:26,868 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HStore(763): Validating hfile at hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20230209/family1/1a84013c81f944e4b4632ae02d575c4e for inclusion in 534ed4e0950fb6e77e8b28dd7e0eebb4/family1 2023-02-09 20:54:26,870 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HStore(775): HFile bounds: first=k0 last=k1 2023-02-09 20:54:26,870 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HStore(777): Region bounds: first=2 last= 2023-02-09 20:54:26,871 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HRegion(2445): Flush status journal for 534ed4e0950fb6e77e8b28dd7e0eebb4: 2023-02-09 20:54:26,872 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20230209/family1/1a84013c81f944e4b4632ae02d575c4e to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/staging/jenkins__testScannerOnBulkLoadRefHFiles__erf1gd6c66e9i0s1e386oc9uucfq5hd2vpug6k1ma70v0s3arau5fu9pdf5umbfe/family1/1a84013c81f944e4b4632ae02d575c4e 2023-02-09 20:54:26,874 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/staging/jenkins__testScannerOnBulkLoadRefHFiles__erf1gd6c66e9i0s1e386oc9uucfq5hd2vpug6k1ma70v0s3arau5fu9pdf5umbfe/family1/1a84013c81f944e4b4632ae02d575c4e as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testScannerOnBulkLoadRefHFiles/534ed4e0950fb6e77e8b28dd7e0eebb4/family1/a30aed2b198e4f22b7f1372d9f083d4e_SeqId_12_ 2023-02-09 20:54:26,875 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HStore(849): Loaded HFile hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/staging/jenkins__testScannerOnBulkLoadRefHFiles__erf1gd6c66e9i0s1e386oc9uucfq5hd2vpug6k1ma70v0s3arau5fu9pdf5umbfe/family1/1a84013c81f944e4b4632ae02d575c4e into 534ed4e0950fb6e77e8b28dd7e0eebb4/family1 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testScannerOnBulkLoadRefHFiles/534ed4e0950fb6e77e8b28dd7e0eebb4/family1/a30aed2b198e4f22b7f1372d9f083d4e_SeqId_12_ - updating store file list. 2023-02-09 20:54:26,879 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HStore(882): Loaded HFile hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testScannerOnBulkLoadRefHFiles/534ed4e0950fb6e77e8b28dd7e0eebb4/family1/a30aed2b198e4f22b7f1372d9f083d4e_SeqId_12_ into 534ed4e0950fb6e77e8b28dd7e0eebb4/family1 2023-02-09 20:54:26,879 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HStore(855): Successfully loaded hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/staging/jenkins__testScannerOnBulkLoadRefHFiles__erf1gd6c66e9i0s1e386oc9uucfq5hd2vpug6k1ma70v0s3arau5fu9pdf5umbfe/family1/1a84013c81f944e4b4632ae02d575c4e into 534ed4e0950fb6e77e8b28dd7e0eebb4/family1 (new location: hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testScannerOnBulkLoadRefHFiles/534ed4e0950fb6e77e8b28dd7e0eebb4/family1/a30aed2b198e4f22b7f1372d9f083d4e_SeqId_12_) 2023-02-09 20:54:26,880 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/staging/jenkins__testScannerOnBulkLoadRefHFiles__erf1gd6c66e9i0s1e386oc9uucfq5hd2vpug6k1ma70v0s3arau5fu9pdf5umbfe/family1/1a84013c81f944e4b4632ae02d575c4e 2023-02-09 20:54:26,880 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-02-09 20:54:26,881 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 15445 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-02-09 20:54:26,881 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HStore(1912): 534ed4e0950fb6e77e8b28dd7e0eebb4/family1 is initiating minor compaction (all files) 2023-02-09 20:54:26,881 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@1232d40f; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-09 20:54:26,881 INFO [RS:0;jenkins-hbase9:40919-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 534ed4e0950fb6e77e8b28dd7e0eebb4/family1 in testScannerOnBulkLoadRefHFiles,2,1675976062940.534ed4e0950fb6e77e8b28dd7e0eebb4. 2023-02-09 20:54:26,881 INFO [RS:0;jenkins-hbase9:40919-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testScannerOnBulkLoadRefHFiles/534ed4e0950fb6e77e8b28dd7e0eebb4/family1/bfa76c1384934bf2a37eb2b634d71381, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testScannerOnBulkLoadRefHFiles/534ed4e0950fb6e77e8b28dd7e0eebb4/family1/4fcfb1bd4a7244b780e07e78b1e7413b, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testScannerOnBulkLoadRefHFiles/534ed4e0950fb6e77e8b28dd7e0eebb4/family1/a30aed2b198e4f22b7f1372d9f083d4e_SeqId_12_] into tmpdir=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testScannerOnBulkLoadRefHFiles/534ed4e0950fb6e77e8b28dd7e0eebb4/.tmp, totalSize=15.1 K 2023-02-09 20:54:26,882 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] compactions.Compactor(207): Compacting bfa76c1384934bf2a37eb2b634d71381, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1675976064050 2023-02-09 20:54:26,883 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] compactions.Compactor(207): Compacting 4fcfb1bd4a7244b780e07e78b1e7413b, keycount=2, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1675976064050 2023-02-09 20:54:26,883 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230209 table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-02-09 20:54:26,883 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] compactions.Compactor(207): Compacting a30aed2b198e4f22b7f1372d9f083d4e_SeqId_12_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1675976064050 2023-02-09 20:54:26,884 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 20:54:26,886 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20230209fe012b4d7e2f4b9aa2a7466f2b314632 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20230209fe012b4d7e2f4b9aa2a7466f2b314632 2023-02-09 20:54:26,888 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20230209ff4cda5909ea4df3818b45a124938de4 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20230209ff4cda5909ea4df3818b45a124938de4 2023-02-09 20:54:26,888 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testScannerOnBulkLoadRefHFiles 2 expired mob files are deleted 2023-02-09 20:54:26,888 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20230209' 2023-02-09 20:54:26,889 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20230209 for table='testScannerOnBulkLoadRefHFiles' and column='family1' 2023-02-09 20:54:26,889 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1675976025848] compactions.PartitionedMobCompactor(354): After compaction, there are 1 mob files. table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-02-09 20:54:26,889 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1675976025848] mob.MobUtils(840): end MOB compaction of files for table='testScannerOnBulkLoadRefHFiles', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-09 20:54:26,890 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-02-09 20:54:26,892 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE in 899 msec 2023-02-09 20:54:26,895 INFO [RS:0;jenkins-hbase9:40919-shortCompactions-0] throttle.PressureAwareThroughputController(145): 534ed4e0950fb6e77e8b28dd7e0eebb4#family1#compaction#37 average throughput is 0.05 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-09 20:54:26,922 INFO [Listener at localhost/46855] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testScannerOnBulkLoadRefHFiles Thread=253 (was 248) - Thread LEAK? -, OpenFileDescriptor=594 (was 592) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=216 (was 235), ProcessCount=168 (was 168), AvailableMemoryMB=10816 (was 10826) 2023-02-09 20:54:26,935 INFO [Listener at localhost/46855] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyPolicy Thread=252, OpenFileDescriptor=594, MaxFileDescriptor=60000, SystemLoadAverage=216, ProcessCount=168, AvailableMemoryMB=10815 2023-02-09 20:54:26,938 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.HMaster$4(2102): Client=jenkins//172.31.2.10 create 'testMajorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-02-09 20:54:26,940 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure2.ProcedureExecutor(1029): Stored pid=35, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:26,941 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-02-09 20:54:26,942 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(697): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyPolicy" procId is: 35 2023-02-09 20:54:26,942 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-09 20:54:26,943 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-02-09 20:54:26,944 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/8d52c5e30d26c0f1140cf795dd05ef4f 2023-02-09 20:54:26,945 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/8d52c5e30d26c0f1140cf795dd05ef4f empty. 2023-02-09 20:54:26,945 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/8d52c5e30d26c0f1140cf795dd05ef4f 2023-02-09 20:54:26,945 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyPolicy regions 2023-02-09 20:54:27,044 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-02-09 20:54:27,245 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-02-09 20:54:27,356 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/.tabledesc/.tableinfo.0000000001 2023-02-09 20:54:27,357 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(7671): creating {ENCODED => 8d52c5e30d26c0f1140cf795dd05ef4f, NAME => 'testMajorCompactionWithWeeklyPolicy,,1675976066938.8d52c5e30d26c0f1140cf795dd05ef4f.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/.tmp 2023-02-09 20:54:27,546 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-02-09 20:54:27,763 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyPolicy,,1675976066938.8d52c5e30d26c0f1140cf795dd05ef4f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 20:54:27,763 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1603): Closing 8d52c5e30d26c0f1140cf795dd05ef4f, disabling compactions & flushes 2023-02-09 20:54:27,764 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyPolicy,,1675976066938.8d52c5e30d26c0f1140cf795dd05ef4f. 2023-02-09 20:54:27,764 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyPolicy,,1675976066938.8d52c5e30d26c0f1140cf795dd05ef4f. 2023-02-09 20:54:27,764 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyPolicy,,1675976066938.8d52c5e30d26c0f1140cf795dd05ef4f. after waiting 0 ms 2023-02-09 20:54:27,764 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyPolicy,,1675976066938.8d52c5e30d26c0f1140cf795dd05ef4f. 2023-02-09 20:54:27,764 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyPolicy,,1675976066938.8d52c5e30d26c0f1140cf795dd05ef4f. 2023-02-09 20:54:27,764 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1557): Region close journal for 8d52c5e30d26c0f1140cf795dd05ef4f: Waiting for close lock at 1675976067763Disabling compacts and flushes for region at 1675976067763Disabling writes for close at 1675976067764 (+1 ms)Writing region close event to WAL at 1675976067764Closed at 1675976067764 2023-02-09 20:54:27,766 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-02-09 20:54:27,767 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyPolicy,,1675976066938.8d52c5e30d26c0f1140cf795dd05ef4f.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1675976067767"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675976067767"}]},"ts":"1675976067767"} 2023-02-09 20:54:27,768 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-09 20:54:27,769 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-09 20:54:27,769 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675976067769"}]},"ts":"1675976067769"} 2023-02-09 20:54:27,770 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyPolicy, state=ENABLING in hbase:meta 2023-02-09 20:54:27,774 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=8d52c5e30d26c0f1140cf795dd05ef4f, ASSIGN}] 2023-02-09 20:54:27,775 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=8d52c5e30d26c0f1140cf795dd05ef4f, ASSIGN 2023-02-09 20:54:27,776 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=8d52c5e30d26c0f1140cf795dd05ef4f, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,40919,1675976022294; forceNewPlan=false, retain=false 2023-02-09 20:54:27,927 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=8d52c5e30d26c0f1140cf795dd05ef4f, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:27,927 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyPolicy,,1675976066938.8d52c5e30d26c0f1140cf795dd05ef4f.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1675976067927"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675976067927"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675976067927"}]},"ts":"1675976067927"} 2023-02-09 20:54:27,929 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE; OpenRegionProcedure 8d52c5e30d26c0f1140cf795dd05ef4f, server=jenkins-hbase9.apache.org,40919,1675976022294}] 2023-02-09 20:54:28,048 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-02-09 20:54:28,083 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyPolicy,,1675976066938.8d52c5e30d26c0f1140cf795dd05ef4f. 2023-02-09 20:54:28,083 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 8d52c5e30d26c0f1140cf795dd05ef4f, NAME => 'testMajorCompactionWithWeeklyPolicy,,1675976066938.8d52c5e30d26c0f1140cf795dd05ef4f.', STARTKEY => '', ENDKEY => ''} 2023-02-09 20:54:28,083 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyPolicy 8d52c5e30d26c0f1140cf795dd05ef4f 2023-02-09 20:54:28,083 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyPolicy,,1675976066938.8d52c5e30d26c0f1140cf795dd05ef4f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 20:54:28,083 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for 8d52c5e30d26c0f1140cf795dd05ef4f 2023-02-09 20:54:28,084 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for 8d52c5e30d26c0f1140cf795dd05ef4f 2023-02-09 20:54:28,087 INFO [StoreOpener-8d52c5e30d26c0f1140cf795dd05ef4f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 8d52c5e30d26c0f1140cf795dd05ef4f 2023-02-09 20:54:28,088 DEBUG [StoreOpener-8d52c5e30d26c0f1140cf795dd05ef4f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyPolicy/8d52c5e30d26c0f1140cf795dd05ef4f/family1 2023-02-09 20:54:28,088 DEBUG [StoreOpener-8d52c5e30d26c0f1140cf795dd05ef4f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyPolicy/8d52c5e30d26c0f1140cf795dd05ef4f/family1 2023-02-09 20:54:28,089 INFO [StoreOpener-8d52c5e30d26c0f1140cf795dd05ef4f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8d52c5e30d26c0f1140cf795dd05ef4f columnFamilyName family1 2023-02-09 20:54:28,090 INFO [StoreOpener-8d52c5e30d26c0f1140cf795dd05ef4f-1] regionserver.HStore(310): Store=8d52c5e30d26c0f1140cf795dd05ef4f/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 20:54:28,091 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyPolicy/8d52c5e30d26c0f1140cf795dd05ef4f 2023-02-09 20:54:28,092 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyPolicy/8d52c5e30d26c0f1140cf795dd05ef4f 2023-02-09 20:54:28,094 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for 8d52c5e30d26c0f1140cf795dd05ef4f 2023-02-09 20:54:28,099 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyPolicy/8d52c5e30d26c0f1140cf795dd05ef4f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 20:54:28,100 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened 8d52c5e30d26c0f1140cf795dd05ef4f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62077298, jitterRate=-0.07497617602348328}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-09 20:54:28,100 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for 8d52c5e30d26c0f1140cf795dd05ef4f: Running coprocessor pre-open hook at 1675976068084Writing region info on filesystem at 1675976068084Initializing all the Stores at 1675976068084Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} at 1675976068084Cleaning up temporary data from old regions at 1675976068092 (+8 ms)Cleaning up detritus from prior splits at 1675976068092Running coprocessor post-open hooks at 1675976068100 (+8 ms)Region opened successfully at 1675976068100 2023-02-09 20:54:28,101 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyPolicy,,1675976066938.8d52c5e30d26c0f1140cf795dd05ef4f., pid=37, masterSystemTime=1675976068080 2023-02-09 20:54:28,102 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyPolicy,,1675976066938.8d52c5e30d26c0f1140cf795dd05ef4f. 2023-02-09 20:54:28,102 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyPolicy,,1675976066938.8d52c5e30d26c0f1140cf795dd05ef4f. 2023-02-09 20:54:28,103 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=8d52c5e30d26c0f1140cf795dd05ef4f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:28,103 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyPolicy,,1675976066938.8d52c5e30d26c0f1140cf795dd05ef4f.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1675976068103"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675976068103"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675976068103"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675976068103"}]},"ts":"1675976068103"} 2023-02-09 20:54:28,107 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=37, resume processing ppid=36 2023-02-09 20:54:28,107 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=36, state=SUCCESS; OpenRegionProcedure 8d52c5e30d26c0f1140cf795dd05ef4f, server=jenkins-hbase9.apache.org,40919,1675976022294 in 177 msec 2023-02-09 20:54:28,109 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=36, resume processing ppid=35 2023-02-09 20:54:28,110 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=36, ppid=35, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=8d52c5e30d26c0f1140cf795dd05ef4f, ASSIGN in 333 msec 2023-02-09 20:54:28,110 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-09 20:54:28,110 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675976068110"}]},"ts":"1675976068110"} 2023-02-09 20:54:28,112 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyPolicy, state=ENABLED in hbase:meta 2023-02-09 20:54:28,114 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-02-09 20:54:28,117 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=35, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy in 1.1770 sec 2023-02-09 20:54:28,121 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testScannerOnBulkLoadRefHFiles/534ed4e0950fb6e77e8b28dd7e0eebb4/.tmp/family1/38572174e6964cc7822d84dd8cb3f4bc as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testScannerOnBulkLoadRefHFiles/534ed4e0950fb6e77e8b28dd7e0eebb4/family1/38572174e6964cc7822d84dd8cb3f4bc 2023-02-09 20:54:28,129 INFO [RS:0;jenkins-hbase9:40919-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 534ed4e0950fb6e77e8b28dd7e0eebb4/family1 of 534ed4e0950fb6e77e8b28dd7e0eebb4 into 38572174e6964cc7822d84dd8cb3f4bc(size=5.1 K), total size for store is 5.1 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-09 20:54:28,129 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 534ed4e0950fb6e77e8b28dd7e0eebb4: 2023-02-09 20:54:28,129 INFO [RS:0;jenkins-hbase9:40919-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testScannerOnBulkLoadRefHFiles,2,1675976062940.534ed4e0950fb6e77e8b28dd7e0eebb4., storeName=family1, fileCount=3, fileSize=15.1 K (4.9 K, 5.0 K, 5.2 K), priority=2, time=1675976066881; duration=1sec 2023-02-09 20:54:28,129 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-09 20:54:28,156 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testScannerOnBulkLoadRefHFiles/534ed4e0950fb6e77e8b28dd7e0eebb4/family1/bfa76c1384934bf2a37eb2b634d71381, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testScannerOnBulkLoadRefHFiles/534ed4e0950fb6e77e8b28dd7e0eebb4/family1/4fcfb1bd4a7244b780e07e78b1e7413b, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testScannerOnBulkLoadRefHFiles/534ed4e0950fb6e77e8b28dd7e0eebb4/family1/a30aed2b198e4f22b7f1372d9f083d4e_SeqId_12_] to archive 2023-02-09 20:54:28,157 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 20:54:28,161 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testScannerOnBulkLoadRefHFiles/534ed4e0950fb6e77e8b28dd7e0eebb4/family1/bfa76c1384934bf2a37eb2b634d71381 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testScannerOnBulkLoadRefHFiles/534ed4e0950fb6e77e8b28dd7e0eebb4/family1/bfa76c1384934bf2a37eb2b634d71381 2023-02-09 20:54:28,163 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testScannerOnBulkLoadRefHFiles/534ed4e0950fb6e77e8b28dd7e0eebb4/family1/4fcfb1bd4a7244b780e07e78b1e7413b to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testScannerOnBulkLoadRefHFiles/534ed4e0950fb6e77e8b28dd7e0eebb4/family1/4fcfb1bd4a7244b780e07e78b1e7413b 2023-02-09 20:54:28,165 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testScannerOnBulkLoadRefHFiles/534ed4e0950fb6e77e8b28dd7e0eebb4/family1/a30aed2b198e4f22b7f1372d9f083d4e_SeqId_12_ to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testScannerOnBulkLoadRefHFiles/534ed4e0950fb6e77e8b28dd7e0eebb4/family1/a30aed2b198e4f22b7f1372d9f083d4e_SeqId_12_ 2023-02-09 20:54:29,049 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-02-09 20:54:29,049 INFO [Listener at localhost/46855] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyPolicy, procId: 35 completed 2023-02-09 20:54:29,070 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(933): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-02-09 20:54:29,071 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:29,072 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-02-09 20:54:29,072 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:54:29,072 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-09 20:54:29,072 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-09 20:54:29,072 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:29,072 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:29,073 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:29,073 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:54:29,073 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:54:29,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:54:29,074 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:29,074 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 20:54:29,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:29,074 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:29,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 20:54:29,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:29,074 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:29,075 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:29,075 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-09 20:54:29,075 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:54:29,075 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-09 20:54:29,075 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 20:54:29,075 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 20:54:29,075 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1675976066938.8d52c5e30d26c0f1140cf795dd05ef4f. 2023-02-09 20:54:29,075 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1675976066938.8d52c5e30d26c0f1140cf795dd05ef4f. started... 2023-02-09 20:54:29,076 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 8d52c5e30d26c0f1140cf795dd05ef4f 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-02-09 20:54:29,097 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130f7bef9ee90c540a096c6321adf0d4976 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151130f7bef9ee90c540a096c6321adf0d4976 2023-02-09 20:54:29,229 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-09 20:54:29,501 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyPolicy/8d52c5e30d26c0f1140cf795dd05ef4f/.tmp/family1/7ff47eb8f752441298d1bf648b5c4086 2023-02-09 20:54:29,506 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyPolicy/8d52c5e30d26c0f1140cf795dd05ef4f/.tmp/family1/7ff47eb8f752441298d1bf648b5c4086 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyPolicy/8d52c5e30d26c0f1140cf795dd05ef4f/family1/7ff47eb8f752441298d1bf648b5c4086 2023-02-09 20:54:29,511 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyPolicy/8d52c5e30d26c0f1140cf795dd05ef4f/family1/7ff47eb8f752441298d1bf648b5c4086, entries=1000, sequenceid=5, filesize=165.1 K 2023-02-09 20:54:29,512 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 8d52c5e30d26c0f1140cf795dd05ef4f in 435ms, sequenceid=5, compaction requested=false 2023-02-09 20:54:29,512 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyPolicy' 2023-02-09 20:54:29,512 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 8d52c5e30d26c0f1140cf795dd05ef4f: 2023-02-09 20:54:29,512 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1675976066938.8d52c5e30d26c0f1140cf795dd05ef4f. 2023-02-09 20:54:29,512 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 20:54:29,512 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 20:54:29,512 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:29,512 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-02-09 20:54:29,512 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-02-09 20:54:29,514 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:29,514 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:29,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:29,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:54:29,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:54:29,515 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:29,515 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 20:54:29,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:54:29,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:54:29,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:29,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:29,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:54:29,516 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-02-09 20:54:29,516 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@c71111d[Count = 0] remaining members to acquire global barrier 2023-02-09 20:54:29,516 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-09 20:54:29,516 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:29,517 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:29,517 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:29,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:29,517 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-09 20:54:29,517 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-02-09 20:54:29,517 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase9.apache.org,40919,1675976022294' in zk 2023-02-09 20:54:29,517 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:29,517 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 20:54:29,519 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:29,519 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-09 20:54:29,519 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:54:29,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:29,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:54:29,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:54:29,519 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-02-09 20:54:29,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:54:29,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:54:29,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:29,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:29,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:54:29,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:29,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:29,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase9.apache.org,40919,1675976022294': 2023-02-09 20:54:29,521 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-09 20:54:29,521 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-02-09 20:54:29,521 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 20:54:29,521 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 20:54:29,521 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:29,521 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 20:54:29,522 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:29,522 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:29,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:29,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:54:29,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:54:29,522 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:29,522 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:54:29,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:29,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:54:29,523 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:54:29,523 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:29,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:54:29,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:29,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:29,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:54:29,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:29,524 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:29,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:29,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:54:29,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:29,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:29,527 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:54:29,527 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:29,527 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:54:29,527 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:54:29,527 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:54:29,527 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-09 20:54:29,527 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-02-09 20:54:29,527 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 20:54:29,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:54:29,527 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:29,527 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:29,527 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:29,527 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:29,527 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:29,527 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:29,527 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-09 20:54:29,527 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 20:54:29,527 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:54:29,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:54:29,628 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 20:54:29,629 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 20:54:29,633 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(933): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-02-09 20:54:29,634 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-09 20:54:29,634 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:29,634 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-02-09 20:54:29,634 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:54:29,634 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-09 20:54:29,635 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-09 20:54:29,635 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:29,635 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:29,636 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:29,636 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:54:29,636 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:54:29,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:54:29,636 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:29,636 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 20:54:29,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:29,637 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:29,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 20:54:29,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:29,637 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:29,637 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-02-09 20:54:29,637 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:29,637 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-09 20:54:29,637 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:54:29,638 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-09 20:54:29,638 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 20:54:29,638 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 20:54:29,638 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1675976066938.8d52c5e30d26c0f1140cf795dd05ef4f. 2023-02-09 20:54:29,638 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1675976066938.8d52c5e30d26c0f1140cf795dd05ef4f. started... 2023-02-09 20:54:29,638 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 8d52c5e30d26c0f1140cf795dd05ef4f 1/1 column families, dataSize=74 B heapSize=408 B 2023-02-09 20:54:30,051 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128d39b26c9a46a4183b6e47219c435367b to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151128d39b26c9a46a4183b6e47219c435367b 2023-02-09 20:54:30,459 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyPolicy/8d52c5e30d26c0f1140cf795dd05ef4f/.tmp/family1/f9bacefe26264ef1bd2238de5d669326 2023-02-09 20:54:30,464 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyPolicy/8d52c5e30d26c0f1140cf795dd05ef4f/.tmp/family1/f9bacefe26264ef1bd2238de5d669326 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyPolicy/8d52c5e30d26c0f1140cf795dd05ef4f/family1/f9bacefe26264ef1bd2238de5d669326 2023-02-09 20:54:30,468 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyPolicy/8d52c5e30d26c0f1140cf795dd05ef4f/family1/f9bacefe26264ef1bd2238de5d669326, entries=1, sequenceid=9, filesize=5.0 K 2023-02-09 20:54:30,469 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 8d52c5e30d26c0f1140cf795dd05ef4f in 831ms, sequenceid=9, compaction requested=false 2023-02-09 20:54:30,469 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 8d52c5e30d26c0f1140cf795dd05ef4f: 2023-02-09 20:54:30,469 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1675976066938.8d52c5e30d26c0f1140cf795dd05ef4f. 2023-02-09 20:54:30,469 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 20:54:30,470 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 20:54:30,470 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:30,470 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-02-09 20:54:30,470 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-02-09 20:54:30,471 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:30,471 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:30,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:30,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:54:30,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:54:30,471 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:30,471 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 20:54:30,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:54:30,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:54:30,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:30,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:30,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:54:30,473 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-02-09 20:54:30,473 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@626329a[Count = 0] remaining members to acquire global barrier 2023-02-09 20:54:30,473 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-09 20:54:30,473 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:30,479 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:30,479 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:30,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:30,479 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-09 20:54:30,480 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-02-09 20:54:30,480 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase9.apache.org,40919,1675976022294' in zk 2023-02-09 20:54:30,480 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:30,480 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 20:54:30,481 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:30,481 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-09 20:54:30,481 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:54:30,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:30,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:54:30,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:54:30,481 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-02-09 20:54:30,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:54:30,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:54:30,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:30,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:30,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:54:30,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:30,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:30,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase9.apache.org,40919,1675976022294': 2023-02-09 20:54:30,484 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-09 20:54:30,484 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-02-09 20:54:30,484 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 20:54:30,484 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 20:54:30,484 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:30,484 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 20:54:30,486 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:30,486 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:30,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:30,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:54:30,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:54:30,486 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:30,486 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:54:30,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:30,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:54:30,486 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:30,486 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:54:30,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:54:30,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:30,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:30,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:54:30,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:30,488 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:30,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:30,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:54:30,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:30,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:30,490 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:30,490 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:54:30,490 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:30,490 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:54:30,490 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-02-09 20:54:30,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:54:30,490 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:30,490 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:54:30,490 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:54:30,490 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:30,490 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 20:54:30,490 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:30,490 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:30,490 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:54:30,491 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:30,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:54:30,491 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-09 20:54:30,491 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 20:54:30,591 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 20:54:30,592 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 20:54:30,596 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(933): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-02-09 20:54:30,598 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-09 20:54:30,598 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:30,598 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-02-09 20:54:30,598 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:54:30,599 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-09 20:54:30,599 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-09 20:54:30,599 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:30,599 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:30,601 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:30,601 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:54:30,601 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:54:30,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:54:30,601 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:30,601 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 20:54:30,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:30,602 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:30,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 20:54:30,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:30,602 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:30,604 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-02-09 20:54:30,604 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:30,604 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-09 20:54:30,604 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:54:30,604 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-09 20:54:30,605 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 20:54:30,605 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 20:54:30,605 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1675976066938.8d52c5e30d26c0f1140cf795dd05ef4f. 2023-02-09 20:54:30,605 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1675976066938.8d52c5e30d26c0f1140cf795dd05ef4f. started... 2023-02-09 20:54:30,605 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 8d52c5e30d26c0f1140cf795dd05ef4f 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-09 20:54:31,021 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201d6f8edbab0c241779a74ec2e51d0579a to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151201d6f8edbab0c241779a74ec2e51d0579a 2023-02-09 20:54:31,427 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyPolicy/8d52c5e30d26c0f1140cf795dd05ef4f/.tmp/family1/760f17ce579144e78eb330610e49c256 2023-02-09 20:54:31,434 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyPolicy/8d52c5e30d26c0f1140cf795dd05ef4f/.tmp/family1/760f17ce579144e78eb330610e49c256 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyPolicy/8d52c5e30d26c0f1140cf795dd05ef4f/family1/760f17ce579144e78eb330610e49c256 2023-02-09 20:54:31,440 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyPolicy/8d52c5e30d26c0f1140cf795dd05ef4f/family1/760f17ce579144e78eb330610e49c256, entries=1, sequenceid=13, filesize=4.9 K 2023-02-09 20:54:31,441 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 8d52c5e30d26c0f1140cf795dd05ef4f in 835ms, sequenceid=13, compaction requested=true 2023-02-09 20:54:31,441 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 8d52c5e30d26c0f1140cf795dd05ef4f: 2023-02-09 20:54:31,441 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1675976066938.8d52c5e30d26c0f1140cf795dd05ef4f. 2023-02-09 20:54:31,441 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 20:54:31,441 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 20:54:31,441 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:31,441 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-02-09 20:54:31,441 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-02-09 20:54:31,443 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:31,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:31,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:54:31,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:54:31,443 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:31,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:54:31,443 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:31,443 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 20:54:31,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:54:31,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:31,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:31,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:54:31,445 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-02-09 20:54:31,445 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4408b774[Count = 0] remaining members to acquire global barrier 2023-02-09 20:54:31,445 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-09 20:54:31,445 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:31,446 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:31,447 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:31,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:31,447 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-09 20:54:31,447 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-02-09 20:54:31,447 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase9.apache.org,40919,1675976022294' in zk 2023-02-09 20:54:31,447 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:31,447 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 20:54:31,448 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-09 20:54:31,448 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:31,449 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:54:31,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:31,449 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-02-09 20:54:31,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:54:31,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:54:31,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:54:31,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:54:31,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:31,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:31,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:54:31,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:31,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:31,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase9.apache.org,40919,1675976022294': 2023-02-09 20:54:31,451 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-09 20:54:31,451 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-02-09 20:54:31,451 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 20:54:31,451 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 20:54:31,451 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:31,451 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 20:54:31,453 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:31,453 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:31,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:31,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:54:31,453 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:31,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:31,453 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:54:31,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:54:31,454 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:31,454 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:54:31,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:54:31,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:54:31,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:31,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:31,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:54:31,455 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:31,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:31,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:31,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:54:31,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:31,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:31,457 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:31,457 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:31,457 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:31,457 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:31,457 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:54:31,457 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:54:31,457 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-02-09 20:54:31,457 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 20:54:31,457 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:31,457 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:54:31,457 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:54:31,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:54:31,457 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:31,457 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:31,457 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-09 20:54:31,457 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-09 20:54:31,457 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:54:31,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:54:31,457 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 20:54:31,558 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 20:54:31,558 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 20:54:31,562 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(933): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-02-09 20:54:31,564 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-09 20:54:31,564 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:31,564 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-02-09 20:54:31,564 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:54:31,564 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-09 20:54:31,564 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-09 20:54:31,565 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:31,565 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:31,566 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:54:31,566 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:31,566 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:54:31,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:54:31,566 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:31,566 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 20:54:31,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:31,566 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:31,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 20:54:31,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:31,567 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:31,567 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-02-09 20:54:31,567 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:31,567 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-09 20:54:31,567 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:54:31,567 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-09 20:54:31,567 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 20:54:31,567 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 20:54:31,567 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1675976066938.8d52c5e30d26c0f1140cf795dd05ef4f. 2023-02-09 20:54:31,567 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1675976066938.8d52c5e30d26c0f1140cf795dd05ef4f. started... 2023-02-09 20:54:31,568 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 8d52c5e30d26c0f1140cf795dd05ef4f 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-09 20:54:31,983 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205020508a539824d6caf734d9c9541e45b to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151205020508a539824d6caf734d9c9541e45b 2023-02-09 20:54:32,389 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyPolicy/8d52c5e30d26c0f1140cf795dd05ef4f/.tmp/family1/dcfa6be52262477a9f7ee1bf9e7ec073 2023-02-09 20:54:32,394 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyPolicy/8d52c5e30d26c0f1140cf795dd05ef4f/.tmp/family1/dcfa6be52262477a9f7ee1bf9e7ec073 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyPolicy/8d52c5e30d26c0f1140cf795dd05ef4f/family1/dcfa6be52262477a9f7ee1bf9e7ec073 2023-02-09 20:54:32,398 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyPolicy/8d52c5e30d26c0f1140cf795dd05ef4f/family1/dcfa6be52262477a9f7ee1bf9e7ec073, entries=1, sequenceid=17, filesize=4.9 K 2023-02-09 20:54:32,399 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 8d52c5e30d26c0f1140cf795dd05ef4f in 831ms, sequenceid=17, compaction requested=true 2023-02-09 20:54:32,399 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 8d52c5e30d26c0f1140cf795dd05ef4f: 2023-02-09 20:54:32,399 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1675976066938.8d52c5e30d26c0f1140cf795dd05ef4f. 2023-02-09 20:54:32,399 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 20:54:32,399 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 20:54:32,399 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:32,399 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-02-09 20:54:32,399 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-02-09 20:54:32,401 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:32,401 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:32,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:32,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:54:32,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:54:32,401 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:32,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:54:32,401 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 20:54:32,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:54:32,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:32,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:32,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:54:32,402 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-02-09 20:54:32,402 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@a3da925[Count = 0] remaining members to acquire global barrier 2023-02-09 20:54:32,402 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-09 20:54:32,402 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:32,404 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:32,404 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:32,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:32,404 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-09 20:54:32,404 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-02-09 20:54:32,404 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase9.apache.org,40919,1675976022294' in zk 2023-02-09 20:54:32,404 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:32,404 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 20:54:32,405 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-09 20:54:32,405 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:54:32,405 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:32,406 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-02-09 20:54:32,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:32,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:54:32,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:54:32,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:54:32,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:54:32,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:32,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:32,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:54:32,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:32,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:32,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase9.apache.org,40919,1675976022294': 2023-02-09 20:54:32,408 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-09 20:54:32,408 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-02-09 20:54:32,408 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 20:54:32,408 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 20:54:32,408 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:32,408 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 20:54:32,409 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:32,409 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:32,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:32,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:54:32,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:54:32,409 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:32,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:32,409 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:54:32,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:54:32,410 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:54:32,410 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:32,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:54:32,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:32,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:32,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:54:32,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:32,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:32,411 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:32,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:54:32,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:32,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:32,413 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:32,413 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:54:32,413 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:32,414 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:54:32,414 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:32,414 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-02-09 20:54:32,414 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 20:54:32,414 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:54:32,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:54:32,414 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:54:32,414 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:32,414 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:32,414 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:32,414 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-09 20:54:32,414 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 20:54:32,414 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:32,414 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:54:32,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:54:32,514 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 20:54:32,515 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 20:54:32,519 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(933): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-02-09 20:54:32,521 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-09 20:54:32,521 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:32,521 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-02-09 20:54:32,521 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:54:32,521 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-09 20:54:32,521 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-09 20:54:32,521 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:32,521 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:32,523 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:32,523 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:54:32,523 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:54:32,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:54:32,523 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:32,523 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 20:54:32,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:32,524 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:32,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 20:54:32,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:32,524 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:32,524 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-02-09 20:54:32,524 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:32,524 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-09 20:54:32,524 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:54:32,524 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-09 20:54:32,525 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 20:54:32,525 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 20:54:32,525 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1675976066938.8d52c5e30d26c0f1140cf795dd05ef4f. 2023-02-09 20:54:32,525 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1675976066938.8d52c5e30d26c0f1140cf795dd05ef4f. started... 2023-02-09 20:54:32,525 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 8d52c5e30d26c0f1140cf795dd05ef4f 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-09 20:54:32,939 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015122882e9aa6f1951460cb5f663f84fdc9aa0 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015122882e9aa6f1951460cb5f663f84fdc9aa0 2023-02-09 20:54:33,345 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyPolicy/8d52c5e30d26c0f1140cf795dd05ef4f/.tmp/family1/fa979f36425543f58851d9223fb06159 2023-02-09 20:54:33,350 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyPolicy/8d52c5e30d26c0f1140cf795dd05ef4f/.tmp/family1/fa979f36425543f58851d9223fb06159 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyPolicy/8d52c5e30d26c0f1140cf795dd05ef4f/family1/fa979f36425543f58851d9223fb06159 2023-02-09 20:54:33,353 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyPolicy/8d52c5e30d26c0f1140cf795dd05ef4f/family1/fa979f36425543f58851d9223fb06159, entries=1, sequenceid=21, filesize=4.9 K 2023-02-09 20:54:33,354 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 8d52c5e30d26c0f1140cf795dd05ef4f in 829ms, sequenceid=21, compaction requested=true 2023-02-09 20:54:33,354 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 8d52c5e30d26c0f1140cf795dd05ef4f: 2023-02-09 20:54:33,354 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1675976066938.8d52c5e30d26c0f1140cf795dd05ef4f. 2023-02-09 20:54:33,354 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 20:54:33,354 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 20:54:33,354 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:33,355 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-02-09 20:54:33,355 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-02-09 20:54:33,359 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:33,359 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:33,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:33,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:54:33,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:54:33,359 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:33,359 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 20:54:33,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:54:33,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:54:33,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:33,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:33,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:54:33,361 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-02-09 20:54:33,361 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@ec0a886[Count = 0] remaining members to acquire global barrier 2023-02-09 20:54:33,361 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-09 20:54:33,361 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:33,362 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:33,362 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:33,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:33,362 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-09 20:54:33,362 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-02-09 20:54:33,362 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase9.apache.org,40919,1675976022294' in zk 2023-02-09 20:54:33,362 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:33,362 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 20:54:33,364 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-09 20:54:33,364 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:33,364 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:54:33,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:33,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:54:33,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:54:33,364 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-02-09 20:54:33,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:54:33,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:54:33,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:33,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:33,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:54:33,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:33,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:33,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase9.apache.org,40919,1675976022294': 2023-02-09 20:54:33,366 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-09 20:54:33,366 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-02-09 20:54:33,366 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 20:54:33,366 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 20:54:33,366 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:33,366 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 20:54:33,367 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:33,367 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:33,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:33,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:54:33,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:54:33,368 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:33,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:33,367 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:54:33,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:54:33,368 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:54:33,368 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:33,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:54:33,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:33,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:33,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:54:33,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:33,369 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:33,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:33,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:54:33,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:33,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:33,371 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:33,371 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:33,371 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:33,371 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:54:33,371 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:54:33,371 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:54:33,371 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:33,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:54:33,371 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-09 20:54:33,371 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-02-09 20:54:33,371 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 20:54:33,371 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:54:33,371 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:33,371 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:33,371 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:54:33,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:54:33,371 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:33,371 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-09 20:54:33,372 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 20:54:33,472 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 20:54:33,473 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 20:54:33,478 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(933): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-02-09 20:54:33,480 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-09 20:54:33,480 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:33,480 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-02-09 20:54:33,480 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:54:33,480 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-09 20:54:33,480 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-09 20:54:33,480 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:33,480 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:33,481 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:33,481 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:54:33,481 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:54:33,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:54:33,481 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:33,482 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 20:54:33,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:33,482 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:33,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 20:54:33,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:33,482 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:33,483 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-02-09 20:54:33,483 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:33,483 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-09 20:54:33,483 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:54:33,483 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-09 20:54:33,483 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 20:54:33,483 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 20:54:33,483 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1675976066938.8d52c5e30d26c0f1140cf795dd05ef4f. 2023-02-09 20:54:33,483 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1675976066938.8d52c5e30d26c0f1140cf795dd05ef4f. started... 2023-02-09 20:54:33,483 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 8d52c5e30d26c0f1140cf795dd05ef4f 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-09 20:54:33,896 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231191f9fad97bf49ee885a4f2d0cd55b04 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151231191f9fad97bf49ee885a4f2d0cd55b04 2023-02-09 20:54:34,301 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyPolicy/8d52c5e30d26c0f1140cf795dd05ef4f/.tmp/family1/50fd04e46ee54cd798c5c0908b32d238 2023-02-09 20:54:34,306 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyPolicy/8d52c5e30d26c0f1140cf795dd05ef4f/.tmp/family1/50fd04e46ee54cd798c5c0908b32d238 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyPolicy/8d52c5e30d26c0f1140cf795dd05ef4f/family1/50fd04e46ee54cd798c5c0908b32d238 2023-02-09 20:54:34,311 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyPolicy/8d52c5e30d26c0f1140cf795dd05ef4f/family1/50fd04e46ee54cd798c5c0908b32d238, entries=1, sequenceid=25, filesize=4.9 K 2023-02-09 20:54:34,311 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 8d52c5e30d26c0f1140cf795dd05ef4f in 828ms, sequenceid=25, compaction requested=true 2023-02-09 20:54:34,312 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 8d52c5e30d26c0f1140cf795dd05ef4f: 2023-02-09 20:54:34,312 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1675976066938.8d52c5e30d26c0f1140cf795dd05ef4f. 2023-02-09 20:54:34,312 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 20:54:34,312 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 20:54:34,312 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:34,312 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-02-09 20:54:34,312 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-02-09 20:54:34,313 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:34,313 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:34,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:34,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:54:34,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:54:34,313 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:34,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:54:34,313 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 20:54:34,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:54:34,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:34,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:34,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:54:34,314 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-02-09 20:54:34,315 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@39c5f926[Count = 0] remaining members to acquire global barrier 2023-02-09 20:54:34,315 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-09 20:54:34,315 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:34,316 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:34,316 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:34,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:34,316 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-09 20:54:34,316 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-02-09 20:54:34,316 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase9.apache.org,40919,1675976022294' in zk 2023-02-09 20:54:34,316 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:34,316 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 20:54:34,318 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:34,318 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-09 20:54:34,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:34,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:54:34,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:54:34,318 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:54:34,318 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-02-09 20:54:34,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:54:34,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:54:34,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:34,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:34,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:54:34,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:34,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:34,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase9.apache.org,40919,1675976022294': 2023-02-09 20:54:34,321 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-09 20:54:34,321 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-02-09 20:54:34,321 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 20:54:34,321 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 20:54:34,321 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:34,321 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 20:54:34,323 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:34,323 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:54:34,323 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:34,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:34,323 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:34,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:34,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:54:34,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:54:34,324 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:54:34,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:54:34,324 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:34,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:54:34,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:34,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:34,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:54:34,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:34,325 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:34,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:34,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:54:34,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:34,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:34,327 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:54:34,327 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-02-09 20:54:34,328 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 20:54:34,328 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-09 20:54:34,328 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-09 20:54:34,328 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 20:54:34,331 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:54:34,331 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:54:34,331 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:54:34,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:54:34,331 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:34,331 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:34,331 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:34,331 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:34,331 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:34,331 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:34,331 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:34,331 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:54:34,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:54:34,428 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 20:54:34,429 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 20:54:34,433 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(933): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-02-09 20:54:34,435 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-09 20:54:34,435 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:34,435 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-02-09 20:54:34,435 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:54:34,435 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-09 20:54:34,435 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-09 20:54:34,435 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:34,435 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:34,436 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:34,436 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:54:34,437 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:54:34,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:54:34,437 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:34,437 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 20:54:34,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:34,437 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:34,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 20:54:34,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:34,437 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:34,438 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-02-09 20:54:34,438 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:34,438 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-09 20:54:34,438 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:54:34,438 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-09 20:54:34,438 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 20:54:34,438 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 20:54:34,438 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1675976066938.8d52c5e30d26c0f1140cf795dd05ef4f. 2023-02-09 20:54:34,438 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1675976066938.8d52c5e30d26c0f1140cf795dd05ef4f. started... 2023-02-09 20:54:34,438 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 8d52c5e30d26c0f1140cf795dd05ef4f 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-09 20:54:34,851 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101f6f86d1ca48149d8908e7bf8fb254f47 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160101f6f86d1ca48149d8908e7bf8fb254f47 2023-02-09 20:54:35,258 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyPolicy/8d52c5e30d26c0f1140cf795dd05ef4f/.tmp/family1/f3deeb9aacf54f4ba4fb4e2f123eded5 2023-02-09 20:54:35,263 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyPolicy/8d52c5e30d26c0f1140cf795dd05ef4f/.tmp/family1/f3deeb9aacf54f4ba4fb4e2f123eded5 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyPolicy/8d52c5e30d26c0f1140cf795dd05ef4f/family1/f3deeb9aacf54f4ba4fb4e2f123eded5 2023-02-09 20:54:35,268 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyPolicy/8d52c5e30d26c0f1140cf795dd05ef4f/family1/f3deeb9aacf54f4ba4fb4e2f123eded5, entries=1, sequenceid=29, filesize=4.9 K 2023-02-09 20:54:35,268 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 8d52c5e30d26c0f1140cf795dd05ef4f in 830ms, sequenceid=29, compaction requested=true 2023-02-09 20:54:35,268 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 8d52c5e30d26c0f1140cf795dd05ef4f: 2023-02-09 20:54:35,268 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1675976066938.8d52c5e30d26c0f1140cf795dd05ef4f. 2023-02-09 20:54:35,269 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 20:54:35,269 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 20:54:35,269 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:35,269 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-02-09 20:54:35,269 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-02-09 20:54:35,270 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:35,270 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:35,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:35,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:54:35,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:54:35,271 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:35,271 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 20:54:35,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:54:35,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:54:35,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:35,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:35,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:54:35,272 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-02-09 20:54:35,272 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@38f74a7d[Count = 0] remaining members to acquire global barrier 2023-02-09 20:54:35,272 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-09 20:54:35,272 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:35,273 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:35,273 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:35,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:35,273 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-09 20:54:35,273 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-02-09 20:54:35,273 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase9.apache.org,40919,1675976022294' in zk 2023-02-09 20:54:35,274 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:35,274 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 20:54:35,276 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-09 20:54:35,276 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:35,276 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:54:35,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:35,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:54:35,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:54:35,276 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-02-09 20:54:35,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:54:35,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:54:35,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:35,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:35,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:54:35,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:35,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:35,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase9.apache.org,40919,1675976022294': 2023-02-09 20:54:35,279 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-09 20:54:35,279 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-02-09 20:54:35,279 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 20:54:35,279 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 20:54:35,279 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:35,279 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 20:54:35,280 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:35,280 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:35,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:35,280 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:35,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:54:35,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:54:35,280 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:54:35,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:35,281 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:35,281 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:54:35,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:54:35,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:54:35,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:35,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:35,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:54:35,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:35,282 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:35,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:35,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:54:35,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:35,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:35,285 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:35,285 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:54:35,285 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:35,285 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:54:35,285 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:54:35,285 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-09 20:54:35,285 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:54:35,285 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-02-09 20:54:35,285 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 20:54:35,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:54:35,285 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:35,285 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:35,285 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:35,285 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:35,285 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:35,285 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-09 20:54:35,285 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:54:35,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:54:35,285 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 20:54:35,386 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 20:54:35,387 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 20:54:35,391 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(933): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-02-09 20:54:35,393 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-09 20:54:35,393 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:35,393 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-02-09 20:54:35,393 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:54:35,393 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-09 20:54:35,393 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-09 20:54:35,393 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:35,393 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:35,399 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:35,399 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:54:35,399 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:54:35,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:54:35,399 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:35,399 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 20:54:35,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:35,400 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:35,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 20:54:35,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:35,400 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:35,401 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-02-09 20:54:35,401 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:35,401 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-09 20:54:35,401 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:54:35,401 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-09 20:54:35,401 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 20:54:35,401 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 20:54:35,401 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1675976066938.8d52c5e30d26c0f1140cf795dd05ef4f. 2023-02-09 20:54:35,401 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1675976066938.8d52c5e30d26c0f1140cf795dd05ef4f. started... 2023-02-09 20:54:35,401 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 8d52c5e30d26c0f1140cf795dd05ef4f 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-09 20:54:35,815 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103ae42d99528424bc0a07931b588adcb58 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160103ae42d99528424bc0a07931b588adcb58 2023-02-09 20:54:36,220 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyPolicy/8d52c5e30d26c0f1140cf795dd05ef4f/.tmp/family1/c0b9034dcd994088a696c5e762a89844 2023-02-09 20:54:36,226 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyPolicy/8d52c5e30d26c0f1140cf795dd05ef4f/.tmp/family1/c0b9034dcd994088a696c5e762a89844 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyPolicy/8d52c5e30d26c0f1140cf795dd05ef4f/family1/c0b9034dcd994088a696c5e762a89844 2023-02-09 20:54:36,231 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyPolicy/8d52c5e30d26c0f1140cf795dd05ef4f/family1/c0b9034dcd994088a696c5e762a89844, entries=1, sequenceid=33, filesize=4.9 K 2023-02-09 20:54:36,232 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 8d52c5e30d26c0f1140cf795dd05ef4f in 831ms, sequenceid=33, compaction requested=true 2023-02-09 20:54:36,232 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 8d52c5e30d26c0f1140cf795dd05ef4f: 2023-02-09 20:54:36,232 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1675976066938.8d52c5e30d26c0f1140cf795dd05ef4f. 2023-02-09 20:54:36,232 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 20:54:36,232 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 20:54:36,232 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:36,233 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-02-09 20:54:36,233 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-02-09 20:54:36,234 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:36,234 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:36,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:36,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:54:36,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:54:36,234 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:36,234 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 20:54:36,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:54:36,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:54:36,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:36,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:36,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:54:36,236 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-02-09 20:54:36,236 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5f64b8c7[Count = 0] remaining members to acquire global barrier 2023-02-09 20:54:36,236 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-09 20:54:36,236 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:36,237 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:36,238 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:36,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:36,238 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-09 20:54:36,238 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-02-09 20:54:36,238 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase9.apache.org,40919,1675976022294' in zk 2023-02-09 20:54:36,238 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:36,238 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 20:54:36,239 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:36,239 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-09 20:54:36,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:36,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:54:36,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:54:36,239 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:54:36,240 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-02-09 20:54:36,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:54:36,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:54:36,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:36,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:36,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:54:36,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:36,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:36,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase9.apache.org,40919,1675976022294': 2023-02-09 20:54:36,242 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-09 20:54:36,242 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-02-09 20:54:36,242 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 20:54:36,242 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 20:54:36,243 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:36,243 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 20:54:36,245 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:36,245 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:36,245 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:54:36,245 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:36,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:36,246 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:54:36,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:36,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:54:36,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:54:36,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:54:36,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:54:36,246 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:36,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:36,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:36,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:54:36,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:36,248 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:36,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:36,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:54:36,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:36,259 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:36,259 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:36,259 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:36,259 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:54:36,259 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:54:36,259 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:36,259 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:54:36,259 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-02-09 20:54:36,259 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 20:54:36,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:54:36,259 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:36,259 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:54:36,259 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:36,259 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-09 20:54:36,260 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-09 20:54:36,260 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 20:54:36,260 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:36,260 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:54:36,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:54:36,360 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 20:54:36,361 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 20:54:36,365 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(933): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-02-09 20:54:36,366 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-09 20:54:36,367 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:36,367 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-02-09 20:54:36,367 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:54:36,367 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-09 20:54:36,367 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-09 20:54:36,367 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:36,367 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:36,368 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:54:36,368 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:36,368 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:54:36,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:54:36,369 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:36,369 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 20:54:36,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:36,369 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:36,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 20:54:36,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:36,369 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:36,370 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-02-09 20:54:36,370 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:36,370 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-09 20:54:36,370 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:54:36,370 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-09 20:54:36,370 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 20:54:36,370 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 20:54:36,370 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1675976066938.8d52c5e30d26c0f1140cf795dd05ef4f. 2023-02-09 20:54:36,370 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1675976066938.8d52c5e30d26c0f1140cf795dd05ef4f. started... 2023-02-09 20:54:36,370 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 8d52c5e30d26c0f1140cf795dd05ef4f 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-09 20:54:36,805 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907079dc67d9ad942239dd02f5db6924a9e to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20150907079dc67d9ad942239dd02f5db6924a9e 2023-02-09 20:54:37,217 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyPolicy/8d52c5e30d26c0f1140cf795dd05ef4f/.tmp/family1/e9a193f5883d4fc58c7db2fa60fe5bdb 2023-02-09 20:54:37,222 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyPolicy/8d52c5e30d26c0f1140cf795dd05ef4f/.tmp/family1/e9a193f5883d4fc58c7db2fa60fe5bdb as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyPolicy/8d52c5e30d26c0f1140cf795dd05ef4f/family1/e9a193f5883d4fc58c7db2fa60fe5bdb 2023-02-09 20:54:37,226 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyPolicy/8d52c5e30d26c0f1140cf795dd05ef4f/family1/e9a193f5883d4fc58c7db2fa60fe5bdb, entries=1, sequenceid=37, filesize=4.9 K 2023-02-09 20:54:37,227 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 8d52c5e30d26c0f1140cf795dd05ef4f in 857ms, sequenceid=37, compaction requested=true 2023-02-09 20:54:37,227 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 8d52c5e30d26c0f1140cf795dd05ef4f: 2023-02-09 20:54:37,227 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1675976066938.8d52c5e30d26c0f1140cf795dd05ef4f. 2023-02-09 20:54:37,227 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 20:54:37,227 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 20:54:37,227 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:37,227 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-02-09 20:54:37,227 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-02-09 20:54:37,228 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:37,228 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:37,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:37,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:54:37,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:54:37,229 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:37,229 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 20:54:37,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:54:37,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:54:37,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:37,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:37,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:54:37,230 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-02-09 20:54:37,230 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@54ebbf35[Count = 0] remaining members to acquire global barrier 2023-02-09 20:54:37,230 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-09 20:54:37,230 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:37,231 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:37,231 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:37,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:37,232 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-09 20:54:37,232 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-02-09 20:54:37,232 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:37,232 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 20:54:37,232 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase9.apache.org,40919,1675976022294' in zk 2023-02-09 20:54:37,233 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-09 20:54:37,233 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:54:37,233 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:37,233 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-02-09 20:54:37,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:37,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:54:37,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:54:37,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:54:37,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:54:37,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:37,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:37,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:54:37,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:37,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:37,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase9.apache.org,40919,1675976022294': 2023-02-09 20:54:37,235 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-09 20:54:37,235 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-02-09 20:54:37,235 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 20:54:37,235 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 20:54:37,235 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:37,235 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 20:54:37,236 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:37,236 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:37,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:37,236 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:37,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:54:37,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:54:37,236 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:54:37,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:37,237 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:54:37,237 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:37,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:54:37,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:54:37,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:37,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:37,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:54:37,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:37,238 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:37,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:37,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:54:37,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:37,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:37,240 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:37,240 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:54:37,240 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:37,240 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:54:37,240 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:54:37,240 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-09 20:54:37,240 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:37,240 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-02-09 20:54:37,240 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 20:54:37,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:54:37,240 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:54:37,240 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:37,240 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:37,240 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:37,240 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:37,240 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-09 20:54:37,240 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 20:54:37,240 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:54:37,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:54:37,340 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 20:54:37,342 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 20:54:37,345 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(933): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-02-09 20:54:37,347 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-09 20:54:37,347 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:37,347 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-02-09 20:54:37,347 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:54:37,347 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-09 20:54:37,347 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-09 20:54:37,347 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:37,347 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:37,350 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:37,350 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:54:37,350 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:54:37,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:54:37,350 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:37,350 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 20:54:37,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:37,351 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:37,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 20:54:37,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:37,351 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:37,351 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-02-09 20:54:37,351 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:37,351 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-09 20:54:37,351 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:54:37,351 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-09 20:54:37,352 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 20:54:37,352 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 20:54:37,352 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1675976066938.8d52c5e30d26c0f1140cf795dd05ef4f. 2023-02-09 20:54:37,352 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1675976066938.8d52c5e30d26c0f1140cf795dd05ef4f. started... 2023-02-09 20:54:37,352 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 8d52c5e30d26c0f1140cf795dd05ef4f 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-09 20:54:37,766 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511203b021e04e1364f7fae67204d61c73eca to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201511203b021e04e1364f7fae67204d61c73eca 2023-02-09 20:54:38,171 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyPolicy/8d52c5e30d26c0f1140cf795dd05ef4f/.tmp/family1/1947113d3d784aebb5872266b26fc182 2023-02-09 20:54:38,176 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyPolicy/8d52c5e30d26c0f1140cf795dd05ef4f/.tmp/family1/1947113d3d784aebb5872266b26fc182 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyPolicy/8d52c5e30d26c0f1140cf795dd05ef4f/family1/1947113d3d784aebb5872266b26fc182 2023-02-09 20:54:38,180 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyPolicy/8d52c5e30d26c0f1140cf795dd05ef4f/family1/1947113d3d784aebb5872266b26fc182, entries=1, sequenceid=41, filesize=4.9 K 2023-02-09 20:54:38,181 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 8d52c5e30d26c0f1140cf795dd05ef4f in 829ms, sequenceid=41, compaction requested=true 2023-02-09 20:54:38,181 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 8d52c5e30d26c0f1140cf795dd05ef4f: 2023-02-09 20:54:38,181 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1675976066938.8d52c5e30d26c0f1140cf795dd05ef4f. 2023-02-09 20:54:38,181 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 20:54:38,181 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 20:54:38,181 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:38,181 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-02-09 20:54:38,181 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-02-09 20:54:38,183 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:38,183 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:38,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:38,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:54:38,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:54:38,183 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:38,183 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 20:54:38,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:54:38,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:54:38,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:38,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:38,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:54:38,184 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-02-09 20:54:38,184 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@42716047[Count = 0] remaining members to acquire global barrier 2023-02-09 20:54:38,184 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-09 20:54:38,184 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:38,185 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:38,185 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:38,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:38,185 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-09 20:54:38,185 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:38,186 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 20:54:38,186 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-02-09 20:54:38,186 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase9.apache.org,40919,1675976022294' in zk 2023-02-09 20:54:38,187 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-09 20:54:38,187 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:54:38,187 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:38,187 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-02-09 20:54:38,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:38,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:54:38,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:54:38,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:54:38,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:54:38,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:38,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:38,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:54:38,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:38,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:38,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase9.apache.org,40919,1675976022294': 2023-02-09 20:54:38,189 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-09 20:54:38,189 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-02-09 20:54:38,189 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 20:54:38,189 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 20:54:38,189 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:38,189 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 20:54:38,191 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:38,191 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:38,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:38,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:54:38,192 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:38,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:38,192 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:54:38,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:54:38,192 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:38,192 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:54:38,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:54:38,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:54:38,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:38,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:38,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:54:38,193 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:38,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:38,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:38,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:54:38,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:38,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:38,197 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:38,197 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:54:38,197 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:38,197 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:54:38,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:54:38,197 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:54:38,197 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:54:38,197 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-02-09 20:54:38,198 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 20:54:38,197 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:38,198 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:54:38,198 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-09 20:54:38,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:54:38,198 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:38,198 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-09 20:54:38,198 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:38,198 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 20:54:38,198 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:38,198 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:38,298 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 20:54:38,299 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 20:54:38,300 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=42951] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyPolicy 2023-02-09 20:54:38,302 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1675976025848] procedure2.ProcedureExecutor(1029): Stored pid=38, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-02-09 20:54:38,303 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=38, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-02-09 20:54:38,303 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1675976025848] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-09 20:54:38,303 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=38, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1675976678303 2023-02-09 20:54:38,307 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1675976025848] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-09 20:54:38,308 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1675976025848] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyPolicy' and column 'family1' 2023-02-09 20:54:38,308 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1675976025848] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-02-09 20:54:38,308 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1675976025848] zookeeper.ReadOnlyZKClient(139): Connect 0x06c52c6f to 127.0.0.1:62089 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 20:54:38,312 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1675976025848] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@50433355, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 20:54:38,312 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-02-09 20:54:39,151 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103bade9e9ad4cc457fada332f6a5cddcb3 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160103bade9e9ad4cc457fada332f6a5cddcb3 2023-02-09 20:54:39,152 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-02-09 20:54:39,164 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 20:54:39,165 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:53426, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 20:54:39,171 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-09 20:54:39,172 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:58000, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-09 20:54:39,180 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/5d6b3fc51dec438384c14898a206631d first=Optional[r3] last=Optional[r6] 2023-02-09 20:54:39,181 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyPolicy,,1675976066938.8d52c5e30d26c0f1140cf795dd05ef4f., hostname=jenkins-hbase9.apache.org,40919,1675976022294, seqNum=2 for row with hfile group [{family1,hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/5d6b3fc51dec438384c14898a206631d}] 2023-02-09 20:54:39,185 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HStore(763): Validating hfile at hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/5d6b3fc51dec438384c14898a206631d for inclusion in 8d52c5e30d26c0f1140cf795dd05ef4f/family1 2023-02-09 20:54:39,187 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-02-09 20:54:39,187 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HStore(777): Region bounds: first= last= 2023-02-09 20:54:39,187 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HRegion(2445): Flush status journal for 8d52c5e30d26c0f1140cf795dd05ef4f: 2023-02-09 20:54:39,188 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/5d6b3fc51dec438384c14898a206631d to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/staging/jenkins__testMajorCompactionWithWeeklyPolicy__1sbidmsmhot75ufa11i3pbcq668svm241glvil2jnt6rt83gldc8uo4v9cs593s7/family1/5d6b3fc51dec438384c14898a206631d 2023-02-09 20:54:39,190 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/staging/jenkins__testMajorCompactionWithWeeklyPolicy__1sbidmsmhot75ufa11i3pbcq668svm241glvil2jnt6rt83gldc8uo4v9cs593s7/family1/5d6b3fc51dec438384c14898a206631d as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyPolicy/8d52c5e30d26c0f1140cf795dd05ef4f/family1/14be0782bb2f484998feb8f37fab63d2_SeqId_44_ 2023-02-09 20:54:39,191 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HStore(849): Loaded HFile hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/staging/jenkins__testMajorCompactionWithWeeklyPolicy__1sbidmsmhot75ufa11i3pbcq668svm241glvil2jnt6rt83gldc8uo4v9cs593s7/family1/5d6b3fc51dec438384c14898a206631d into 8d52c5e30d26c0f1140cf795dd05ef4f/family1 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyPolicy/8d52c5e30d26c0f1140cf795dd05ef4f/family1/14be0782bb2f484998feb8f37fab63d2_SeqId_44_ - updating store file list. 2023-02-09 20:54:39,194 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HStore(882): Loaded HFile hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyPolicy/8d52c5e30d26c0f1140cf795dd05ef4f/family1/14be0782bb2f484998feb8f37fab63d2_SeqId_44_ into 8d52c5e30d26c0f1140cf795dd05ef4f/family1 2023-02-09 20:54:39,194 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HStore(855): Successfully loaded hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/staging/jenkins__testMajorCompactionWithWeeklyPolicy__1sbidmsmhot75ufa11i3pbcq668svm241glvil2jnt6rt83gldc8uo4v9cs593s7/family1/5d6b3fc51dec438384c14898a206631d into 8d52c5e30d26c0f1140cf795dd05ef4f/family1 (new location: hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyPolicy/8d52c5e30d26c0f1140cf795dd05ef4f/family1/14be0782bb2f484998feb8f37fab63d2_SeqId_44_) 2023-02-09 20:54:39,195 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/staging/jenkins__testMajorCompactionWithWeeklyPolicy__1sbidmsmhot75ufa11i3pbcq668svm241glvil2jnt6rt83gldc8uo4v9cs593s7/family1/5d6b3fc51dec438384c14898a206631d 2023-02-09 20:54:39,195 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-02-09 20:54:39,198 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51214 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-02-09 20:54:39,198 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HStore(1912): 8d52c5e30d26c0f1140cf795dd05ef4f/family1 is initiating minor compaction 2023-02-09 20:54:39,198 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@2f1c91a5; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-09 20:54:39,198 INFO [RS:0;jenkins-hbase9:40919-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 8d52c5e30d26c0f1140cf795dd05ef4f/family1 in testMajorCompactionWithWeeklyPolicy,,1675976066938.8d52c5e30d26c0f1140cf795dd05ef4f. 2023-02-09 20:54:39,198 INFO [RS:0;jenkins-hbase9:40919-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyPolicy/8d52c5e30d26c0f1140cf795dd05ef4f/family1/f9bacefe26264ef1bd2238de5d669326, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyPolicy/8d52c5e30d26c0f1140cf795dd05ef4f/family1/760f17ce579144e78eb330610e49c256, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyPolicy/8d52c5e30d26c0f1140cf795dd05ef4f/family1/dcfa6be52262477a9f7ee1bf9e7ec073, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyPolicy/8d52c5e30d26c0f1140cf795dd05ef4f/family1/fa979f36425543f58851d9223fb06159, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyPolicy/8d52c5e30d26c0f1140cf795dd05ef4f/family1/50fd04e46ee54cd798c5c0908b32d238, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyPolicy/8d52c5e30d26c0f1140cf795dd05ef4f/family1/f3deeb9aacf54f4ba4fb4e2f123eded5, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyPolicy/8d52c5e30d26c0f1140cf795dd05ef4f/family1/c0b9034dcd994088a696c5e762a89844, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyPolicy/8d52c5e30d26c0f1140cf795dd05ef4f/family1/e9a193f5883d4fc58c7db2fa60fe5bdb, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyPolicy/8d52c5e30d26c0f1140cf795dd05ef4f/family1/1947113d3d784aebb5872266b26fc182, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyPolicy/8d52c5e30d26c0f1140cf795dd05ef4f/family1/14be0782bb2f484998feb8f37fab63d2_SeqId_44_] into tmpdir=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyPolicy/8d52c5e30d26c0f1140cf795dd05ef4f/.tmp, totalSize=50.0 K 2023-02-09 20:54:39,198 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] compactions.Compactor(207): Compacting f9bacefe26264ef1bd2238de5d669326, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-02-09 20:54:39,198 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] compactions.Compactor(207): Compacting 760f17ce579144e78eb330610e49c256, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-02-09 20:54:39,198 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] compactions.Compactor(207): Compacting dcfa6be52262477a9f7ee1bf9e7ec073, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-02-09 20:54:39,198 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] compactions.Compactor(207): Compacting fa979f36425543f58851d9223fb06159, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-02-09 20:54:39,198 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] compactions.Compactor(207): Compacting 50fd04e46ee54cd798c5c0908b32d238, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-02-09 20:54:39,198 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] compactions.Compactor(207): Compacting f3deeb9aacf54f4ba4fb4e2f123eded5, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-02-09 20:54:39,198 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] compactions.Compactor(207): Compacting c0b9034dcd994088a696c5e762a89844, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-02-09 20:54:39,199 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] compactions.Compactor(207): Compacting e9a193f5883d4fc58c7db2fa60fe5bdb, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-02-09 20:54:39,199 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] compactions.Compactor(207): Compacting 1947113d3d784aebb5872266b26fc182, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-02-09 20:54:39,199 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] compactions.Compactor(207): Compacting 14be0782bb2f484998feb8f37fab63d2_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-02-09 20:54:39,200 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-02-09 20:54:39,201 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 20:54:39,203 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015122882e9aa6f1951460cb5f663f84fdc9aa0 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015122882e9aa6f1951460cb5f663f84fdc9aa0 2023-02-09 20:54:39,204 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151231191f9fad97bf49ee885a4f2d0cd55b04 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151231191f9fad97bf49ee885a4f2d0cd55b04 2023-02-09 20:54:39,206 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160101f6f86d1ca48149d8908e7bf8fb254f47 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160101f6f86d1ca48149d8908e7bf8fb254f47 2023-02-09 20:54:39,207 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160103ae42d99528424bc0a07931b588adcb58 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160103ae42d99528424bc0a07931b588adcb58 2023-02-09 20:54:39,207 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyPolicy 4 expired mob files are deleted 2023-02-09 20:54:39,207 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-02-09 20:54:39,207 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-02-09 20:54:39,208 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-02-09 20:54:39,208 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-02-09 20:54:39,208 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-02-09 20:54:39,208 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-02-09 20:54:39,208 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-02-09 20:54:39,208 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-02-09 20:54:39,208 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-02-09 20:54:39,237 INFO [RS:0;jenkins-hbase9:40919-shortCompactions-0] throttle.PressureAwareThroughputController(145): 8d52c5e30d26c0f1140cf795dd05ef4f#family1#compaction#48 average throughput is 0.45 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-09 20:54:39,667 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyPolicy/8d52c5e30d26c0f1140cf795dd05ef4f/.tmp/family1/4248aa46c486465b9497eafa622cf94f as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyPolicy/8d52c5e30d26c0f1140cf795dd05ef4f/family1/4248aa46c486465b9497eafa622cf94f 2023-02-09 20:54:39,673 INFO [RS:0;jenkins-hbase9:40919-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 8d52c5e30d26c0f1140cf795dd05ef4f/family1 of 8d52c5e30d26c0f1140cf795dd05ef4f into 4248aa46c486465b9497eafa622cf94f(size=6.6 K), total size for store is 171.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-09 20:54:39,673 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 8d52c5e30d26c0f1140cf795dd05ef4f: 2023-02-09 20:54:39,673 INFO [RS:0;jenkins-hbase9:40919-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyPolicy,,1675976066938.8d52c5e30d26c0f1140cf795dd05ef4f., storeName=family1, fileCount=10, fileSize=50.0 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.5 K), priority=2, time=1675976079198; duration=0sec 2023-02-09 20:54:39,673 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-09 20:54:39,762 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyPolicy/8d52c5e30d26c0f1140cf795dd05ef4f/family1/f9bacefe26264ef1bd2238de5d669326, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyPolicy/8d52c5e30d26c0f1140cf795dd05ef4f/family1/760f17ce579144e78eb330610e49c256, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyPolicy/8d52c5e30d26c0f1140cf795dd05ef4f/family1/dcfa6be52262477a9f7ee1bf9e7ec073, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyPolicy/8d52c5e30d26c0f1140cf795dd05ef4f/family1/fa979f36425543f58851d9223fb06159, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyPolicy/8d52c5e30d26c0f1140cf795dd05ef4f/family1/50fd04e46ee54cd798c5c0908b32d238, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyPolicy/8d52c5e30d26c0f1140cf795dd05ef4f/family1/f3deeb9aacf54f4ba4fb4e2f123eded5, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyPolicy/8d52c5e30d26c0f1140cf795dd05ef4f/family1/c0b9034dcd994088a696c5e762a89844, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyPolicy/8d52c5e30d26c0f1140cf795dd05ef4f/family1/e9a193f5883d4fc58c7db2fa60fe5bdb, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyPolicy/8d52c5e30d26c0f1140cf795dd05ef4f/family1/1947113d3d784aebb5872266b26fc182, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyPolicy/8d52c5e30d26c0f1140cf795dd05ef4f/family1/14be0782bb2f484998feb8f37fab63d2_SeqId_44_] to archive 2023-02-09 20:54:39,763 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 20:54:39,765 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyPolicy/8d52c5e30d26c0f1140cf795dd05ef4f/family1/f9bacefe26264ef1bd2238de5d669326 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMajorCompactionWithWeeklyPolicy/8d52c5e30d26c0f1140cf795dd05ef4f/family1/f9bacefe26264ef1bd2238de5d669326 2023-02-09 20:54:39,766 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyPolicy/8d52c5e30d26c0f1140cf795dd05ef4f/family1/760f17ce579144e78eb330610e49c256 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMajorCompactionWithWeeklyPolicy/8d52c5e30d26c0f1140cf795dd05ef4f/family1/760f17ce579144e78eb330610e49c256 2023-02-09 20:54:39,767 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyPolicy/8d52c5e30d26c0f1140cf795dd05ef4f/family1/dcfa6be52262477a9f7ee1bf9e7ec073 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMajorCompactionWithWeeklyPolicy/8d52c5e30d26c0f1140cf795dd05ef4f/family1/dcfa6be52262477a9f7ee1bf9e7ec073 2023-02-09 20:54:39,768 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyPolicy/8d52c5e30d26c0f1140cf795dd05ef4f/family1/fa979f36425543f58851d9223fb06159 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMajorCompactionWithWeeklyPolicy/8d52c5e30d26c0f1140cf795dd05ef4f/family1/fa979f36425543f58851d9223fb06159 2023-02-09 20:54:39,769 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyPolicy/8d52c5e30d26c0f1140cf795dd05ef4f/family1/50fd04e46ee54cd798c5c0908b32d238 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMajorCompactionWithWeeklyPolicy/8d52c5e30d26c0f1140cf795dd05ef4f/family1/50fd04e46ee54cd798c5c0908b32d238 2023-02-09 20:54:39,770 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyPolicy/8d52c5e30d26c0f1140cf795dd05ef4f/family1/f3deeb9aacf54f4ba4fb4e2f123eded5 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMajorCompactionWithWeeklyPolicy/8d52c5e30d26c0f1140cf795dd05ef4f/family1/f3deeb9aacf54f4ba4fb4e2f123eded5 2023-02-09 20:54:39,772 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyPolicy/8d52c5e30d26c0f1140cf795dd05ef4f/family1/c0b9034dcd994088a696c5e762a89844 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMajorCompactionWithWeeklyPolicy/8d52c5e30d26c0f1140cf795dd05ef4f/family1/c0b9034dcd994088a696c5e762a89844 2023-02-09 20:54:39,773 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyPolicy/8d52c5e30d26c0f1140cf795dd05ef4f/family1/e9a193f5883d4fc58c7db2fa60fe5bdb to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMajorCompactionWithWeeklyPolicy/8d52c5e30d26c0f1140cf795dd05ef4f/family1/e9a193f5883d4fc58c7db2fa60fe5bdb 2023-02-09 20:54:39,774 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyPolicy/8d52c5e30d26c0f1140cf795dd05ef4f/family1/1947113d3d784aebb5872266b26fc182 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMajorCompactionWithWeeklyPolicy/8d52c5e30d26c0f1140cf795dd05ef4f/family1/1947113d3d784aebb5872266b26fc182 2023-02-09 20:54:39,775 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyPolicy/8d52c5e30d26c0f1140cf795dd05ef4f/family1/14be0782bb2f484998feb8f37fab63d2_SeqId_44_ to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMajorCompactionWithWeeklyPolicy/8d52c5e30d26c0f1140cf795dd05ef4f/family1/14be0782bb2f484998feb8f37fab63d2_SeqId_44_ 2023-02-09 20:54:40,072 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120578c670bf48234be4b303eafeed449bb0 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015120578c670bf48234be4b303eafeed449bb0 2023-02-09 20:54:40,073 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-02-09 20:54:40,097 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/1e30ac7613c240c2b64fe13e5aa7b8f5 first=Optional[r00] last=Optional[r2] 2023-02-09 20:54:40,097 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyPolicy,,1675976066938.8d52c5e30d26c0f1140cf795dd05ef4f., hostname=jenkins-hbase9.apache.org,40919,1675976022294, seqNum=2 for row with hfile group [{family1,hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/1e30ac7613c240c2b64fe13e5aa7b8f5}] 2023-02-09 20:54:40,099 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HStore(763): Validating hfile at hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/1e30ac7613c240c2b64fe13e5aa7b8f5 for inclusion in 8d52c5e30d26c0f1140cf795dd05ef4f/family1 2023-02-09 20:54:40,103 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-02-09 20:54:40,103 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HStore(777): Region bounds: first= last= 2023-02-09 20:54:40,103 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HRegion(2445): Flush status journal for 8d52c5e30d26c0f1140cf795dd05ef4f: 2023-02-09 20:54:40,104 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/1e30ac7613c240c2b64fe13e5aa7b8f5 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/staging/jenkins__testMajorCompactionWithWeeklyPolicy__u6hdcefspqc9d6f58s34upge51k4gu5sgmmpj1d0cn3lnlc3do4o3j059s4m2q7q/family1/1e30ac7613c240c2b64fe13e5aa7b8f5 2023-02-09 20:54:40,106 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/staging/jenkins__testMajorCompactionWithWeeklyPolicy__u6hdcefspqc9d6f58s34upge51k4gu5sgmmpj1d0cn3lnlc3do4o3j059s4m2q7q/family1/1e30ac7613c240c2b64fe13e5aa7b8f5 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyPolicy/8d52c5e30d26c0f1140cf795dd05ef4f/family1/b6eb3118b1914fa19bb9d2595002f9a7_SeqId_47_ 2023-02-09 20:54:40,106 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HStore(849): Loaded HFile hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/staging/jenkins__testMajorCompactionWithWeeklyPolicy__u6hdcefspqc9d6f58s34upge51k4gu5sgmmpj1d0cn3lnlc3do4o3j059s4m2q7q/family1/1e30ac7613c240c2b64fe13e5aa7b8f5 into 8d52c5e30d26c0f1140cf795dd05ef4f/family1 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyPolicy/8d52c5e30d26c0f1140cf795dd05ef4f/family1/b6eb3118b1914fa19bb9d2595002f9a7_SeqId_47_ - updating store file list. 2023-02-09 20:54:40,111 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HStore(882): Loaded HFile hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyPolicy/8d52c5e30d26c0f1140cf795dd05ef4f/family1/b6eb3118b1914fa19bb9d2595002f9a7_SeqId_47_ into 8d52c5e30d26c0f1140cf795dd05ef4f/family1 2023-02-09 20:54:40,111 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HStore(855): Successfully loaded hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/staging/jenkins__testMajorCompactionWithWeeklyPolicy__u6hdcefspqc9d6f58s34upge51k4gu5sgmmpj1d0cn3lnlc3do4o3j059s4m2q7q/family1/1e30ac7613c240c2b64fe13e5aa7b8f5 into 8d52c5e30d26c0f1140cf795dd05ef4f/family1 (new location: hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyPolicy/8d52c5e30d26c0f1140cf795dd05ef4f/family1/b6eb3118b1914fa19bb9d2595002f9a7_SeqId_47_) 2023-02-09 20:54:40,111 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/staging/jenkins__testMajorCompactionWithWeeklyPolicy__u6hdcefspqc9d6f58s34upge51k4gu5sgmmpj1d0cn3lnlc3do4o3j059s4m2q7q/family1/1e30ac7613c240c2b64fe13e5aa7b8f5 2023-02-09 20:54:40,112 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-02-09 20:54:40,113 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 345120 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-02-09 20:54:40,113 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HStore(1912): 8d52c5e30d26c0f1140cf795dd05ef4f/family1 is initiating minor compaction (all files) 2023-02-09 20:54:40,113 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@5a552193; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-09 20:54:40,113 INFO [RS:0;jenkins-hbase9:40919-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 8d52c5e30d26c0f1140cf795dd05ef4f/family1 in testMajorCompactionWithWeeklyPolicy,,1675976066938.8d52c5e30d26c0f1140cf795dd05ef4f. 2023-02-09 20:54:40,113 INFO [RS:0;jenkins-hbase9:40919-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyPolicy/8d52c5e30d26c0f1140cf795dd05ef4f/family1/7ff47eb8f752441298d1bf648b5c4086, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyPolicy/8d52c5e30d26c0f1140cf795dd05ef4f/family1/4248aa46c486465b9497eafa622cf94f, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyPolicy/8d52c5e30d26c0f1140cf795dd05ef4f/family1/b6eb3118b1914fa19bb9d2595002f9a7_SeqId_47_] into tmpdir=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyPolicy/8d52c5e30d26c0f1140cf795dd05ef4f/.tmp, totalSize=337.0 K 2023-02-09 20:54:40,113 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] compactions.Compactor(207): Compacting 7ff47eb8f752441298d1bf648b5c4086, keycount=1000, bloomtype=ROW, size=165.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878845982 2023-02-09 20:54:40,114 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] compactions.Compactor(207): Compacting 4248aa46c486465b9497eafa622cf94f, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621245982 2023-02-09 20:54:40,114 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] compactions.Compactor(207): Compacting b6eb3118b1914fa19bb9d2595002f9a7_SeqId_47_, keycount=1002, bloomtype=ROW, size=165.4 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878845982 2023-02-09 20:54:40,115 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-02-09 20:54:40,115 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 20:54:40,117 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151130f7bef9ee90c540a096c6321adf0d4976 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151130f7bef9ee90c540a096c6321adf0d4976 2023-02-09 20:54:40,118 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151201d6f8edbab0c241779a74ec2e51d0579a to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151201d6f8edbab0c241779a74ec2e51d0579a 2023-02-09 20:54:40,120 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151205020508a539824d6caf734d9c9541e45b to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151205020508a539824d6caf734d9c9541e45b 2023-02-09 20:54:40,120 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyPolicy 3 expired mob files are deleted 2023-02-09 20:54:40,120 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-02-09 20:54:40,120 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-02-09 20:54:40,121 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1675976025848] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-02-09 20:54:40,121 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1675976025848] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-09 20:54:40,122 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=38, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-02-09 20:54:40,123 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=38, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE in 1.8210 sec 2023-02-09 20:54:40,130 INFO [RS:0;jenkins-hbase9:40919-shortCompactions-0] throttle.PressureAwareThroughputController(145): 8d52c5e30d26c0f1140cf795dd05ef4f#family1#compaction#49 average throughput is 22.09 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-09 20:54:40,215 INFO [Listener at localhost/46855] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyPolicy Thread=255 (was 252) - Thread LEAK? -, OpenFileDescriptor=622 (was 594) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=182 (was 216), ProcessCount=168 (was 168), AvailableMemoryMB=10719 (was 10815) 2023-02-09 20:54:40,228 INFO [Listener at localhost/46855] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly Thread=255, OpenFileDescriptor=622, MaxFileDescriptor=60000, SystemLoadAverage=182, ProcessCount=168, AvailableMemoryMB=10718 2023-02-09 20:54:40,230 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.HMaster$4(2102): Client=jenkins//172.31.2.10 create 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-02-09 20:54:40,231 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure2.ProcedureExecutor(1029): Stored pid=39, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:40,232 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_PRE_OPERATION 2023-02-09 20:54:40,233 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(697): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly" procId is: 39 2023-02-09 20:54:40,233 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-09 20:54:40,233 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-02-09 20:54:40,234 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a405dceeac89784cda948f90b491cbc9 2023-02-09 20:54:40,235 DEBUG [HFileArchiver-9] backup.HFileArchiver(153): Directory hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a405dceeac89784cda948f90b491cbc9 empty. 2023-02-09 20:54:40,235 DEBUG [HFileArchiver-9] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a405dceeac89784cda948f90b491cbc9 2023-02-09 20:54:40,235 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly regions 2023-02-09 20:54:40,334 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-02-09 20:54:40,535 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-02-09 20:54:40,560 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyPolicy/8d52c5e30d26c0f1140cf795dd05ef4f/.tmp/family1/1a2fa91f9854437cbfbf3547c79a2b70 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyPolicy/8d52c5e30d26c0f1140cf795dd05ef4f/family1/1a2fa91f9854437cbfbf3547c79a2b70 2023-02-09 20:54:40,564 INFO [RS:0;jenkins-hbase9:40919-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 8d52c5e30d26c0f1140cf795dd05ef4f/family1 of 8d52c5e30d26c0f1140cf795dd05ef4f into 1a2fa91f9854437cbfbf3547c79a2b70(size=166.4 K), total size for store is 166.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-09 20:54:40,564 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 8d52c5e30d26c0f1140cf795dd05ef4f: 2023-02-09 20:54:40,565 INFO [RS:0;jenkins-hbase9:40919-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyPolicy,,1675976066938.8d52c5e30d26c0f1140cf795dd05ef4f., storeName=family1, fileCount=3, fileSize=337.0 K (165.1 K, 6.6 K, 165.4 K), priority=2, time=1675976080113; duration=0sec 2023-02-09 20:54:40,565 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-09 20:54:40,644 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000001 2023-02-09 20:54:40,646 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(7671): creating {ENCODED => a405dceeac89784cda948f90b491cbc9, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675976080230.a405dceeac89784cda948f90b491cbc9.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/.tmp 2023-02-09 20:54:40,663 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyPolicy/8d52c5e30d26c0f1140cf795dd05ef4f/family1/7ff47eb8f752441298d1bf648b5c4086, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyPolicy/8d52c5e30d26c0f1140cf795dd05ef4f/family1/4248aa46c486465b9497eafa622cf94f, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyPolicy/8d52c5e30d26c0f1140cf795dd05ef4f/family1/b6eb3118b1914fa19bb9d2595002f9a7_SeqId_47_] to archive 2023-02-09 20:54:40,663 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 20:54:40,664 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyPolicy/8d52c5e30d26c0f1140cf795dd05ef4f/family1/7ff47eb8f752441298d1bf648b5c4086 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMajorCompactionWithWeeklyPolicy/8d52c5e30d26c0f1140cf795dd05ef4f/family1/7ff47eb8f752441298d1bf648b5c4086 2023-02-09 20:54:40,665 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyPolicy/8d52c5e30d26c0f1140cf795dd05ef4f/family1/4248aa46c486465b9497eafa622cf94f to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMajorCompactionWithWeeklyPolicy/8d52c5e30d26c0f1140cf795dd05ef4f/family1/4248aa46c486465b9497eafa622cf94f 2023-02-09 20:54:40,666 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyPolicy/8d52c5e30d26c0f1140cf795dd05ef4f/family1/b6eb3118b1914fa19bb9d2595002f9a7_SeqId_47_ to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMajorCompactionWithWeeklyPolicy/8d52c5e30d26c0f1140cf795dd05ef4f/family1/b6eb3118b1914fa19bb9d2595002f9a7_SeqId_47_ 2023-02-09 20:54:40,836 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-02-09 20:54:41,052 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675976080230.a405dceeac89784cda948f90b491cbc9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 20:54:41,052 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1603): Closing a405dceeac89784cda948f90b491cbc9, disabling compactions & flushes 2023-02-09 20:54:41,052 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675976080230.a405dceeac89784cda948f90b491cbc9. 2023-02-09 20:54:41,052 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675976080230.a405dceeac89784cda948f90b491cbc9. 2023-02-09 20:54:41,052 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675976080230.a405dceeac89784cda948f90b491cbc9. after waiting 0 ms 2023-02-09 20:54:41,052 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675976080230.a405dceeac89784cda948f90b491cbc9. 2023-02-09 20:54:41,052 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675976080230.a405dceeac89784cda948f90b491cbc9. 2023-02-09 20:54:41,052 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1557): Region close journal for a405dceeac89784cda948f90b491cbc9: Waiting for close lock at 1675976081052Disabling compacts and flushes for region at 1675976081052Disabling writes for close at 1675976081052Writing region close event to WAL at 1675976081052Closed at 1675976081052 2023-02-09 20:54:41,055 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_ADD_TO_META 2023-02-09 20:54:41,056 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675976080230.a405dceeac89784cda948f90b491cbc9.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1675976081056"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675976081056"}]},"ts":"1675976081056"} 2023-02-09 20:54:41,057 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-09 20:54:41,058 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-09 20:54:41,058 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675976081058"}]},"ts":"1675976081058"} 2023-02-09 20:54:41,059 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, state=ENABLING in hbase:meta 2023-02-09 20:54:41,061 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=a405dceeac89784cda948f90b491cbc9, ASSIGN}] 2023-02-09 20:54:41,063 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=a405dceeac89784cda948f90b491cbc9, ASSIGN 2023-02-09 20:54:41,064 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=a405dceeac89784cda948f90b491cbc9, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,40919,1675976022294; forceNewPlan=false, retain=false 2023-02-09 20:54:41,215 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=a405dceeac89784cda948f90b491cbc9, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:41,215 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675976080230.a405dceeac89784cda948f90b491cbc9.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1675976081215"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675976081215"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675976081215"}]},"ts":"1675976081215"} 2023-02-09 20:54:41,217 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=41, ppid=40, state=RUNNABLE; OpenRegionProcedure a405dceeac89784cda948f90b491cbc9, server=jenkins-hbase9.apache.org,40919,1675976022294}] 2023-02-09 20:54:41,337 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-02-09 20:54:41,371 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675976080230.a405dceeac89784cda948f90b491cbc9. 2023-02-09 20:54:41,372 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => a405dceeac89784cda948f90b491cbc9, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675976080230.a405dceeac89784cda948f90b491cbc9.', STARTKEY => '', ENDKEY => ''} 2023-02-09 20:54:41,372 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly a405dceeac89784cda948f90b491cbc9 2023-02-09 20:54:41,372 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675976080230.a405dceeac89784cda948f90b491cbc9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 20:54:41,372 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for a405dceeac89784cda948f90b491cbc9 2023-02-09 20:54:41,372 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for a405dceeac89784cda948f90b491cbc9 2023-02-09 20:54:41,373 INFO [StoreOpener-a405dceeac89784cda948f90b491cbc9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region a405dceeac89784cda948f90b491cbc9 2023-02-09 20:54:41,374 DEBUG [StoreOpener-a405dceeac89784cda948f90b491cbc9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a405dceeac89784cda948f90b491cbc9/family1 2023-02-09 20:54:41,375 DEBUG [StoreOpener-a405dceeac89784cda948f90b491cbc9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a405dceeac89784cda948f90b491cbc9/family1 2023-02-09 20:54:41,375 INFO [StoreOpener-a405dceeac89784cda948f90b491cbc9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a405dceeac89784cda948f90b491cbc9 columnFamilyName family1 2023-02-09 20:54:41,376 INFO [StoreOpener-a405dceeac89784cda948f90b491cbc9-1] regionserver.HStore(310): Store=a405dceeac89784cda948f90b491cbc9/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 20:54:41,377 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a405dceeac89784cda948f90b491cbc9 2023-02-09 20:54:41,377 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a405dceeac89784cda948f90b491cbc9 2023-02-09 20:54:41,380 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for a405dceeac89784cda948f90b491cbc9 2023-02-09 20:54:41,381 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a405dceeac89784cda948f90b491cbc9/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 20:54:41,382 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened a405dceeac89784cda948f90b491cbc9; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70506769, jitterRate=0.05063273012638092}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-09 20:54:41,382 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for a405dceeac89784cda948f90b491cbc9: Running coprocessor pre-open hook at 1675976081372Writing region info on filesystem at 1675976081372Initializing all the Stores at 1675976081373 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} at 1675976081373Cleaning up temporary data from old regions at 1675976081378 (+5 ms)Cleaning up detritus from prior splits at 1675976081378Running coprocessor post-open hooks at 1675976081382 (+4 ms)Region opened successfully at 1675976081382 2023-02-09 20:54:41,383 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675976080230.a405dceeac89784cda948f90b491cbc9., pid=41, masterSystemTime=1675976081369 2023-02-09 20:54:41,384 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675976080230.a405dceeac89784cda948f90b491cbc9. 2023-02-09 20:54:41,384 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675976080230.a405dceeac89784cda948f90b491cbc9. 2023-02-09 20:54:41,385 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=a405dceeac89784cda948f90b491cbc9, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:41,385 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675976080230.a405dceeac89784cda948f90b491cbc9.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1675976081385"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675976081385"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675976081385"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675976081385"}]},"ts":"1675976081385"} 2023-02-09 20:54:41,387 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=41, resume processing ppid=40 2023-02-09 20:54:41,387 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=41, ppid=40, state=SUCCESS; OpenRegionProcedure a405dceeac89784cda948f90b491cbc9, server=jenkins-hbase9.apache.org,40919,1675976022294 in 169 msec 2023-02-09 20:54:41,389 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=40, resume processing ppid=39 2023-02-09 20:54:41,389 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=39, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=a405dceeac89784cda948f90b491cbc9, ASSIGN in 326 msec 2023-02-09 20:54:41,389 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-09 20:54:41,390 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675976081390"}]},"ts":"1675976081390"} 2023-02-09 20:54:41,391 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, state=ENABLED in hbase:meta 2023-02-09 20:54:41,393 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_POST_OPERATION 2023-02-09 20:54:41,394 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=39, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 1.1630 sec 2023-02-09 20:54:42,338 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-02-09 20:54:42,338 INFO [Listener at localhost/46855] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, procId: 39 completed 2023-02-09 20:54:42,360 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(933): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-02-09 20:54:42,362 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:42,362 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-09 20:54:42,362 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:54:42,362 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-02-09 20:54:42,362 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-02-09 20:54:42,363 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:42,363 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:42,365 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:54:42,365 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:42,365 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:54:42,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:54:42,366 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:42,366 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 20:54:42,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:42,366 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:42,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 20:54:42,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:42,366 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:42,366 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:42,367 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-02-09 20:54:42,367 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:54:42,367 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-02-09 20:54:42,367 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 20:54:42,367 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 20:54:42,367 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675976080230.a405dceeac89784cda948f90b491cbc9. 2023-02-09 20:54:42,367 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675976080230.a405dceeac89784cda948f90b491cbc9. started... 2023-02-09 20:54:42,368 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing a405dceeac89784cda948f90b491cbc9 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-02-09 20:54:42,787 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130d7a27c3ac05d45ae9f1d9ee867dae637 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151130d7a27c3ac05d45ae9f1d9ee867dae637 2023-02-09 20:54:43,191 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a405dceeac89784cda948f90b491cbc9/.tmp/family1/fe1a43f5123b4da9bb2c7d62e3456cba 2023-02-09 20:54:43,196 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a405dceeac89784cda948f90b491cbc9/.tmp/family1/fe1a43f5123b4da9bb2c7d62e3456cba as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a405dceeac89784cda948f90b491cbc9/family1/fe1a43f5123b4da9bb2c7d62e3456cba 2023-02-09 20:54:43,200 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a405dceeac89784cda948f90b491cbc9/family1/fe1a43f5123b4da9bb2c7d62e3456cba, entries=1000, sequenceid=5, filesize=191.4 K 2023-02-09 20:54:43,200 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for a405dceeac89784cda948f90b491cbc9 in 833ms, sequenceid=5, compaction requested=false 2023-02-09 20:54:43,201 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-09 20:54:43,201 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for a405dceeac89784cda948f90b491cbc9: 2023-02-09 20:54:43,201 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675976080230.a405dceeac89784cda948f90b491cbc9. 2023-02-09 20:54:43,201 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 20:54:43,201 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 20:54:43,201 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:43,202 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-02-09 20:54:43,202 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-02-09 20:54:43,203 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:43,203 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:43,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:43,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:54:43,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:54:43,203 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:43,203 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 20:54:43,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:54:43,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:54:43,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:43,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:43,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:54:43,205 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-02-09 20:54:43,205 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@40576ed6[Count = 0] remaining members to acquire global barrier 2023-02-09 20:54:43,205 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-02-09 20:54:43,205 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:43,206 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:43,206 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:43,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:43,206 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-02-09 20:54:43,206 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-02-09 20:54:43,206 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase9.apache.org,40919,1675976022294' in zk 2023-02-09 20:54:43,206 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:43,206 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 20:54:43,207 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-02-09 20:54:43,207 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:43,207 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:54:43,208 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-02-09 20:54:43,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:43,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:54:43,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:54:43,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:54:43,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:54:43,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:43,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:43,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:54:43,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:43,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:43,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase9.apache.org,40919,1675976022294': 2023-02-09 20:54:43,210 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-02-09 20:54:43,210 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-02-09 20:54:43,210 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 20:54:43,210 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 20:54:43,210 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:43,210 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 20:54:43,212 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:43,212 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:43,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:43,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:54:43,213 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:43,213 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:54:43,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:43,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:54:43,213 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:43,213 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:54:43,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:54:43,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:54:43,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:43,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:43,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:54:43,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:43,214 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:43,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:43,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:54:43,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:43,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:43,216 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:43,216 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:43,216 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:43,216 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:43,216 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-09 20:54:43,216 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 20:54:43,216 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:54:43,216 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:43,216 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:54:43,216 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:43,216 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:54:43,216 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-02-09 20:54:43,216 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-02-09 20:54:43,216 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 20:54:43,216 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:43,216 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:54:43,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:54:43,217 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:54:43,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:54:43,316 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 20:54:43,317 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 20:54:43,321 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(933): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-02-09 20:54:43,323 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-02-09 20:54:43,323 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:43,323 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-09 20:54:43,323 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:54:43,323 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-02-09 20:54:43,323 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-02-09 20:54:43,323 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:43,323 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:43,325 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:43,325 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:54:43,325 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:54:43,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:54:43,325 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:43,325 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 20:54:43,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:43,326 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:43,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 20:54:43,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:43,326 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:43,326 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-02-09 20:54:43,326 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:43,326 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-02-09 20:54:43,326 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:54:43,327 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-02-09 20:54:43,327 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 20:54:43,327 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 20:54:43,327 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675976080230.a405dceeac89784cda948f90b491cbc9. 2023-02-09 20:54:43,327 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675976080230.a405dceeac89784cda948f90b491cbc9. started... 2023-02-09 20:54:43,327 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing a405dceeac89784cda948f90b491cbc9 1/1 column families, dataSize=74 B heapSize=408 B 2023-02-09 20:54:43,443 DEBUG [regionserver/jenkins-hbase9:0.Chore.1] throttle.PressureAwareCompactionThroughputController(103): CompactionPressure is 0.0, tune throughput to 50.00 MB/second 2023-02-09 20:54:43,742 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128b983e7f964e94d4a85b4e81b667f1648 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151128b983e7f964e94d4a85b4e81b667f1648 2023-02-09 20:54:43,768 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-09 20:54:43,768 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x06c52c6f to 127.0.0.1:62089 2023-02-09 20:54:43,769 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 20:54:43,769 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-09 20:54:43,769 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x50622d61 to 127.0.0.1:62089 2023-02-09 20:54:43,769 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 20:54:43,769 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-09 20:54:43,769 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x05939af8 to 127.0.0.1:62089 2023-02-09 20:54:43,769 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 20:54:43,770 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a405dceeac89784cda948f90b491cbc9/.tmp/family1/b295c00bf95e42bcab90378771bce433 2023-02-09 20:54:43,775 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a405dceeac89784cda948f90b491cbc9/.tmp/family1/b295c00bf95e42bcab90378771bce433 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a405dceeac89784cda948f90b491cbc9/family1/b295c00bf95e42bcab90378771bce433 2023-02-09 20:54:43,780 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a405dceeac89784cda948f90b491cbc9/family1/b295c00bf95e42bcab90378771bce433, entries=1, sequenceid=9, filesize=5.0 K 2023-02-09 20:54:43,781 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for a405dceeac89784cda948f90b491cbc9 in 454ms, sequenceid=9, compaction requested=false 2023-02-09 20:54:43,781 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for a405dceeac89784cda948f90b491cbc9: 2023-02-09 20:54:43,781 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675976080230.a405dceeac89784cda948f90b491cbc9. 2023-02-09 20:54:43,781 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 20:54:43,781 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 20:54:43,781 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:43,781 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-02-09 20:54:43,781 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-02-09 20:54:43,783 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:43,783 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:43,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:43,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:54:43,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:54:43,783 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:43,783 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 20:54:43,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:54:43,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:54:43,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:43,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:43,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:54:43,785 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-02-09 20:54:43,785 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3a0f549b[Count = 0] remaining members to acquire global barrier 2023-02-09 20:54:43,785 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-02-09 20:54:43,785 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:43,786 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:43,786 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:43,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:43,786 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-02-09 20:54:43,786 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-02-09 20:54:43,786 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase9.apache.org,40919,1675976022294' in zk 2023-02-09 20:54:43,786 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:43,786 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 20:54:43,788 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:43,788 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-02-09 20:54:43,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:43,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:54:43,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:54:43,788 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:54:43,788 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-02-09 20:54:43,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:54:43,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:54:43,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:43,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:43,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:54:43,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:43,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:43,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase9.apache.org,40919,1675976022294': 2023-02-09 20:54:43,790 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-02-09 20:54:43,790 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-02-09 20:54:43,790 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 20:54:43,790 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 20:54:43,790 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:43,790 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 20:54:43,792 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:43,792 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:43,792 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:43,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:43,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:54:43,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:54:43,792 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:54:43,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:43,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:54:43,792 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:43,792 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:54:43,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:54:43,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:43,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:43,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:54:43,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:43,793 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:43,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:43,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:54:43,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:43,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:43,798 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:43,798 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:54:43,798 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:43,798 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:54:43,798 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:43,798 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-02-09 20:54:43,798 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-09 20:54:43,798 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 20:54:43,798 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:54:43,798 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:54:43,798 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:43,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:54:43,798 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:43,798 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:43,798 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:43,798 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-02-09 20:54:43,799 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 20:54:43,799 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:54:43,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:54:43,899 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 20:54:43,900 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 20:54:43,903 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(933): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-02-09 20:54:43,905 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-02-09 20:54:43,905 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:43,905 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-09 20:54:43,905 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:54:43,905 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-02-09 20:54:43,905 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-02-09 20:54:43,905 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:43,905 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:43,913 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:43,913 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:54:43,913 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:54:43,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:54:43,913 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:43,913 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 20:54:43,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:43,913 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:43,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 20:54:43,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:43,914 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:43,914 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-02-09 20:54:43,914 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:43,914 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-02-09 20:54:43,914 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:54:43,914 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-02-09 20:54:43,914 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 20:54:43,914 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 20:54:43,914 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675976080230.a405dceeac89784cda948f90b491cbc9. 2023-02-09 20:54:43,914 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675976080230.a405dceeac89784cda948f90b491cbc9. started... 2023-02-09 20:54:43,914 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing a405dceeac89784cda948f90b491cbc9 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-09 20:54:44,327 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201c998a52aeb8b4bdfb69fcc41877a35ef to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151201c998a52aeb8b4bdfb69fcc41877a35ef 2023-02-09 20:54:44,733 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a405dceeac89784cda948f90b491cbc9/.tmp/family1/e83b524810844ae99f09a3a1017eedc5 2023-02-09 20:54:44,739 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a405dceeac89784cda948f90b491cbc9/.tmp/family1/e83b524810844ae99f09a3a1017eedc5 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a405dceeac89784cda948f90b491cbc9/family1/e83b524810844ae99f09a3a1017eedc5 2023-02-09 20:54:44,742 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a405dceeac89784cda948f90b491cbc9/family1/e83b524810844ae99f09a3a1017eedc5, entries=1, sequenceid=13, filesize=5.0 K 2023-02-09 20:54:44,743 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for a405dceeac89784cda948f90b491cbc9 in 829ms, sequenceid=13, compaction requested=true 2023-02-09 20:54:44,743 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for a405dceeac89784cda948f90b491cbc9: 2023-02-09 20:54:44,744 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675976080230.a405dceeac89784cda948f90b491cbc9. 2023-02-09 20:54:44,744 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 20:54:44,744 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 20:54:44,744 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:44,744 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-02-09 20:54:44,744 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-02-09 20:54:44,745 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:44,745 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:44,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:44,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:54:44,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:54:44,745 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:44,745 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 20:54:44,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:54:44,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:54:44,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:44,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:44,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:54:44,746 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-02-09 20:54:44,747 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@339456f8[Count = 0] remaining members to acquire global barrier 2023-02-09 20:54:44,747 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-02-09 20:54:44,747 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:44,748 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:44,748 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:44,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:44,748 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-02-09 20:54:44,748 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-02-09 20:54:44,748 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase9.apache.org,40919,1675976022294' in zk 2023-02-09 20:54:44,748 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:44,748 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 20:54:44,751 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-02-09 20:54:44,751 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:44,751 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:54:44,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:44,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:54:44,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:54:44,751 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-02-09 20:54:44,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:54:44,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:54:44,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:44,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:44,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:54:44,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:44,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:44,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase9.apache.org,40919,1675976022294': 2023-02-09 20:54:44,753 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-02-09 20:54:44,753 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-02-09 20:54:44,753 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 20:54:44,753 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 20:54:44,753 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:44,753 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 20:54:44,754 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:44,754 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:44,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:44,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:54:44,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:54:44,755 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:44,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:44,755 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:54:44,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:54:44,755 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:44,755 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:54:44,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:54:44,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:44,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:44,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:54:44,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:44,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:44,756 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:44,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:54:44,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:44,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:44,758 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:44,758 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:54:44,758 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:44,758 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:54:44,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:54:44,758 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:54:44,758 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:54:44,758 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-09 20:54:44,758 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 20:54:44,758 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:44,758 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:44,758 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:44,758 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:54:44,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:54:44,759 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:44,759 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:44,759 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-02-09 20:54:44,759 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 20:54:44,859 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 20:54:44,860 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 20:54:44,863 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(933): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-02-09 20:54:44,865 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-02-09 20:54:44,865 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:44,865 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-09 20:54:44,865 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:54:44,865 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-02-09 20:54:44,865 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-02-09 20:54:44,866 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:44,866 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:44,867 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:44,867 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:54:44,867 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:54:44,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:54:44,867 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:44,867 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 20:54:44,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:44,867 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:44,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 20:54:44,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:44,868 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:44,868 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-02-09 20:54:44,868 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:44,868 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-02-09 20:54:44,868 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:54:44,868 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-02-09 20:54:44,868 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 20:54:44,868 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 20:54:44,868 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675976080230.a405dceeac89784cda948f90b491cbc9. 2023-02-09 20:54:44,868 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675976080230.a405dceeac89784cda948f90b491cbc9. started... 2023-02-09 20:54:44,868 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing a405dceeac89784cda948f90b491cbc9 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-09 20:54:45,280 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205cc2348d3d0e7469ea0561cf425a0ac5e to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151205cc2348d3d0e7469ea0561cf425a0ac5e 2023-02-09 20:54:45,686 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a405dceeac89784cda948f90b491cbc9/.tmp/family1/8eda028eaf3c4776a7a2cd9be88bba3b 2023-02-09 20:54:45,690 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a405dceeac89784cda948f90b491cbc9/.tmp/family1/8eda028eaf3c4776a7a2cd9be88bba3b as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a405dceeac89784cda948f90b491cbc9/family1/8eda028eaf3c4776a7a2cd9be88bba3b 2023-02-09 20:54:45,694 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a405dceeac89784cda948f90b491cbc9/family1/8eda028eaf3c4776a7a2cd9be88bba3b, entries=1, sequenceid=17, filesize=5.0 K 2023-02-09 20:54:45,695 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for a405dceeac89784cda948f90b491cbc9 in 827ms, sequenceid=17, compaction requested=true 2023-02-09 20:54:45,695 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for a405dceeac89784cda948f90b491cbc9: 2023-02-09 20:54:45,695 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675976080230.a405dceeac89784cda948f90b491cbc9. 2023-02-09 20:54:45,695 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 20:54:45,695 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 20:54:45,695 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:45,695 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-02-09 20:54:45,695 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-02-09 20:54:45,703 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:45,703 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:45,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:45,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:54:45,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:54:45,703 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:45,703 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 20:54:45,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:54:45,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:54:45,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:45,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:45,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:54:45,705 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-02-09 20:54:45,705 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7a2e6b95[Count = 0] remaining members to acquire global barrier 2023-02-09 20:54:45,705 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-02-09 20:54:45,705 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:45,706 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:45,706 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:45,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:45,706 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-02-09 20:54:45,706 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-02-09 20:54:45,706 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:45,706 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 20:54:45,706 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase9.apache.org,40919,1675976022294' in zk 2023-02-09 20:54:45,707 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:45,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:45,707 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-02-09 20:54:45,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:54:45,707 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:54:45,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:54:45,707 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-02-09 20:54:45,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:54:45,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:54:45,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:45,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:45,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:54:45,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:45,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:45,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase9.apache.org,40919,1675976022294': 2023-02-09 20:54:45,709 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-02-09 20:54:45,709 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-02-09 20:54:45,709 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 20:54:45,709 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 20:54:45,709 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:45,709 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 20:54:45,711 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:45,711 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:45,711 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:54:45,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:45,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:54:45,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:54:45,711 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:45,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:45,711 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:54:45,711 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:45,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:54:45,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:54:45,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:45,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:45,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:54:45,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:45,712 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:45,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:45,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:54:45,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:45,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:45,715 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:54:45,715 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:45,715 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:54:45,715 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:54:45,715 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:54:45,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:54:45,715 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-09 20:54:45,716 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 20:54:45,715 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:45,716 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-02-09 20:54:45,716 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:45,716 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:54:45,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:54:45,716 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:45,716 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-02-09 20:54:45,716 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 20:54:45,716 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:45,716 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:45,716 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:45,816 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 20:54:45,817 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 20:54:45,821 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(933): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-02-09 20:54:45,822 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-02-09 20:54:45,822 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:45,822 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-09 20:54:45,822 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:54:45,822 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-02-09 20:54:45,822 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-02-09 20:54:45,823 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:45,823 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:45,824 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:45,824 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:54:45,824 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:54:45,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:54:45,824 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:45,824 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 20:54:45,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:45,825 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:45,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 20:54:45,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:45,825 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:45,825 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-02-09 20:54:45,825 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:45,825 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-02-09 20:54:45,825 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:54:45,825 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-02-09 20:54:45,826 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 20:54:45,826 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 20:54:45,826 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675976080230.a405dceeac89784cda948f90b491cbc9. 2023-02-09 20:54:45,826 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675976080230.a405dceeac89784cda948f90b491cbc9. started... 2023-02-09 20:54:45,826 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing a405dceeac89784cda948f90b491cbc9 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-09 20:54:46,238 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228a0152802bdd14f798893575a1d1c3454 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151228a0152802bdd14f798893575a1d1c3454 2023-02-09 20:54:46,643 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a405dceeac89784cda948f90b491cbc9/.tmp/family1/574bd463ed3b4c308fd8f8caafad7f9d 2023-02-09 20:54:46,647 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a405dceeac89784cda948f90b491cbc9/.tmp/family1/574bd463ed3b4c308fd8f8caafad7f9d as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a405dceeac89784cda948f90b491cbc9/family1/574bd463ed3b4c308fd8f8caafad7f9d 2023-02-09 20:54:46,651 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a405dceeac89784cda948f90b491cbc9/family1/574bd463ed3b4c308fd8f8caafad7f9d, entries=1, sequenceid=21, filesize=5.0 K 2023-02-09 20:54:46,652 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for a405dceeac89784cda948f90b491cbc9 in 826ms, sequenceid=21, compaction requested=true 2023-02-09 20:54:46,652 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for a405dceeac89784cda948f90b491cbc9: 2023-02-09 20:54:46,652 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675976080230.a405dceeac89784cda948f90b491cbc9. 2023-02-09 20:54:46,652 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 20:54:46,652 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 20:54:46,652 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:46,652 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-02-09 20:54:46,652 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-02-09 20:54:46,657 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:46,657 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:46,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:46,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:54:46,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:54:46,657 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:46,657 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 20:54:46,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:54:46,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:54:46,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:46,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:46,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:54:46,658 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-02-09 20:54:46,658 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1749bd8[Count = 0] remaining members to acquire global barrier 2023-02-09 20:54:46,658 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-02-09 20:54:46,658 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:46,663 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:46,663 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:46,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:46,663 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-02-09 20:54:46,663 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-02-09 20:54:46,663 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:46,663 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 20:54:46,663 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase9.apache.org,40919,1675976022294' in zk 2023-02-09 20:54:46,665 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-02-09 20:54:46,665 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:46,665 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:54:46,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:46,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:54:46,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:54:46,665 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-02-09 20:54:46,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:54:46,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:54:46,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:46,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:46,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:54:46,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:46,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:46,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase9.apache.org,40919,1675976022294': 2023-02-09 20:54:46,666 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-02-09 20:54:46,666 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-02-09 20:54:46,667 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 20:54:46,667 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 20:54:46,667 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:46,667 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 20:54:46,668 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:46,668 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:46,668 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:46,668 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:54:46,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:46,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:46,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:54:46,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:54:46,668 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:54:46,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:54:46,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:54:46,668 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:46,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:46,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:46,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:54:46,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:46,670 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:46,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:46,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:54:46,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:46,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:46,672 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:46,672 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:46,672 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:46,672 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:54:46,672 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-09 20:54:46,672 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 20:54:46,672 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:54:46,672 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:54:46,672 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:54:46,672 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-02-09 20:54:46,672 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:46,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:54:46,672 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:46,672 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-02-09 20:54:46,672 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 20:54:46,672 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:46,672 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:46,672 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:54:46,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:54:46,772 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 20:54:46,773 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 20:54:46,777 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(933): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-02-09 20:54:46,778 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-02-09 20:54:46,778 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:46,778 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-09 20:54:46,778 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:54:46,778 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-02-09 20:54:46,779 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-02-09 20:54:46,779 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:46,779 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:46,781 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:54:46,781 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:46,781 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:54:46,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:54:46,781 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:46,781 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 20:54:46,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:46,782 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:46,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 20:54:46,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:46,782 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:46,782 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-02-09 20:54:46,782 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:46,782 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-02-09 20:54:46,782 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:54:46,782 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-02-09 20:54:46,783 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 20:54:46,783 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 20:54:46,783 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675976080230.a405dceeac89784cda948f90b491cbc9. 2023-02-09 20:54:46,783 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675976080230.a405dceeac89784cda948f90b491cbc9. started... 2023-02-09 20:54:46,783 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing a405dceeac89784cda948f90b491cbc9 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-09 20:54:46,900 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-09 20:54:47,195 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231bebc98c7429d49f1bc0a3f7af51cc729 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151231bebc98c7429d49f1bc0a3f7af51cc729 2023-02-09 20:54:47,600 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a405dceeac89784cda948f90b491cbc9/.tmp/family1/45fa5fbde61547d5accb006f4b106104 2023-02-09 20:54:47,606 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a405dceeac89784cda948f90b491cbc9/.tmp/family1/45fa5fbde61547d5accb006f4b106104 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a405dceeac89784cda948f90b491cbc9/family1/45fa5fbde61547d5accb006f4b106104 2023-02-09 20:54:47,610 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a405dceeac89784cda948f90b491cbc9/family1/45fa5fbde61547d5accb006f4b106104, entries=1, sequenceid=25, filesize=5.0 K 2023-02-09 20:54:47,611 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for a405dceeac89784cda948f90b491cbc9 in 828ms, sequenceid=25, compaction requested=true 2023-02-09 20:54:47,611 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for a405dceeac89784cda948f90b491cbc9: 2023-02-09 20:54:47,612 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675976080230.a405dceeac89784cda948f90b491cbc9. 2023-02-09 20:54:47,612 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 20:54:47,612 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 20:54:47,612 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:47,612 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-02-09 20:54:47,612 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-02-09 20:54:47,613 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:47,613 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:47,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:47,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:54:47,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:54:47,614 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:47,614 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 20:54:47,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:54:47,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:54:47,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:47,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:47,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:54:47,615 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-02-09 20:54:47,615 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@419fbce1[Count = 0] remaining members to acquire global barrier 2023-02-09 20:54:47,615 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-02-09 20:54:47,615 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:47,616 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:47,616 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:47,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:47,616 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-02-09 20:54:47,616 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-02-09 20:54:47,616 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase9.apache.org,40919,1675976022294' in zk 2023-02-09 20:54:47,616 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:47,616 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 20:54:47,618 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-02-09 20:54:47,618 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:47,618 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:54:47,618 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-02-09 20:54:47,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:47,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:54:47,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:54:47,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:54:47,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:54:47,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:47,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:47,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:54:47,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:47,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:47,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase9.apache.org,40919,1675976022294': 2023-02-09 20:54:47,620 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-02-09 20:54:47,620 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-02-09 20:54:47,620 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 20:54:47,620 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 20:54:47,620 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:47,620 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 20:54:47,621 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:47,621 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:47,621 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:54:47,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:47,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:54:47,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:54:47,621 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:47,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:47,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:54:47,622 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:54:47,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:54:47,622 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:47,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:47,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:47,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:54:47,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:47,623 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:47,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:47,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:54:47,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:47,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:47,625 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:47,625 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:54:47,625 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:47,625 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:54:47,625 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:54:47,625 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:54:47,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:54:47,625 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-09 20:54:47,625 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 20:54:47,625 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:47,625 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:47,625 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:47,625 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:47,625 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:47,625 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:54:47,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:54:47,625 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-02-09 20:54:47,625 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 20:54:47,725 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 20:54:47,726 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 20:54:47,730 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(933): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-02-09 20:54:47,731 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-02-09 20:54:47,731 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:47,731 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-09 20:54:47,731 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:54:47,731 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-02-09 20:54:47,731 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-02-09 20:54:47,732 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:47,732 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:47,733 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:47,733 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:54:47,733 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:54:47,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:54:47,733 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:47,733 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 20:54:47,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:47,734 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:47,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 20:54:47,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:47,734 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:47,734 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-02-09 20:54:47,734 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:47,734 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-02-09 20:54:47,734 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:54:47,734 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-02-09 20:54:47,734 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 20:54:47,734 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 20:54:47,734 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675976080230.a405dceeac89784cda948f90b491cbc9. 2023-02-09 20:54:47,734 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675976080230.a405dceeac89784cda948f90b491cbc9. started... 2023-02-09 20:54:47,735 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing a405dceeac89784cda948f90b491cbc9 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-09 20:54:48,149 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601016901acb592e947cdbc0a925375dfbe3c to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201601016901acb592e947cdbc0a925375dfbe3c 2023-02-09 20:54:48,555 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a405dceeac89784cda948f90b491cbc9/.tmp/family1/c62bd25f3caa4e1d92ed98aea1525af7 2023-02-09 20:54:48,560 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a405dceeac89784cda948f90b491cbc9/.tmp/family1/c62bd25f3caa4e1d92ed98aea1525af7 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a405dceeac89784cda948f90b491cbc9/family1/c62bd25f3caa4e1d92ed98aea1525af7 2023-02-09 20:54:48,564 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a405dceeac89784cda948f90b491cbc9/family1/c62bd25f3caa4e1d92ed98aea1525af7, entries=1, sequenceid=29, filesize=5.0 K 2023-02-09 20:54:48,565 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for a405dceeac89784cda948f90b491cbc9 in 830ms, sequenceid=29, compaction requested=true 2023-02-09 20:54:48,565 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for a405dceeac89784cda948f90b491cbc9: 2023-02-09 20:54:48,565 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675976080230.a405dceeac89784cda948f90b491cbc9. 2023-02-09 20:54:48,565 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 20:54:48,565 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 20:54:48,566 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:48,566 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-02-09 20:54:48,566 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-02-09 20:54:48,568 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:48,568 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:48,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:48,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:54:48,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:54:48,568 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:48,568 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 20:54:48,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:54:48,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:54:48,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:48,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:48,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:54:48,570 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-02-09 20:54:48,570 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@50ad01bc[Count = 0] remaining members to acquire global barrier 2023-02-09 20:54:48,570 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-02-09 20:54:48,570 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:48,571 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:48,571 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:48,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:48,571 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-02-09 20:54:48,571 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-02-09 20:54:48,571 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase9.apache.org,40919,1675976022294' in zk 2023-02-09 20:54:48,571 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:48,571 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 20:54:48,572 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:48,572 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-02-09 20:54:48,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:48,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:54:48,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:54:48,572 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:54:48,572 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-02-09 20:54:48,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:54:48,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:54:48,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:48,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:48,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:54:48,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:48,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:48,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase9.apache.org,40919,1675976022294': 2023-02-09 20:54:48,575 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-02-09 20:54:48,575 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-02-09 20:54:48,575 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 20:54:48,575 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 20:54:48,575 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:48,575 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 20:54:48,580 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:48,580 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:48,580 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:48,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:48,580 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:54:48,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:48,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:54:48,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:54:48,580 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:48,580 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:54:48,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:54:48,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:54:48,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:48,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:48,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:54:48,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:48,581 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:48,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:48,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:54:48,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:48,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:48,583 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:48,583 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:48,583 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:48,583 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:48,583 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:48,583 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-09 20:54:48,583 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 20:54:48,583 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:54:48,583 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:48,583 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:54:48,583 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:54:48,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:54:48,583 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-02-09 20:54:48,583 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:48,583 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-02-09 20:54:48,583 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:54:48,583 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 20:54:48,584 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:54:48,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:54:48,684 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 20:54:48,685 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 20:54:48,688 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(933): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-02-09 20:54:48,690 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-02-09 20:54:48,690 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:48,690 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-09 20:54:48,690 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:54:48,690 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-02-09 20:54:48,690 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-02-09 20:54:48,690 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:48,691 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:48,692 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:54:48,692 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:48,692 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:54:48,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:54:48,692 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:48,692 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 20:54:48,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:48,692 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:48,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 20:54:48,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:48,693 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:48,693 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-02-09 20:54:48,693 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:48,693 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-02-09 20:54:48,693 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:54:48,693 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-02-09 20:54:48,693 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 20:54:48,693 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 20:54:48,693 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675976080230.a405dceeac89784cda948f90b491cbc9. 2023-02-09 20:54:48,693 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675976080230.a405dceeac89784cda948f90b491cbc9. started... 2023-02-09 20:54:48,693 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing a405dceeac89784cda948f90b491cbc9 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-09 20:54:49,106 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601032d30b36fded346dc94990f359fca4397 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201601032d30b36fded346dc94990f359fca4397 2023-02-09 20:54:49,511 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a405dceeac89784cda948f90b491cbc9/.tmp/family1/6e3ea3e2ca2048128f346f2bfbb3edc1 2023-02-09 20:54:49,515 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a405dceeac89784cda948f90b491cbc9/.tmp/family1/6e3ea3e2ca2048128f346f2bfbb3edc1 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a405dceeac89784cda948f90b491cbc9/family1/6e3ea3e2ca2048128f346f2bfbb3edc1 2023-02-09 20:54:49,519 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a405dceeac89784cda948f90b491cbc9/family1/6e3ea3e2ca2048128f346f2bfbb3edc1, entries=1, sequenceid=33, filesize=5.0 K 2023-02-09 20:54:49,519 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for a405dceeac89784cda948f90b491cbc9 in 826ms, sequenceid=33, compaction requested=true 2023-02-09 20:54:49,520 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for a405dceeac89784cda948f90b491cbc9: 2023-02-09 20:54:49,520 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675976080230.a405dceeac89784cda948f90b491cbc9. 2023-02-09 20:54:49,520 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 20:54:49,520 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 20:54:49,520 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:49,520 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-02-09 20:54:49,520 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-02-09 20:54:49,521 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:49,521 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:49,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:49,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:54:49,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:54:49,521 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:49,522 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 20:54:49,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:54:49,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:54:49,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:49,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:49,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:54:49,523 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-02-09 20:54:49,523 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@59d6baff[Count = 0] remaining members to acquire global barrier 2023-02-09 20:54:49,523 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-02-09 20:54:49,523 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:49,525 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:49,525 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:49,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:49,525 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-02-09 20:54:49,525 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-02-09 20:54:49,525 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:49,525 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 20:54:49,525 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase9.apache.org,40919,1675976022294' in zk 2023-02-09 20:54:49,526 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:49,526 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-02-09 20:54:49,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:49,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:54:49,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:54:49,526 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:54:49,526 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-02-09 20:54:49,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:54:49,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:54:49,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:49,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:49,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:54:49,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:49,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:49,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase9.apache.org,40919,1675976022294': 2023-02-09 20:54:49,528 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-02-09 20:54:49,528 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-02-09 20:54:49,528 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 20:54:49,528 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 20:54:49,528 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:49,528 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 20:54:49,530 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:49,530 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:49,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:49,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:54:49,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:54:49,530 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:49,530 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:54:49,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:49,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:54:49,530 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:54:49,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:54:49,530 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:49,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:49,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:49,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:54:49,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:49,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:49,531 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:49,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:54:49,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:49,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:49,533 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:49,533 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:49,533 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:54:49,533 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:49,533 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:54:49,533 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-09 20:54:49,534 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 20:54:49,533 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:54:49,533 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:49,533 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:54:49,534 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-02-09 20:54:49,534 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 20:54:49,534 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:49,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:54:49,534 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:49,534 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:49,534 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:54:49,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:54:49,634 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 20:54:49,635 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 20:54:49,638 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(933): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-02-09 20:54:49,640 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-02-09 20:54:49,640 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:49,640 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-09 20:54:49,640 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:54:49,640 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-02-09 20:54:49,640 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-02-09 20:54:49,640 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:49,641 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:49,641 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:49,641 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:54:49,642 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:54:49,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:54:49,642 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:49,642 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 20:54:49,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:49,642 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:49,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 20:54:49,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:49,642 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:49,643 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-02-09 20:54:49,643 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:49,643 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-02-09 20:54:49,643 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:54:49,643 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-02-09 20:54:49,643 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 20:54:49,643 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 20:54:49,643 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675976080230.a405dceeac89784cda948f90b491cbc9. 2023-02-09 20:54:49,643 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675976080230.a405dceeac89784cda948f90b491cbc9. started... 2023-02-09 20:54:49,643 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing a405dceeac89784cda948f90b491cbc9 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-09 20:54:50,057 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907a066e56711db4e43aedf78b5916e990c to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20150907a066e56711db4e43aedf78b5916e990c 2023-02-09 20:54:50,463 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a405dceeac89784cda948f90b491cbc9/.tmp/family1/ed250814a7084cee8005c4a6f28637fb 2023-02-09 20:54:50,467 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a405dceeac89784cda948f90b491cbc9/.tmp/family1/ed250814a7084cee8005c4a6f28637fb as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a405dceeac89784cda948f90b491cbc9/family1/ed250814a7084cee8005c4a6f28637fb 2023-02-09 20:54:50,471 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a405dceeac89784cda948f90b491cbc9/family1/ed250814a7084cee8005c4a6f28637fb, entries=1, sequenceid=37, filesize=5.0 K 2023-02-09 20:54:50,472 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for a405dceeac89784cda948f90b491cbc9 in 829ms, sequenceid=37, compaction requested=true 2023-02-09 20:54:50,472 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for a405dceeac89784cda948f90b491cbc9: 2023-02-09 20:54:50,472 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675976080230.a405dceeac89784cda948f90b491cbc9. 2023-02-09 20:54:50,472 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 20:54:50,472 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 20:54:50,472 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:50,472 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-02-09 20:54:50,472 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-02-09 20:54:50,473 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:50,473 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:50,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:50,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:54:50,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:54:50,474 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:50,474 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 20:54:50,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:54:50,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:54:50,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:50,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:50,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:54:50,475 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-02-09 20:54:50,475 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7cd94046[Count = 0] remaining members to acquire global barrier 2023-02-09 20:54:50,475 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-02-09 20:54:50,475 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:50,476 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:50,476 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:50,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:50,476 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-02-09 20:54:50,476 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-02-09 20:54:50,476 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase9.apache.org,40919,1675976022294' in zk 2023-02-09 20:54:50,476 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:50,476 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 20:54:50,478 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:50,478 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-02-09 20:54:50,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:50,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:54:50,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:54:50,478 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:54:50,478 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-02-09 20:54:50,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:54:50,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:54:50,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:50,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:50,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:54:50,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:50,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:50,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase9.apache.org,40919,1675976022294': 2023-02-09 20:54:50,480 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-02-09 20:54:50,480 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-02-09 20:54:50,480 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 20:54:50,480 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 20:54:50,480 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:50,480 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 20:54:50,482 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:50,482 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:50,482 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:50,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:50,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:54:50,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:54:50,482 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:54:50,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:50,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:54:50,482 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:54:50,482 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:50,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:54:50,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:50,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:50,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:54:50,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:50,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:50,483 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:50,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:54:50,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:50,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:50,487 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:50,488 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:50,488 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:54:50,488 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:54:50,488 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:50,488 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:54:50,488 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:54:50,488 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-09 20:54:50,488 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 20:54:50,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:54:50,488 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:50,488 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:50,488 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:50,488 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:50,488 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-02-09 20:54:50,488 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:54:50,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:54:50,488 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 20:54:50,588 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 20:54:50,589 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 20:54:50,593 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(933): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-02-09 20:54:50,595 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-02-09 20:54:50,595 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:50,595 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-09 20:54:50,595 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:54:50,595 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-02-09 20:54:50,595 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-02-09 20:54:50,595 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:50,595 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:50,597 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:50,597 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:54:50,598 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:54:50,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:54:50,598 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:50,598 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 20:54:50,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:50,598 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:50,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 20:54:50,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:50,598 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:50,599 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-02-09 20:54:50,599 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:50,599 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-02-09 20:54:50,599 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:54:50,599 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-02-09 20:54:50,599 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 20:54:50,599 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 20:54:50,599 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675976080230.a405dceeac89784cda948f90b491cbc9. 2023-02-09 20:54:50,599 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675976080230.a405dceeac89784cda948f90b491cbc9. started... 2023-02-09 20:54:50,599 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing a405dceeac89784cda948f90b491cbc9 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-09 20:54:51,012 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112043019f03d46c469fb70fc45e7edd5a4f to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015112043019f03d46c469fb70fc45e7edd5a4f 2023-02-09 20:54:51,417 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a405dceeac89784cda948f90b491cbc9/.tmp/family1/051d6ce1e446485496b10d427c9648bb 2023-02-09 20:54:51,422 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a405dceeac89784cda948f90b491cbc9/.tmp/family1/051d6ce1e446485496b10d427c9648bb as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a405dceeac89784cda948f90b491cbc9/family1/051d6ce1e446485496b10d427c9648bb 2023-02-09 20:54:51,425 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a405dceeac89784cda948f90b491cbc9/family1/051d6ce1e446485496b10d427c9648bb, entries=1, sequenceid=41, filesize=5.0 K 2023-02-09 20:54:51,426 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for a405dceeac89784cda948f90b491cbc9 in 827ms, sequenceid=41, compaction requested=true 2023-02-09 20:54:51,426 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for a405dceeac89784cda948f90b491cbc9: 2023-02-09 20:54:51,426 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675976080230.a405dceeac89784cda948f90b491cbc9. 2023-02-09 20:54:51,426 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 20:54:51,426 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 20:54:51,426 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:51,426 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-02-09 20:54:51,426 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-02-09 20:54:51,428 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:51,428 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:51,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:51,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:54:51,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:54:51,428 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:51,428 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 20:54:51,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:54:51,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:54:51,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:51,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:51,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:54:51,429 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-02-09 20:54:51,429 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@401d9388[Count = 0] remaining members to acquire global barrier 2023-02-09 20:54:51,429 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-02-09 20:54:51,429 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:51,430 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:51,430 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:51,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:51,431 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-02-09 20:54:51,431 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-02-09 20:54:51,431 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase9.apache.org,40919,1675976022294' in zk 2023-02-09 20:54:51,431 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:51,431 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 20:54:51,432 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:51,432 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-02-09 20:54:51,432 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:54:51,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:51,432 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-02-09 20:54:51,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:54:51,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:54:51,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:54:51,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:54:51,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:51,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:51,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:54:51,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:51,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:51,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase9.apache.org,40919,1675976022294': 2023-02-09 20:54:51,434 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-02-09 20:54:51,434 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-02-09 20:54:51,434 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 20:54:51,434 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 20:54:51,434 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:51,434 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 20:54:51,437 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:51,437 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:51,437 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:51,437 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:54:51,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:51,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:54:51,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:54:51,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:51,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:54:51,437 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:51,437 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:54:51,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:54:51,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:51,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:51,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:54:51,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:51,439 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:51,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:51,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:54:51,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:51,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:51,440 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:51,441 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:54:51,441 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:51,441 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:54:51,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:54:51,441 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:54:51,441 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-09 20:54:51,441 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 20:54:51,441 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:51,441 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:54:51,441 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:51,441 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:54:51,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:54:51,441 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:51,441 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-02-09 20:54:51,441 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 20:54:51,441 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:51,441 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:51,541 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 20:54:51,542 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 20:54:51,544 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=42951] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:51,545 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1675976025848] procedure2.ProcedureExecutor(1029): Stored pid=42, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-02-09 20:54:51,546 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=42, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-02-09 20:54:51,546 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1675976025848] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-09 20:54:51,546 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=42, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1675976691546 2023-02-09 20:54:51,549 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1675976025848] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-09 20:54:51,549 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1675976025848] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-02-09 20:54:51,550 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1675976025848] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-09 20:54:51,550 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1675976025848] zookeeper.ReadOnlyZKClient(139): Connect 0x36dbaa6e to 127.0.0.1:62089 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 20:54:51,553 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1675976025848] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@57a69747, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 20:54:51,553 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-09 20:54:52,389 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601038f6c0916a6e045f5bc3653f836177dd7 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201601038f6c0916a6e045f5bc3653f836177dd7 2023-02-09 20:54:52,390 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-09 20:54:52,402 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 20:54:52,404 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:54198, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 20:54:52,410 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-09 20:54:52,412 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:41594, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-09 20:54:52,420 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/9d540d12882942c39e6124751dd5389b first=Optional[r3] last=Optional[r6] 2023-02-09 20:54:52,421 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675976080230.a405dceeac89784cda948f90b491cbc9., hostname=jenkins-hbase9.apache.org,40919,1675976022294, seqNum=2 for row with hfile group [{family1,hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/9d540d12882942c39e6124751dd5389b}] 2023-02-09 20:54:52,425 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HStore(763): Validating hfile at hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/9d540d12882942c39e6124751dd5389b for inclusion in a405dceeac89784cda948f90b491cbc9/family1 2023-02-09 20:54:52,427 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-02-09 20:54:52,427 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HStore(777): Region bounds: first= last= 2023-02-09 20:54:52,428 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HRegion(2445): Flush status journal for a405dceeac89784cda948f90b491cbc9: 2023-02-09 20:54:52,428 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/9d540d12882942c39e6124751dd5389b to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__inbqqschd5jue5ujtdldqqc9hahoemteedejkvjp7fnv2bhhncait57ce5pfde5k/family1/9d540d12882942c39e6124751dd5389b 2023-02-09 20:54:52,430 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__inbqqschd5jue5ujtdldqqc9hahoemteedejkvjp7fnv2bhhncait57ce5pfde5k/family1/9d540d12882942c39e6124751dd5389b as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a405dceeac89784cda948f90b491cbc9/family1/f9895ae4216f4af1b62940584fd4abeb_SeqId_44_ 2023-02-09 20:54:52,431 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HStore(849): Loaded HFile hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__inbqqschd5jue5ujtdldqqc9hahoemteedejkvjp7fnv2bhhncait57ce5pfde5k/family1/9d540d12882942c39e6124751dd5389b into a405dceeac89784cda948f90b491cbc9/family1 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a405dceeac89784cda948f90b491cbc9/family1/f9895ae4216f4af1b62940584fd4abeb_SeqId_44_ - updating store file list. 2023-02-09 20:54:52,434 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HStore(882): Loaded HFile hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a405dceeac89784cda948f90b491cbc9/family1/f9895ae4216f4af1b62940584fd4abeb_SeqId_44_ into a405dceeac89784cda948f90b491cbc9/family1 2023-02-09 20:54:52,434 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HStore(855): Successfully loaded hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__inbqqschd5jue5ujtdldqqc9hahoemteedejkvjp7fnv2bhhncait57ce5pfde5k/family1/9d540d12882942c39e6124751dd5389b into a405dceeac89784cda948f90b491cbc9/family1 (new location: hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a405dceeac89784cda948f90b491cbc9/family1/f9895ae4216f4af1b62940584fd4abeb_SeqId_44_) 2023-02-09 20:54:52,435 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__inbqqschd5jue5ujtdldqqc9hahoemteedejkvjp7fnv2bhhncait57ce5pfde5k/family1/9d540d12882942c39e6124751dd5389b 2023-02-09 20:54:52,435 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-02-09 20:54:52,437 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51565 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-02-09 20:54:52,438 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HStore(1912): a405dceeac89784cda948f90b491cbc9/family1 is initiating minor compaction 2023-02-09 20:54:52,438 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@ec77848; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-09 20:54:52,438 INFO [RS:0;jenkins-hbase9:40919-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of a405dceeac89784cda948f90b491cbc9/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675976080230.a405dceeac89784cda948f90b491cbc9. 2023-02-09 20:54:52,438 INFO [RS:0;jenkins-hbase9:40919-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a405dceeac89784cda948f90b491cbc9/family1/b295c00bf95e42bcab90378771bce433, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a405dceeac89784cda948f90b491cbc9/family1/e83b524810844ae99f09a3a1017eedc5, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a405dceeac89784cda948f90b491cbc9/family1/8eda028eaf3c4776a7a2cd9be88bba3b, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a405dceeac89784cda948f90b491cbc9/family1/574bd463ed3b4c308fd8f8caafad7f9d, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a405dceeac89784cda948f90b491cbc9/family1/45fa5fbde61547d5accb006f4b106104, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a405dceeac89784cda948f90b491cbc9/family1/c62bd25f3caa4e1d92ed98aea1525af7, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a405dceeac89784cda948f90b491cbc9/family1/6e3ea3e2ca2048128f346f2bfbb3edc1, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a405dceeac89784cda948f90b491cbc9/family1/ed250814a7084cee8005c4a6f28637fb, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a405dceeac89784cda948f90b491cbc9/family1/051d6ce1e446485496b10d427c9648bb, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a405dceeac89784cda948f90b491cbc9/family1/f9895ae4216f4af1b62940584fd4abeb_SeqId_44_] into tmpdir=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a405dceeac89784cda948f90b491cbc9/.tmp, totalSize=50.4 K 2023-02-09 20:54:52,438 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] compactions.Compactor(207): Compacting b295c00bf95e42bcab90378771bce433, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-02-09 20:54:52,438 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] compactions.Compactor(207): Compacting e83b524810844ae99f09a3a1017eedc5, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-02-09 20:54:52,438 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] compactions.Compactor(207): Compacting 8eda028eaf3c4776a7a2cd9be88bba3b, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-02-09 20:54:52,438 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] compactions.Compactor(207): Compacting 574bd463ed3b4c308fd8f8caafad7f9d, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-02-09 20:54:52,438 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] compactions.Compactor(207): Compacting 45fa5fbde61547d5accb006f4b106104, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-02-09 20:54:52,438 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] compactions.Compactor(207): Compacting c62bd25f3caa4e1d92ed98aea1525af7, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-02-09 20:54:52,438 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] compactions.Compactor(207): Compacting 6e3ea3e2ca2048128f346f2bfbb3edc1, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-02-09 20:54:52,438 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] compactions.Compactor(207): Compacting ed250814a7084cee8005c4a6f28637fb, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-02-09 20:54:52,438 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] compactions.Compactor(207): Compacting 051d6ce1e446485496b10d427c9648bb, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-02-09 20:54:52,438 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] compactions.Compactor(207): Compacting f9895ae4216f4af1b62940584fd4abeb_SeqId_44_, keycount=4, bloomtype=ROW, size=5.6 K, encoding=NONE, compression=NONE, seqNum=45 2023-02-09 20:54:52,440 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-09 20:54:52,440 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 20:54:52,442 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151228a0152802bdd14f798893575a1d1c3454 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151228a0152802bdd14f798893575a1d1c3454 2023-02-09 20:54:52,443 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151231bebc98c7429d49f1bc0a3f7af51cc729 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151231bebc98c7429d49f1bc0a3f7af51cc729 2023-02-09 20:54:52,445 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201601016901acb592e947cdbc0a925375dfbe3c to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201601016901acb592e947cdbc0a925375dfbe3c 2023-02-09 20:54:52,446 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201601032d30b36fded346dc94990f359fca4397 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201601032d30b36fded346dc94990f359fca4397 2023-02-09 20:54:52,446 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 4 expired mob files are deleted 2023-02-09 20:54:52,446 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-02-09 20:54:52,447 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-09 20:54:52,447 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-09 20:54:52,447 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-09 20:54:52,447 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-09 20:54:52,447 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-09 20:54:52,447 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-09 20:54:52,447 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-09 20:54:52,447 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-09 20:54:52,473 INFO [RS:0;jenkins-hbase9:40919-shortCompactions-0] throttle.PressureAwareThroughputController(145): a405dceeac89784cda948f90b491cbc9#family1#compaction#60 average throughput is 0.79 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-09 20:54:53,294 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a405dceeac89784cda948f90b491cbc9/.tmp/family1/a1e88c03c8df406e94e2ef836cf0f814 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a405dceeac89784cda948f90b491cbc9/family1/a1e88c03c8df406e94e2ef836cf0f814 2023-02-09 20:54:53,298 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205024356fd8eac4d08ac2e1463dbc57847 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151205024356fd8eac4d08ac2e1463dbc57847 2023-02-09 20:54:53,299 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-09 20:54:53,300 INFO [RS:0;jenkins-hbase9:40919-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in a405dceeac89784cda948f90b491cbc9/family1 of a405dceeac89784cda948f90b491cbc9 into a1e88c03c8df406e94e2ef836cf0f814(size=6.8 K), total size for store is 198.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-09 20:54:53,300 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for a405dceeac89784cda948f90b491cbc9: 2023-02-09 20:54:53,300 INFO [RS:0;jenkins-hbase9:40919-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675976080230.a405dceeac89784cda948f90b491cbc9., storeName=family1, fileCount=10, fileSize=50.4 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.6 K), priority=2, time=1675976092438; duration=0sec 2023-02-09 20:54:53,300 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-09 20:54:53,324 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/2a0315b8da384a5b9d4498aa2a0e188b first=Optional[r00] last=Optional[r2] 2023-02-09 20:54:53,325 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675976080230.a405dceeac89784cda948f90b491cbc9., hostname=jenkins-hbase9.apache.org,40919,1675976022294, seqNum=2 for row with hfile group [{family1,hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/2a0315b8da384a5b9d4498aa2a0e188b}] 2023-02-09 20:54:53,327 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HStore(763): Validating hfile at hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/2a0315b8da384a5b9d4498aa2a0e188b for inclusion in a405dceeac89784cda948f90b491cbc9/family1 2023-02-09 20:54:53,329 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-02-09 20:54:53,329 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HStore(777): Region bounds: first= last= 2023-02-09 20:54:53,329 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HRegion(2445): Flush status journal for a405dceeac89784cda948f90b491cbc9: 2023-02-09 20:54:53,330 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/2a0315b8da384a5b9d4498aa2a0e188b to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__i03ssk4f0og0nrohfp95joptkrn5o3ltqv0utbpu5q8up9ehlhsguc4utr6vpsk3/family1/2a0315b8da384a5b9d4498aa2a0e188b 2023-02-09 20:54:53,332 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__i03ssk4f0og0nrohfp95joptkrn5o3ltqv0utbpu5q8up9ehlhsguc4utr6vpsk3/family1/2a0315b8da384a5b9d4498aa2a0e188b as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a405dceeac89784cda948f90b491cbc9/family1/bf2c8b51ce804511b567e5b156822f56_SeqId_47_ 2023-02-09 20:54:53,333 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HStore(849): Loaded HFile hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__i03ssk4f0og0nrohfp95joptkrn5o3ltqv0utbpu5q8up9ehlhsguc4utr6vpsk3/family1/2a0315b8da384a5b9d4498aa2a0e188b into a405dceeac89784cda948f90b491cbc9/family1 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a405dceeac89784cda948f90b491cbc9/family1/bf2c8b51ce804511b567e5b156822f56_SeqId_47_ - updating store file list. 2023-02-09 20:54:53,336 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HStore(882): Loaded HFile hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a405dceeac89784cda948f90b491cbc9/family1/bf2c8b51ce804511b567e5b156822f56_SeqId_47_ into a405dceeac89784cda948f90b491cbc9/family1 2023-02-09 20:54:53,336 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HStore(855): Successfully loaded hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__i03ssk4f0og0nrohfp95joptkrn5o3ltqv0utbpu5q8up9ehlhsguc4utr6vpsk3/family1/2a0315b8da384a5b9d4498aa2a0e188b into a405dceeac89784cda948f90b491cbc9/family1 (new location: hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a405dceeac89784cda948f90b491cbc9/family1/bf2c8b51ce804511b567e5b156822f56_SeqId_47_) 2023-02-09 20:54:53,336 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__i03ssk4f0og0nrohfp95joptkrn5o3ltqv0utbpu5q8up9ehlhsguc4utr6vpsk3/family1/2a0315b8da384a5b9d4498aa2a0e188b 2023-02-09 20:54:53,336 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-02-09 20:54:53,337 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 399433 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-02-09 20:54:53,337 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HStore(1912): a405dceeac89784cda948f90b491cbc9/family1 is initiating minor compaction (all files) 2023-02-09 20:54:53,338 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@710dd18d; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-09 20:54:53,338 INFO [RS:0;jenkins-hbase9:40919-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of a405dceeac89784cda948f90b491cbc9/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675976080230.a405dceeac89784cda948f90b491cbc9. 2023-02-09 20:54:53,338 INFO [RS:0;jenkins-hbase9:40919-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a405dceeac89784cda948f90b491cbc9/family1/fe1a43f5123b4da9bb2c7d62e3456cba, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a405dceeac89784cda948f90b491cbc9/family1/a1e88c03c8df406e94e2ef836cf0f814, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a405dceeac89784cda948f90b491cbc9/family1/bf2c8b51ce804511b567e5b156822f56_SeqId_47_] into tmpdir=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a405dceeac89784cda948f90b491cbc9/.tmp, totalSize=390.1 K 2023-02-09 20:54:53,338 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] compactions.Compactor(207): Compacting fe1a43f5123b4da9bb2c7d62e3456cba, keycount=1000, bloomtype=ROW, size=191.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878845982 2023-02-09 20:54:53,338 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] compactions.Compactor(207): Compacting a1e88c03c8df406e94e2ef836cf0f814, keycount=9, bloomtype=ROW, size=6.8 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621245982 2023-02-09 20:54:53,339 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] compactions.Compactor(207): Compacting bf2c8b51ce804511b567e5b156822f56_SeqId_47_, keycount=1002, bloomtype=ROW, size=191.8 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878845982 2023-02-09 20:54:53,339 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-09 20:54:53,340 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 20:54:53,341 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151130d7a27c3ac05d45ae9f1d9ee867dae637 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151130d7a27c3ac05d45ae9f1d9ee867dae637 2023-02-09 20:54:53,343 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151201c998a52aeb8b4bdfb69fcc41877a35ef to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151201c998a52aeb8b4bdfb69fcc41877a35ef 2023-02-09 20:54:53,344 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151205cc2348d3d0e7469ea0561cf425a0ac5e to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151205cc2348d3d0e7469ea0561cf425a0ac5e 2023-02-09 20:54:53,344 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 3 expired mob files are deleted 2023-02-09 20:54:53,344 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-02-09 20:54:53,345 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-09 20:54:53,345 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1675976025848] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-09 20:54:53,345 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1675976025848] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-09 20:54:53,346 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=42, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-02-09 20:54:53,347 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=42, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 1.8020 sec 2023-02-09 20:54:53,353 INFO [RS:0;jenkins-hbase9:40919-shortCompactions-0] throttle.PressureAwareThroughputController(145): a405dceeac89784cda948f90b491cbc9#family1#compaction#61 average throughput is 25.80 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-09 20:54:53,368 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a405dceeac89784cda948f90b491cbc9/family1/b295c00bf95e42bcab90378771bce433, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a405dceeac89784cda948f90b491cbc9/family1/e83b524810844ae99f09a3a1017eedc5, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a405dceeac89784cda948f90b491cbc9/family1/8eda028eaf3c4776a7a2cd9be88bba3b, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a405dceeac89784cda948f90b491cbc9/family1/574bd463ed3b4c308fd8f8caafad7f9d, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a405dceeac89784cda948f90b491cbc9/family1/45fa5fbde61547d5accb006f4b106104, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a405dceeac89784cda948f90b491cbc9/family1/c62bd25f3caa4e1d92ed98aea1525af7, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a405dceeac89784cda948f90b491cbc9/family1/6e3ea3e2ca2048128f346f2bfbb3edc1, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a405dceeac89784cda948f90b491cbc9/family1/ed250814a7084cee8005c4a6f28637fb, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a405dceeac89784cda948f90b491cbc9/family1/051d6ce1e446485496b10d427c9648bb, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a405dceeac89784cda948f90b491cbc9/family1/f9895ae4216f4af1b62940584fd4abeb_SeqId_44_] to archive 2023-02-09 20:54:53,369 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 20:54:53,370 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a405dceeac89784cda948f90b491cbc9/family1/b295c00bf95e42bcab90378771bce433 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a405dceeac89784cda948f90b491cbc9/family1/b295c00bf95e42bcab90378771bce433 2023-02-09 20:54:53,372 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a405dceeac89784cda948f90b491cbc9/family1/e83b524810844ae99f09a3a1017eedc5 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a405dceeac89784cda948f90b491cbc9/family1/e83b524810844ae99f09a3a1017eedc5 2023-02-09 20:54:53,373 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a405dceeac89784cda948f90b491cbc9/family1/8eda028eaf3c4776a7a2cd9be88bba3b to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a405dceeac89784cda948f90b491cbc9/family1/8eda028eaf3c4776a7a2cd9be88bba3b 2023-02-09 20:54:53,374 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a405dceeac89784cda948f90b491cbc9/family1/574bd463ed3b4c308fd8f8caafad7f9d to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a405dceeac89784cda948f90b491cbc9/family1/574bd463ed3b4c308fd8f8caafad7f9d 2023-02-09 20:54:53,376 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a405dceeac89784cda948f90b491cbc9/family1/45fa5fbde61547d5accb006f4b106104 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a405dceeac89784cda948f90b491cbc9/family1/45fa5fbde61547d5accb006f4b106104 2023-02-09 20:54:53,377 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a405dceeac89784cda948f90b491cbc9/family1/c62bd25f3caa4e1d92ed98aea1525af7 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a405dceeac89784cda948f90b491cbc9/family1/c62bd25f3caa4e1d92ed98aea1525af7 2023-02-09 20:54:53,378 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a405dceeac89784cda948f90b491cbc9/family1/6e3ea3e2ca2048128f346f2bfbb3edc1 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a405dceeac89784cda948f90b491cbc9/family1/6e3ea3e2ca2048128f346f2bfbb3edc1 2023-02-09 20:54:53,380 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a405dceeac89784cda948f90b491cbc9/family1/ed250814a7084cee8005c4a6f28637fb to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a405dceeac89784cda948f90b491cbc9/family1/ed250814a7084cee8005c4a6f28637fb 2023-02-09 20:54:53,381 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a405dceeac89784cda948f90b491cbc9/family1/051d6ce1e446485496b10d427c9648bb to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a405dceeac89784cda948f90b491cbc9/family1/051d6ce1e446485496b10d427c9648bb 2023-02-09 20:54:53,383 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a405dceeac89784cda948f90b491cbc9/family1/f9895ae4216f4af1b62940584fd4abeb_SeqId_44_ to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a405dceeac89784cda948f90b491cbc9/family1/f9895ae4216f4af1b62940584fd4abeb_SeqId_44_ 2023-02-09 20:54:53,427 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.HMaster$12(2441): Client=jenkins//172.31.2.10 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-02-09 20:54:53,429 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure2.ProcedureExecutor(1029): Stored pid=43, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:53,839 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-02-09 20:54:53,840 DEBUG [PEWorker-5] util.FSTableDescriptors(519): Deleted hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000001 2023-02-09 20:54:53,840 INFO [PEWorker-5] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-02-09 20:54:53,842 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=44, ppid=43, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly}] 2023-02-09 20:54:53,845 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=a405dceeac89784cda948f90b491cbc9, REOPEN/MOVE}] 2023-02-09 20:54:53,845 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=a405dceeac89784cda948f90b491cbc9, REOPEN/MOVE 2023-02-09 20:54:53,846 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=a405dceeac89784cda948f90b491cbc9, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:53,846 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675976080230.a405dceeac89784cda948f90b491cbc9.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1675976093846"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675976093846"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675976093846"}]},"ts":"1675976093846"} 2023-02-09 20:54:53,847 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=45, state=RUNNABLE; CloseRegionProcedure a405dceeac89784cda948f90b491cbc9, server=jenkins-hbase9.apache.org,40919,1675976022294}] 2023-02-09 20:54:53,999 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(109): Close a405dceeac89784cda948f90b491cbc9 2023-02-09 20:54:53,999 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing a405dceeac89784cda948f90b491cbc9, disabling compactions & flushes 2023-02-09 20:54:53,999 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1857): waiting for 1 compactions to complete for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675976080230.a405dceeac89784cda948f90b491cbc9. 2023-02-09 20:54:54,569 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a405dceeac89784cda948f90b491cbc9/.tmp/family1/6701a289f75a40c5ab1bea4a761940e1 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a405dceeac89784cda948f90b491cbc9/family1/6701a289f75a40c5ab1bea4a761940e1 2023-02-09 20:54:54,573 INFO [RS:0;jenkins-hbase9:40919-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in a405dceeac89784cda948f90b491cbc9/family1 of a405dceeac89784cda948f90b491cbc9 into 6701a289f75a40c5ab1bea4a761940e1(size=193.0 K), total size for store is 193.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-09 20:54:54,573 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for a405dceeac89784cda948f90b491cbc9: 2023-02-09 20:54:54,573 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675976080230.a405dceeac89784cda948f90b491cbc9. 2023-02-09 20:54:54,574 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675976080230.a405dceeac89784cda948f90b491cbc9. 2023-02-09 20:54:54,574 INFO [RS:0;jenkins-hbase9:40919-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675976080230.a405dceeac89784cda948f90b491cbc9., storeName=family1, fileCount=3, fileSize=390.1 K (191.4 K, 6.8 K, 191.8 K), priority=2, time=1675976093337; duration=1sec 2023-02-09 20:54:54,574 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675976080230.a405dceeac89784cda948f90b491cbc9. after waiting 0 ms 2023-02-09 20:54:54,574 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675976080230.a405dceeac89784cda948f90b491cbc9. 2023-02-09 20:54:54,574 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-09 20:54:54,574 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675976080230.a405dceeac89784cda948f90b491cbc9.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a405dceeac89784cda948f90b491cbc9/family1/fe1a43f5123b4da9bb2c7d62e3456cba, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a405dceeac89784cda948f90b491cbc9/family1/a1e88c03c8df406e94e2ef836cf0f814, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a405dceeac89784cda948f90b491cbc9/family1/bf2c8b51ce804511b567e5b156822f56_SeqId_47_] to archive 2023-02-09 20:54:54,575 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675976080230.a405dceeac89784cda948f90b491cbc9.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 20:54:54,576 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675976080230.a405dceeac89784cda948f90b491cbc9.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a405dceeac89784cda948f90b491cbc9/family1/fe1a43f5123b4da9bb2c7d62e3456cba to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a405dceeac89784cda948f90b491cbc9/family1/fe1a43f5123b4da9bb2c7d62e3456cba 2023-02-09 20:54:54,578 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675976080230.a405dceeac89784cda948f90b491cbc9.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a405dceeac89784cda948f90b491cbc9/family1/a1e88c03c8df406e94e2ef836cf0f814 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a405dceeac89784cda948f90b491cbc9/family1/a1e88c03c8df406e94e2ef836cf0f814 2023-02-09 20:54:54,579 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675976080230.a405dceeac89784cda948f90b491cbc9.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a405dceeac89784cda948f90b491cbc9/family1/bf2c8b51ce804511b567e5b156822f56_SeqId_47_ to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a405dceeac89784cda948f90b491cbc9/family1/bf2c8b51ce804511b567e5b156822f56_SeqId_47_ 2023-02-09 20:54:54,584 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a405dceeac89784cda948f90b491cbc9/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-02-09 20:54:54,585 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675976080230.a405dceeac89784cda948f90b491cbc9. 2023-02-09 20:54:54,585 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for a405dceeac89784cda948f90b491cbc9: Waiting for close lock at 1675976093999Running coprocessor pre-close hooks at 1675976093999Disabling compacts and flushes for region at 1675976093999Disabling writes for close at 1675976094574 (+575 ms)Writing region close event to WAL at 1675976094581 (+7 ms)Running coprocessor post-close hooks at 1675976094584 (+3 ms)Closed at 1675976094585 (+1 ms) 2023-02-09 20:54:54,585 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(3509): Not adding moved region record: a405dceeac89784cda948f90b491cbc9 to self. 2023-02-09 20:54:54,586 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(147): Closed a405dceeac89784cda948f90b491cbc9 2023-02-09 20:54:54,586 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=a405dceeac89784cda948f90b491cbc9, regionState=CLOSED 2023-02-09 20:54:54,587 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675976080230.a405dceeac89784cda948f90b491cbc9.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1675976094586"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675976094586"}]},"ts":"1675976094586"} 2023-02-09 20:54:54,589 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=45 2023-02-09 20:54:54,589 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=45, state=SUCCESS; CloseRegionProcedure a405dceeac89784cda948f90b491cbc9, server=jenkins-hbase9.apache.org,40919,1675976022294 in 741 msec 2023-02-09 20:54:54,590 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=a405dceeac89784cda948f90b491cbc9, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase9.apache.org,40919,1675976022294; forceNewPlan=false, retain=true 2023-02-09 20:54:54,740 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=a405dceeac89784cda948f90b491cbc9, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:54,740 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675976080230.a405dceeac89784cda948f90b491cbc9.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1675976094740"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675976094740"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675976094740"}]},"ts":"1675976094740"} 2023-02-09 20:54:54,742 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=47, ppid=45, state=RUNNABLE; OpenRegionProcedure a405dceeac89784cda948f90b491cbc9, server=jenkins-hbase9.apache.org,40919,1675976022294}] 2023-02-09 20:54:54,896 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675976080230.a405dceeac89784cda948f90b491cbc9. 2023-02-09 20:54:54,896 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => a405dceeac89784cda948f90b491cbc9, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675976080230.a405dceeac89784cda948f90b491cbc9.', STARTKEY => '', ENDKEY => ''} 2023-02-09 20:54:54,896 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly a405dceeac89784cda948f90b491cbc9 2023-02-09 20:54:54,897 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675976080230.a405dceeac89784cda948f90b491cbc9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 20:54:54,897 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for a405dceeac89784cda948f90b491cbc9 2023-02-09 20:54:54,897 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for a405dceeac89784cda948f90b491cbc9 2023-02-09 20:54:54,898 INFO [StoreOpener-a405dceeac89784cda948f90b491cbc9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region a405dceeac89784cda948f90b491cbc9 2023-02-09 20:54:54,899 DEBUG [StoreOpener-a405dceeac89784cda948f90b491cbc9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a405dceeac89784cda948f90b491cbc9/family1 2023-02-09 20:54:54,899 DEBUG [StoreOpener-a405dceeac89784cda948f90b491cbc9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a405dceeac89784cda948f90b491cbc9/family1 2023-02-09 20:54:54,899 INFO [StoreOpener-a405dceeac89784cda948f90b491cbc9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a405dceeac89784cda948f90b491cbc9 columnFamilyName family1 2023-02-09 20:54:54,903 DEBUG [StoreOpener-a405dceeac89784cda948f90b491cbc9-1] regionserver.HStore(539): loaded hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a405dceeac89784cda948f90b491cbc9/family1/6701a289f75a40c5ab1bea4a761940e1 2023-02-09 20:54:54,904 INFO [StoreOpener-a405dceeac89784cda948f90b491cbc9-1] regionserver.HStore(310): Store=a405dceeac89784cda948f90b491cbc9/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 20:54:54,904 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a405dceeac89784cda948f90b491cbc9 2023-02-09 20:54:54,905 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a405dceeac89784cda948f90b491cbc9 2023-02-09 20:54:54,908 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for a405dceeac89784cda948f90b491cbc9 2023-02-09 20:54:54,908 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened a405dceeac89784cda948f90b491cbc9; next sequenceid=51; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66970292, jitterRate=-0.0020648837089538574}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-09 20:54:54,908 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for a405dceeac89784cda948f90b491cbc9: Running coprocessor pre-open hook at 1675976094897Writing region info on filesystem at 1675976094897Initializing all the Stores at 1675976094897Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} at 1675976094897Cleaning up temporary data from old regions at 1675976094906 (+9 ms)Cleaning up detritus from prior splits at 1675976094906Running coprocessor post-open hooks at 1675976094908 (+2 ms)Region opened successfully at 1675976094908 2023-02-09 20:54:54,909 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675976080230.a405dceeac89784cda948f90b491cbc9., pid=47, masterSystemTime=1675976094893 2023-02-09 20:54:54,910 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675976080230.a405dceeac89784cda948f90b491cbc9. 2023-02-09 20:54:54,910 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675976080230.a405dceeac89784cda948f90b491cbc9. 2023-02-09 20:54:54,911 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=a405dceeac89784cda948f90b491cbc9, regionState=OPEN, openSeqNum=51, regionLocation=jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:54,911 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675976080230.a405dceeac89784cda948f90b491cbc9.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1675976094911"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675976094911"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675976094911"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675976094911"}]},"ts":"1675976094911"} 2023-02-09 20:54:54,913 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=47, resume processing ppid=45 2023-02-09 20:54:54,913 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=47, ppid=45, state=SUCCESS; OpenRegionProcedure a405dceeac89784cda948f90b491cbc9, server=jenkins-hbase9.apache.org,40919,1675976022294 in 170 msec 2023-02-09 20:54:54,914 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=44 2023-02-09 20:54:54,914 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=44, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=a405dceeac89784cda948f90b491cbc9, REOPEN/MOVE in 1.0680 sec 2023-02-09 20:54:54,916 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=43 2023-02-09 20:54:54,916 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=43, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 1.0730 sec 2023-02-09 20:54:54,917 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=43, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 1.4890 sec 2023-02-09 20:54:54,918 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1227): Checking to see if procedure is done pid=43 2023-02-09 20:54:54,919 INFO [Listener at localhost/46855] compactions.TestMobCompactor(278): alter status finished 2023-02-09 20:54:54,920 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=42951] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:54,921 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1675976025848] procedure2.ProcedureExecutor(1029): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-02-09 20:54:54,922 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-02-09 20:54:54,923 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1675976025848] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-09 20:54:54,923 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1675976694923 2023-02-09 20:54:54,923 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1675976025848] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-09 20:54:54,924 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1675976025848] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-02-09 20:54:54,924 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1675976025848] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-09 20:54:54,924 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1675976025848] zookeeper.ReadOnlyZKClient(139): Connect 0x5cedf3de to 127.0.0.1:62089 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 20:54:54,928 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1675976025848] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3f125bab, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 20:54:54,929 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-09 20:54:54,929 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-09 20:54:54,929 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-09 20:54:54,929 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-09 20:54:54,929 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-09 20:54:55,755 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511288c38446d7a11425db421b227bcd3ccdd to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511288c38446d7a11425db421b227bcd3ccdd 2023-02-09 20:54:55,756 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-09 20:54:55,768 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 20:54:55,769 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:54204, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 20:54:55,775 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-09 20:54:55,777 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:41606, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-09 20:54:55,784 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/7dd3fdb0b3534ad18735b9c7b2a264c7 first=Optional[r05] last=Optional[r8] 2023-02-09 20:54:55,785 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675976080230.a405dceeac89784cda948f90b491cbc9., hostname=jenkins-hbase9.apache.org,40919,1675976022294, seqNum=51 for row with hfile group [{family1,hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/7dd3fdb0b3534ad18735b9c7b2a264c7}] 2023-02-09 20:54:55,789 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HStore(763): Validating hfile at hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/7dd3fdb0b3534ad18735b9c7b2a264c7 for inclusion in a405dceeac89784cda948f90b491cbc9/family1 2023-02-09 20:54:55,791 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-02-09 20:54:55,791 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HStore(777): Region bounds: first= last= 2023-02-09 20:54:55,792 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HRegion(2445): Flush status journal for a405dceeac89784cda948f90b491cbc9: 2023-02-09 20:54:55,793 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/7dd3fdb0b3534ad18735b9c7b2a264c7 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__jfhtcv2accpf5hpmrivmqt63950fjd4t5bu1kfh0oj2kq7lcpl9ifq1l06ffl9br/family1/7dd3fdb0b3534ad18735b9c7b2a264c7 2023-02-09 20:54:55,796 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__jfhtcv2accpf5hpmrivmqt63950fjd4t5bu1kfh0oj2kq7lcpl9ifq1l06ffl9br/family1/7dd3fdb0b3534ad18735b9c7b2a264c7 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a405dceeac89784cda948f90b491cbc9/family1/210372ee47a34b039ceffc943e16050b_SeqId_53_ 2023-02-09 20:54:55,797 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HStore(849): Loaded HFile hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__jfhtcv2accpf5hpmrivmqt63950fjd4t5bu1kfh0oj2kq7lcpl9ifq1l06ffl9br/family1/7dd3fdb0b3534ad18735b9c7b2a264c7 into a405dceeac89784cda948f90b491cbc9/family1 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a405dceeac89784cda948f90b491cbc9/family1/210372ee47a34b039ceffc943e16050b_SeqId_53_ - updating store file list. 2023-02-09 20:54:55,800 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HStore(882): Loaded HFile hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a405dceeac89784cda948f90b491cbc9/family1/210372ee47a34b039ceffc943e16050b_SeqId_53_ into a405dceeac89784cda948f90b491cbc9/family1 2023-02-09 20:54:55,800 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HStore(855): Successfully loaded hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__jfhtcv2accpf5hpmrivmqt63950fjd4t5bu1kfh0oj2kq7lcpl9ifq1l06ffl9br/family1/7dd3fdb0b3534ad18735b9c7b2a264c7 into a405dceeac89784cda948f90b491cbc9/family1 (new location: hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a405dceeac89784cda948f90b491cbc9/family1/210372ee47a34b039ceffc943e16050b_SeqId_53_) 2023-02-09 20:54:55,800 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__jfhtcv2accpf5hpmrivmqt63950fjd4t5bu1kfh0oj2kq7lcpl9ifq1l06ffl9br/family1/7dd3fdb0b3534ad18735b9c7b2a264c7 2023-02-09 20:54:55,802 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-09 20:54:55,803 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 20:54:55,804 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015112043019f03d46c469fb70fc45e7edd5a4f to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015112043019f03d46c469fb70fc45e7edd5a4f 2023-02-09 20:54:55,805 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151128b983e7f964e94d4a85b4e81b667f1648 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151128b983e7f964e94d4a85b4e81b667f1648 2023-02-09 20:54:55,805 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2 expired mob files are deleted 2023-02-09 20:54:55,805 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-02-09 20:54:55,805 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-09 20:54:55,805 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-09 20:54:55,805 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-09 20:54:55,805 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1675976025848] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-09 20:54:55,805 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1675976025848] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-09 20:54:55,806 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-02-09 20:54:55,808 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 885 msec 2023-02-09 20:54:55,856 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.HMaster$12(2441): Client=jenkins//172.31.2.10 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-02-09 20:54:55,857 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure2.ProcedureExecutor(1029): Stored pid=49, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:56,266 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000003 2023-02-09 20:54:56,269 DEBUG [PEWorker-3] util.FSTableDescriptors(519): Deleted hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-02-09 20:54:56,269 INFO [PEWorker-3] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000003 2023-02-09 20:54:56,271 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=50, ppid=49, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly}] 2023-02-09 20:54:56,274 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=a405dceeac89784cda948f90b491cbc9, REOPEN/MOVE}] 2023-02-09 20:54:56,275 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=a405dceeac89784cda948f90b491cbc9, REOPEN/MOVE 2023-02-09 20:54:56,275 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=a405dceeac89784cda948f90b491cbc9, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:56,276 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675976080230.a405dceeac89784cda948f90b491cbc9.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1675976096275"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675976096275"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675976096275"}]},"ts":"1675976096275"} 2023-02-09 20:54:56,277 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE; CloseRegionProcedure a405dceeac89784cda948f90b491cbc9, server=jenkins-hbase9.apache.org,40919,1675976022294}] 2023-02-09 20:54:56,428 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(109): Close a405dceeac89784cda948f90b491cbc9 2023-02-09 20:54:56,429 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing a405dceeac89784cda948f90b491cbc9, disabling compactions & flushes 2023-02-09 20:54:56,429 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675976080230.a405dceeac89784cda948f90b491cbc9. 2023-02-09 20:54:56,429 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675976080230.a405dceeac89784cda948f90b491cbc9. 2023-02-09 20:54:56,429 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675976080230.a405dceeac89784cda948f90b491cbc9. after waiting 0 ms 2023-02-09 20:54:56,429 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675976080230.a405dceeac89784cda948f90b491cbc9. 2023-02-09 20:54:56,434 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a405dceeac89784cda948f90b491cbc9/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=50 2023-02-09 20:54:56,435 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675976080230.a405dceeac89784cda948f90b491cbc9. 2023-02-09 20:54:56,435 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for a405dceeac89784cda948f90b491cbc9: Waiting for close lock at 1675976096429Running coprocessor pre-close hooks at 1675976096429Disabling compacts and flushes for region at 1675976096429Disabling writes for close at 1675976096429Writing region close event to WAL at 1675976096431 (+2 ms)Running coprocessor post-close hooks at 1675976096435 (+4 ms)Closed at 1675976096435 2023-02-09 20:54:56,435 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(3509): Not adding moved region record: a405dceeac89784cda948f90b491cbc9 to self. 2023-02-09 20:54:56,437 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(147): Closed a405dceeac89784cda948f90b491cbc9 2023-02-09 20:54:56,437 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=a405dceeac89784cda948f90b491cbc9, regionState=CLOSED 2023-02-09 20:54:56,437 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675976080230.a405dceeac89784cda948f90b491cbc9.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1675976096437"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675976096437"}]},"ts":"1675976096437"} 2023-02-09 20:54:56,440 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=51 2023-02-09 20:54:56,440 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=51, state=SUCCESS; CloseRegionProcedure a405dceeac89784cda948f90b491cbc9, server=jenkins-hbase9.apache.org,40919,1675976022294 in 162 msec 2023-02-09 20:54:56,440 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=a405dceeac89784cda948f90b491cbc9, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase9.apache.org,40919,1675976022294; forceNewPlan=false, retain=true 2023-02-09 20:54:56,591 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=a405dceeac89784cda948f90b491cbc9, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:56,591 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675976080230.a405dceeac89784cda948f90b491cbc9.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1675976096591"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675976096591"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675976096591"}]},"ts":"1675976096591"} 2023-02-09 20:54:56,592 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=53, ppid=51, state=RUNNABLE; OpenRegionProcedure a405dceeac89784cda948f90b491cbc9, server=jenkins-hbase9.apache.org,40919,1675976022294}] 2023-02-09 20:54:56,746 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675976080230.a405dceeac89784cda948f90b491cbc9. 2023-02-09 20:54:56,747 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => a405dceeac89784cda948f90b491cbc9, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675976080230.a405dceeac89784cda948f90b491cbc9.', STARTKEY => '', ENDKEY => ''} 2023-02-09 20:54:56,747 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly a405dceeac89784cda948f90b491cbc9 2023-02-09 20:54:56,747 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675976080230.a405dceeac89784cda948f90b491cbc9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 20:54:56,747 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for a405dceeac89784cda948f90b491cbc9 2023-02-09 20:54:56,747 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for a405dceeac89784cda948f90b491cbc9 2023-02-09 20:54:56,748 INFO [StoreOpener-a405dceeac89784cda948f90b491cbc9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region a405dceeac89784cda948f90b491cbc9 2023-02-09 20:54:56,749 DEBUG [StoreOpener-a405dceeac89784cda948f90b491cbc9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a405dceeac89784cda948f90b491cbc9/family1 2023-02-09 20:54:56,749 DEBUG [StoreOpener-a405dceeac89784cda948f90b491cbc9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a405dceeac89784cda948f90b491cbc9/family1 2023-02-09 20:54:56,750 INFO [StoreOpener-a405dceeac89784cda948f90b491cbc9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a405dceeac89784cda948f90b491cbc9 columnFamilyName family1 2023-02-09 20:54:56,754 DEBUG [StoreOpener-a405dceeac89784cda948f90b491cbc9-1] regionserver.HStore(539): loaded hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a405dceeac89784cda948f90b491cbc9/family1/210372ee47a34b039ceffc943e16050b_SeqId_53_ 2023-02-09 20:54:56,757 DEBUG [StoreOpener-a405dceeac89784cda948f90b491cbc9-1] regionserver.HStore(539): loaded hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a405dceeac89784cda948f90b491cbc9/family1/6701a289f75a40c5ab1bea4a761940e1 2023-02-09 20:54:56,757 INFO [StoreOpener-a405dceeac89784cda948f90b491cbc9-1] regionserver.HStore(310): Store=a405dceeac89784cda948f90b491cbc9/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 20:54:56,758 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a405dceeac89784cda948f90b491cbc9 2023-02-09 20:54:56,759 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a405dceeac89784cda948f90b491cbc9 2023-02-09 20:54:56,761 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for a405dceeac89784cda948f90b491cbc9 2023-02-09 20:54:56,762 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened a405dceeac89784cda948f90b491cbc9; next sequenceid=56; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60367078, jitterRate=-0.10046043992042542}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-09 20:54:56,762 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for a405dceeac89784cda948f90b491cbc9: Running coprocessor pre-open hook at 1675976096747Writing region info on filesystem at 1675976096747Initializing all the Stores at 1675976096748 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} at 1675976096748Cleaning up temporary data from old regions at 1675976096759 (+11 ms)Cleaning up detritus from prior splits at 1675976096760 (+1 ms)Running coprocessor post-open hooks at 1675976096762 (+2 ms)Region opened successfully at 1675976096762 2023-02-09 20:54:56,763 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675976080230.a405dceeac89784cda948f90b491cbc9., pid=53, masterSystemTime=1675976096744 2023-02-09 20:54:56,764 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675976080230.a405dceeac89784cda948f90b491cbc9. 2023-02-09 20:54:56,764 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675976080230.a405dceeac89784cda948f90b491cbc9. 2023-02-09 20:54:56,764 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=a405dceeac89784cda948f90b491cbc9, regionState=OPEN, openSeqNum=56, regionLocation=jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:56,765 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675976080230.a405dceeac89784cda948f90b491cbc9.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1675976096764"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675976096764"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675976096764"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675976096764"}]},"ts":"1675976096764"} 2023-02-09 20:54:56,767 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=51 2023-02-09 20:54:56,767 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=51, state=SUCCESS; OpenRegionProcedure a405dceeac89784cda948f90b491cbc9, server=jenkins-hbase9.apache.org,40919,1675976022294 in 174 msec 2023-02-09 20:54:56,768 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=51, resume processing ppid=50 2023-02-09 20:54:56,768 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=51, ppid=50, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=a405dceeac89784cda948f90b491cbc9, REOPEN/MOVE in 493 msec 2023-02-09 20:54:56,770 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=50, resume processing ppid=49 2023-02-09 20:54:56,770 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=50, ppid=49, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 498 msec 2023-02-09 20:54:56,772 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=49, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 915 msec 2023-02-09 20:54:56,772 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1227): Checking to see if procedure is done pid=49 2023-02-09 20:54:56,773 INFO [Listener at localhost/46855] compactions.TestMobCompactor(278): alter status finished 2023-02-09 20:54:56,774 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=42951] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-09 20:54:56,775 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1675976025848] procedure2.ProcedureExecutor(1029): Stored pid=54, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-02-09 20:54:56,776 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=54, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-02-09 20:54:56,776 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1675976025848] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-09 20:54:56,776 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=54, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1675976696776 2023-02-09 20:54:56,777 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1675976025848] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-09 20:54:56,777 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1675976025848] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 4 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-02-09 20:54:56,777 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1675976025848] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-09 20:54:56,778 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1675976025848] zookeeper.ReadOnlyZKClient(139): Connect 0x26c9a163 to 127.0.0.1:62089 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 20:54:56,783 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1675976025848] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@bab7912, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 20:54:56,783 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-09 20:54:56,783 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-09 20:54:56,783 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-09 20:54:56,783 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-09 20:54:56,783 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-09 20:54:56,783 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-09 20:54:56,783 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-09 20:54:56,783 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-09 20:54:56,783 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1675976025848] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-09 20:54:56,783 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1675976025848] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-09 20:54:56,784 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=54, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-02-09 20:54:56,785 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=54, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 10 msec 2023-02-09 20:54:56,844 INFO [Listener at localhost/46855] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly Thread=243 (was 255), OpenFileDescriptor=611 (was 622), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=142 (was 182), ProcessCount=168 (was 168), AvailableMemoryMB=10667 (was 10718) 2023-02-09 20:54:56,854 INFO [Listener at localhost/46855] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily Thread=243, OpenFileDescriptor=611, MaxFileDescriptor=60000, SystemLoadAverage=142, ProcessCount=168, AvailableMemoryMB=10667 2023-02-09 20:54:56,855 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.HMaster$4(2102): Client=jenkins//172.31.2.10 create 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-02-09 20:54:56,856 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure2.ProcedureExecutor(1029): Stored pid=55, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:54:56,857 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_PRE_OPERATION 2023-02-09 20:54:56,857 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(697): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily" procId is: 55 2023-02-09 20:54:56,858 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-09 20:54:56,858 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-02-09 20:54:56,859 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/7b664758b0f2a40178d815ef9f2c6c7f 2023-02-09 20:54:56,859 DEBUG [HFileArchiver-10] backup.HFileArchiver(153): Directory hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/7b664758b0f2a40178d815ef9f2c6c7f empty. 2023-02-09 20:54:56,860 DEBUG [HFileArchiver-10] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/7b664758b0f2a40178d815ef9f2c6c7f 2023-02-09 20:54:56,860 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily regions 2023-02-09 20:54:56,959 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-02-09 20:54:57,160 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-02-09 20:54:57,267 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000001 2023-02-09 20:54:57,268 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(7671): creating {ENCODED => 7b664758b0f2a40178d815ef9f2c6c7f, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675976096855.7b664758b0f2a40178d815ef9f2c6c7f.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/.tmp 2023-02-09 20:54:57,461 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-02-09 20:54:57,674 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675976096855.7b664758b0f2a40178d815ef9f2c6c7f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 20:54:57,675 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1603): Closing 7b664758b0f2a40178d815ef9f2c6c7f, disabling compactions & flushes 2023-02-09 20:54:57,675 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675976096855.7b664758b0f2a40178d815ef9f2c6c7f. 2023-02-09 20:54:57,675 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675976096855.7b664758b0f2a40178d815ef9f2c6c7f. 2023-02-09 20:54:57,675 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675976096855.7b664758b0f2a40178d815ef9f2c6c7f. after waiting 0 ms 2023-02-09 20:54:57,675 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675976096855.7b664758b0f2a40178d815ef9f2c6c7f. 2023-02-09 20:54:57,675 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675976096855.7b664758b0f2a40178d815ef9f2c6c7f. 2023-02-09 20:54:57,675 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1557): Region close journal for 7b664758b0f2a40178d815ef9f2c6c7f: Waiting for close lock at 1675976097675Disabling compacts and flushes for region at 1675976097675Disabling writes for close at 1675976097675Writing region close event to WAL at 1675976097675Closed at 1675976097675 2023-02-09 20:54:57,677 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_ADD_TO_META 2023-02-09 20:54:57,678 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675976096855.7b664758b0f2a40178d815ef9f2c6c7f.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1675976097678"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675976097678"}]},"ts":"1675976097678"} 2023-02-09 20:54:57,679 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-09 20:54:57,680 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-09 20:54:57,680 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675976097680"}]},"ts":"1675976097680"} 2023-02-09 20:54:57,681 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, state=ENABLING in hbase:meta 2023-02-09 20:54:57,684 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=7b664758b0f2a40178d815ef9f2c6c7f, ASSIGN}] 2023-02-09 20:54:57,685 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=7b664758b0f2a40178d815ef9f2c6c7f, ASSIGN 2023-02-09 20:54:57,686 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=7b664758b0f2a40178d815ef9f2c6c7f, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,40919,1675976022294; forceNewPlan=false, retain=false 2023-02-09 20:54:57,837 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=56 updating hbase:meta row=7b664758b0f2a40178d815ef9f2c6c7f, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:57,837 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675976096855.7b664758b0f2a40178d815ef9f2c6c7f.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1675976097837"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675976097837"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675976097837"}]},"ts":"1675976097837"} 2023-02-09 20:54:57,839 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=57, ppid=56, state=RUNNABLE; OpenRegionProcedure 7b664758b0f2a40178d815ef9f2c6c7f, server=jenkins-hbase9.apache.org,40919,1675976022294}] 2023-02-09 20:54:57,962 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-02-09 20:54:57,993 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675976096855.7b664758b0f2a40178d815ef9f2c6c7f. 2023-02-09 20:54:57,993 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 7b664758b0f2a40178d815ef9f2c6c7f, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675976096855.7b664758b0f2a40178d815ef9f2c6c7f.', STARTKEY => '', ENDKEY => ''} 2023-02-09 20:54:57,993 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 7b664758b0f2a40178d815ef9f2c6c7f 2023-02-09 20:54:57,994 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675976096855.7b664758b0f2a40178d815ef9f2c6c7f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 20:54:57,994 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for 7b664758b0f2a40178d815ef9f2c6c7f 2023-02-09 20:54:57,994 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for 7b664758b0f2a40178d815ef9f2c6c7f 2023-02-09 20:54:57,995 INFO [StoreOpener-7b664758b0f2a40178d815ef9f2c6c7f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 7b664758b0f2a40178d815ef9f2c6c7f 2023-02-09 20:54:57,996 DEBUG [StoreOpener-7b664758b0f2a40178d815ef9f2c6c7f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/7b664758b0f2a40178d815ef9f2c6c7f/family1 2023-02-09 20:54:57,996 DEBUG [StoreOpener-7b664758b0f2a40178d815ef9f2c6c7f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/7b664758b0f2a40178d815ef9f2c6c7f/family1 2023-02-09 20:54:57,996 INFO [StoreOpener-7b664758b0f2a40178d815ef9f2c6c7f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7b664758b0f2a40178d815ef9f2c6c7f columnFamilyName family1 2023-02-09 20:54:57,998 INFO [StoreOpener-7b664758b0f2a40178d815ef9f2c6c7f-1] regionserver.HStore(310): Store=7b664758b0f2a40178d815ef9f2c6c7f/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 20:54:57,998 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/7b664758b0f2a40178d815ef9f2c6c7f 2023-02-09 20:54:57,999 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/7b664758b0f2a40178d815ef9f2c6c7f 2023-02-09 20:54:58,001 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for 7b664758b0f2a40178d815ef9f2c6c7f 2023-02-09 20:54:58,003 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/7b664758b0f2a40178d815ef9f2c6c7f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 20:54:58,004 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened 7b664758b0f2a40178d815ef9f2c6c7f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74189405, jitterRate=0.10550828278064728}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-09 20:54:58,004 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for 7b664758b0f2a40178d815ef9f2c6c7f: Running coprocessor pre-open hook at 1675976097994Writing region info on filesystem at 1675976097994Initializing all the Stores at 1675976097994Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} at 1675976097994Cleaning up temporary data from old regions at 1675976097999 (+5 ms)Cleaning up detritus from prior splits at 1675976097999Running coprocessor post-open hooks at 1675976098004 (+5 ms)Region opened successfully at 1675976098004 2023-02-09 20:54:58,004 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675976096855.7b664758b0f2a40178d815ef9f2c6c7f., pid=57, masterSystemTime=1675976097990 2023-02-09 20:54:58,006 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675976096855.7b664758b0f2a40178d815ef9f2c6c7f. 2023-02-09 20:54:58,006 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675976096855.7b664758b0f2a40178d815ef9f2c6c7f. 2023-02-09 20:54:58,006 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=56 updating hbase:meta row=7b664758b0f2a40178d815ef9f2c6c7f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:58,006 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675976096855.7b664758b0f2a40178d815ef9f2c6c7f.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1675976098006"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675976098006"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675976098006"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675976098006"}]},"ts":"1675976098006"} 2023-02-09 20:54:58,009 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=57, resume processing ppid=56 2023-02-09 20:54:58,009 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=57, ppid=56, state=SUCCESS; OpenRegionProcedure 7b664758b0f2a40178d815ef9f2c6c7f, server=jenkins-hbase9.apache.org,40919,1675976022294 in 168 msec 2023-02-09 20:54:58,010 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=56, resume processing ppid=55 2023-02-09 20:54:58,010 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=56, ppid=55, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=7b664758b0f2a40178d815ef9f2c6c7f, ASSIGN in 325 msec 2023-02-09 20:54:58,011 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-09 20:54:58,011 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675976098011"}]},"ts":"1675976098011"} 2023-02-09 20:54:58,012 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, state=ENABLED in hbase:meta 2023-02-09 20:54:58,014 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_POST_OPERATION 2023-02-09 20:54:58,015 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=55, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 1.1580 sec 2023-02-09 20:54:58,963 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-02-09 20:54:58,963 INFO [Listener at localhost/46855] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, procId: 55 completed 2023-02-09 20:54:58,982 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(933): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-02-09 20:54:58,983 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:54:58,984 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-09 20:54:58,984 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:54:58,984 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-02-09 20:54:58,984 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-02-09 20:54:58,984 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:54:58,984 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:54:58,986 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:54:58,986 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:58,986 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:54:58,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:54:58,986 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:58,986 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 20:54:58,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:54:58,986 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:54:58,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 20:54:58,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:54:58,987 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:54:58,987 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:54:58,987 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-02-09 20:54:58,987 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:54:58,987 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-02-09 20:54:58,987 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 20:54:58,987 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 20:54:58,987 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675976096855.7b664758b0f2a40178d815ef9f2c6c7f. 2023-02-09 20:54:58,988 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675976096855.7b664758b0f2a40178d815ef9f2c6c7f. started... 2023-02-09 20:54:58,988 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 7b664758b0f2a40178d815ef9f2c6c7f 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-02-09 20:54:59,408 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130d1fca72c91d44b2d8f876aa6cd7de946 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151130d1fca72c91d44b2d8f876aa6cd7de946 2023-02-09 20:54:59,811 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/7b664758b0f2a40178d815ef9f2c6c7f/.tmp/family1/4f2c62a09be147ee83c82d5312317dc3 2023-02-09 20:54:59,816 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/7b664758b0f2a40178d815ef9f2c6c7f/.tmp/family1/4f2c62a09be147ee83c82d5312317dc3 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/7b664758b0f2a40178d815ef9f2c6c7f/family1/4f2c62a09be147ee83c82d5312317dc3 2023-02-09 20:54:59,819 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/7b664758b0f2a40178d815ef9f2c6c7f/family1/4f2c62a09be147ee83c82d5312317dc3, entries=1000, sequenceid=5, filesize=190.5 K 2023-02-09 20:54:59,820 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 7b664758b0f2a40178d815ef9f2c6c7f in 832ms, sequenceid=5, compaction requested=false 2023-02-09 20:54:59,820 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-09 20:54:59,821 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 7b664758b0f2a40178d815ef9f2c6c7f: 2023-02-09 20:54:59,821 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675976096855.7b664758b0f2a40178d815ef9f2c6c7f. 2023-02-09 20:54:59,821 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 20:54:59,821 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 20:54:59,821 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:59,821 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-02-09 20:54:59,821 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-02-09 20:54:59,822 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:59,822 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:54:59,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:59,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:54:59,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:54:59,823 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:54:59,823 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 20:54:59,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:54:59,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:54:59,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:54:59,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:59,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:54:59,824 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-02-09 20:54:59,824 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7885dad6[Count = 0] remaining members to acquire global barrier 2023-02-09 20:54:59,824 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-02-09 20:54:59,824 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:54:59,826 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:54:59,826 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:54:59,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:54:59,826 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-02-09 20:54:59,826 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-02-09 20:54:59,826 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:59,826 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 20:54:59,826 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase9.apache.org,40919,1675976022294' in zk 2023-02-09 20:54:59,827 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-02-09 20:54:59,827 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:54:59,827 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:59,827 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-02-09 20:54:59,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:59,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:54:59,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:54:59,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:54:59,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:54:59,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:54:59,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:59,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:54:59,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:54:59,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:59,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase9.apache.org,40919,1675976022294': 2023-02-09 20:54:59,829 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-02-09 20:54:59,829 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-02-09 20:54:59,829 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 20:54:59,829 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 20:54:59,829 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:54:59,829 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 20:54:59,830 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:54:59,830 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:54:59,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:54:59,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:54:59,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:54:59,831 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:54:59,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:54:59,831 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:54:59,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:54:59,831 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:59,831 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:54:59,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:54:59,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:54:59,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:54:59,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:54:59,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:54:59,832 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:59,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:59,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:54:59,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:54:59,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:59,840 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:59,840 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:54:59,840 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:54:59,840 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:54:59,840 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:54:59,840 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-09 20:54:59,840 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 20:54:59,840 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:54:59,840 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:59,840 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:54:59,840 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:54:59,840 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:54:59,841 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-02-09 20:54:59,841 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-02-09 20:54:59,840 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:54:59,841 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 20:54:59,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:54:59,841 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:54:59,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:54:59,941 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 20:54:59,942 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 20:54:59,945 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(933): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-02-09 20:54:59,947 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-02-09 20:54:59,947 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:54:59,947 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-09 20:54:59,947 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:54:59,947 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-02-09 20:54:59,947 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-02-09 20:54:59,947 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:54:59,947 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:54:59,948 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:54:59,948 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:59,949 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:54:59,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:54:59,949 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:54:59,949 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 20:54:59,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:54:59,949 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:54:59,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 20:54:59,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:54:59,949 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:54:59,950 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-02-09 20:54:59,950 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:54:59,950 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-02-09 20:54:59,950 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:54:59,950 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-02-09 20:54:59,950 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 20:54:59,950 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 20:54:59,950 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675976096855.7b664758b0f2a40178d815ef9f2c6c7f. 2023-02-09 20:54:59,950 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675976096855.7b664758b0f2a40178d815ef9f2c6c7f. started... 2023-02-09 20:54:59,950 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 7b664758b0f2a40178d815ef9f2c6c7f 1/1 column families, dataSize=74 B heapSize=408 B 2023-02-09 20:55:00,113 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-09 20:55:00,362 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128a10c9f4fad70445e8952aaf5d450d5b5 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151128a10c9f4fad70445e8952aaf5d450d5b5 2023-02-09 20:55:00,768 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/7b664758b0f2a40178d815ef9f2c6c7f/.tmp/family1/6bfb7b92fbb448ecaedb082843bde28e 2023-02-09 20:55:00,773 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/7b664758b0f2a40178d815ef9f2c6c7f/.tmp/family1/6bfb7b92fbb448ecaedb082843bde28e as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/7b664758b0f2a40178d815ef9f2c6c7f/family1/6bfb7b92fbb448ecaedb082843bde28e 2023-02-09 20:55:00,777 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/7b664758b0f2a40178d815ef9f2c6c7f/family1/6bfb7b92fbb448ecaedb082843bde28e, entries=1, sequenceid=9, filesize=5.0 K 2023-02-09 20:55:00,778 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 7b664758b0f2a40178d815ef9f2c6c7f in 828ms, sequenceid=9, compaction requested=false 2023-02-09 20:55:00,778 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 7b664758b0f2a40178d815ef9f2c6c7f: 2023-02-09 20:55:00,778 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675976096855.7b664758b0f2a40178d815ef9f2c6c7f. 2023-02-09 20:55:00,778 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 20:55:00,778 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 20:55:00,778 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:00,778 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-02-09 20:55:00,778 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-02-09 20:55:00,780 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:00,780 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:00,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:00,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:55:00,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:55:00,780 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:00,780 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 20:55:00,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:55:00,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:55:00,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:00,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:00,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:55:00,781 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-02-09 20:55:00,781 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1468967b[Count = 0] remaining members to acquire global barrier 2023-02-09 20:55:00,781 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-02-09 20:55:00,781 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:00,783 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:00,783 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:00,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:00,783 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-02-09 20:55:00,783 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-02-09 20:55:00,783 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase9.apache.org,40919,1675976022294' in zk 2023-02-09 20:55:00,783 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:00,783 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 20:55:00,784 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-02-09 20:55:00,784 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:00,784 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:55:00,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:00,784 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-02-09 20:55:00,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:55:00,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:55:00,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:55:00,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:55:00,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:00,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:00,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:55:00,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:00,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:00,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase9.apache.org,40919,1675976022294': 2023-02-09 20:55:00,787 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-02-09 20:55:00,787 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-02-09 20:55:00,787 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 20:55:00,787 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 20:55:00,787 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:00,787 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 20:55:00,788 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:00,788 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:00,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:00,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:55:00,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:55:00,788 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:00,788 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:55:00,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:00,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:55:00,788 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:00,789 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:55:00,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:55:00,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:00,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:00,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:55:00,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:00,790 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:00,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:00,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:55:00,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:00,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:00,791 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:00,792 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:55:00,792 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:00,792 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:55:00,792 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-02-09 20:55:00,792 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:55:00,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:55:00,792 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:55:00,792 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-09 20:55:00,792 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 20:55:00,792 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:00,792 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:00,792 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:00,792 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:55:00,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:55:00,792 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:00,792 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-02-09 20:55:00,792 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 20:55:00,792 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:00,892 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 20:55:00,893 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 20:55:00,896 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(933): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-02-09 20:55:00,898 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-02-09 20:55:00,898 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:00,898 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-09 20:55:00,898 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:55:00,898 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-02-09 20:55:00,898 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-02-09 20:55:00,898 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:00,899 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:00,906 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:00,906 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:55:00,906 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:55:00,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:55:00,906 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:00,906 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 20:55:00,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:00,906 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:00,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 20:55:00,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:00,907 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:00,907 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-02-09 20:55:00,907 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:00,907 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-02-09 20:55:00,907 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:55:00,907 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-02-09 20:55:00,907 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 20:55:00,907 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 20:55:00,907 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675976096855.7b664758b0f2a40178d815ef9f2c6c7f. 2023-02-09 20:55:00,907 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675976096855.7b664758b0f2a40178d815ef9f2c6c7f. started... 2023-02-09 20:55:00,908 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 7b664758b0f2a40178d815ef9f2c6c7f 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-09 20:55:01,320 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120151932f5bbdad42de9d699b81ab92ca87 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015120151932f5bbdad42de9d699b81ab92ca87 2023-02-09 20:55:01,726 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/7b664758b0f2a40178d815ef9f2c6c7f/.tmp/family1/295ad02c1f754c0883384ac1ffc9f536 2023-02-09 20:55:01,730 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/7b664758b0f2a40178d815ef9f2c6c7f/.tmp/family1/295ad02c1f754c0883384ac1ffc9f536 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/7b664758b0f2a40178d815ef9f2c6c7f/family1/295ad02c1f754c0883384ac1ffc9f536 2023-02-09 20:55:01,734 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/7b664758b0f2a40178d815ef9f2c6c7f/family1/295ad02c1f754c0883384ac1ffc9f536, entries=1, sequenceid=13, filesize=5.0 K 2023-02-09 20:55:01,735 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 7b664758b0f2a40178d815ef9f2c6c7f in 827ms, sequenceid=13, compaction requested=true 2023-02-09 20:55:01,735 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 7b664758b0f2a40178d815ef9f2c6c7f: 2023-02-09 20:55:01,735 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675976096855.7b664758b0f2a40178d815ef9f2c6c7f. 2023-02-09 20:55:01,735 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 20:55:01,735 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 20:55:01,735 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:01,735 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-02-09 20:55:01,735 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-02-09 20:55:01,737 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:01,737 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:01,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:01,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:55:01,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:55:01,737 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:01,737 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 20:55:01,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:55:01,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:55:01,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:01,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:01,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:55:01,739 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-02-09 20:55:01,739 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@22852fc0[Count = 0] remaining members to acquire global barrier 2023-02-09 20:55:01,739 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-02-09 20:55:01,739 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:01,740 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:01,740 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:01,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:01,740 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-02-09 20:55:01,740 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-02-09 20:55:01,740 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase9.apache.org,40919,1675976022294' in zk 2023-02-09 20:55:01,740 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:01,740 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 20:55:01,741 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:01,741 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-02-09 20:55:01,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:01,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:55:01,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:55:01,741 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:55:01,742 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-02-09 20:55:01,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:55:01,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:55:01,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:01,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:01,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:55:01,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:01,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:01,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase9.apache.org,40919,1675976022294': 2023-02-09 20:55:01,744 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-02-09 20:55:01,744 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-02-09 20:55:01,744 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 20:55:01,744 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 20:55:01,744 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:01,744 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 20:55:01,746 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:01,746 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:01,746 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:55:01,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:01,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:55:01,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:55:01,746 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:01,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:01,747 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:55:01,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:55:01,747 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:01,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:55:01,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:01,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:01,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:55:01,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:01,748 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:01,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:01,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:55:01,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:01,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:01,751 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:01,751 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:01,751 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:01,751 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:01,751 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-09 20:55:01,751 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 20:55:01,751 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:55:01,751 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-02-09 20:55:01,751 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:01,751 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:55:01,751 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:01,751 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:55:01,751 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:55:01,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:55:01,751 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:01,751 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-02-09 20:55:01,751 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 20:55:01,752 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:55:01,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:55:01,852 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 20:55:01,852 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 20:55:01,856 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(933): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-02-09 20:55:01,858 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-02-09 20:55:01,858 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:01,858 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-09 20:55:01,858 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:55:01,858 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-02-09 20:55:01,858 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-02-09 20:55:01,858 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:01,858 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:01,860 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:01,860 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:55:01,860 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:55:01,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:55:01,860 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:01,860 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 20:55:01,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:01,860 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:01,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 20:55:01,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:01,861 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:01,861 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-02-09 20:55:01,861 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:01,861 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-02-09 20:55:01,861 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:55:01,861 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-02-09 20:55:01,861 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 20:55:01,861 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 20:55:01,861 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675976096855.7b664758b0f2a40178d815ef9f2c6c7f. 2023-02-09 20:55:01,861 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675976096855.7b664758b0f2a40178d815ef9f2c6c7f. started... 2023-02-09 20:55:01,861 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 7b664758b0f2a40178d815ef9f2c6c7f 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-09 20:55:02,273 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205610505aff46042cab3dcd786a88c49d4 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151205610505aff46042cab3dcd786a88c49d4 2023-02-09 20:55:02,678 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/7b664758b0f2a40178d815ef9f2c6c7f/.tmp/family1/d89817c60c69445889fe12fb72e7809a 2023-02-09 20:55:02,683 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/7b664758b0f2a40178d815ef9f2c6c7f/.tmp/family1/d89817c60c69445889fe12fb72e7809a as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/7b664758b0f2a40178d815ef9f2c6c7f/family1/d89817c60c69445889fe12fb72e7809a 2023-02-09 20:55:02,687 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/7b664758b0f2a40178d815ef9f2c6c7f/family1/d89817c60c69445889fe12fb72e7809a, entries=1, sequenceid=17, filesize=5.0 K 2023-02-09 20:55:02,687 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 7b664758b0f2a40178d815ef9f2c6c7f in 826ms, sequenceid=17, compaction requested=true 2023-02-09 20:55:02,688 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 7b664758b0f2a40178d815ef9f2c6c7f: 2023-02-09 20:55:02,688 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675976096855.7b664758b0f2a40178d815ef9f2c6c7f. 2023-02-09 20:55:02,688 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 20:55:02,688 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 20:55:02,688 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:02,688 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-02-09 20:55:02,688 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-02-09 20:55:02,689 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:02,689 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:02,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:02,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:55:02,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:55:02,689 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:02,689 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 20:55:02,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:55:02,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:55:02,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:02,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:02,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:55:02,690 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-02-09 20:55:02,690 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@ea869cb[Count = 0] remaining members to acquire global barrier 2023-02-09 20:55:02,690 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-02-09 20:55:02,691 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:02,695 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:02,695 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:02,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:02,695 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-02-09 20:55:02,695 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-02-09 20:55:02,695 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase9.apache.org,40919,1675976022294' in zk 2023-02-09 20:55:02,695 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:02,695 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 20:55:02,696 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-02-09 20:55:02,696 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:55:02,696 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:02,696 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-02-09 20:55:02,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:02,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:55:02,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:55:02,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:55:02,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:55:02,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:02,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:02,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:55:02,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:02,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:02,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase9.apache.org,40919,1675976022294': 2023-02-09 20:55:02,698 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-02-09 20:55:02,698 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-02-09 20:55:02,698 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 20:55:02,698 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 20:55:02,698 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:02,698 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 20:55:02,700 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:02,700 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:02,700 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:02,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:02,700 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:55:02,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:02,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:55:02,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:55:02,700 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:55:02,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:55:02,700 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:02,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:55:02,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:02,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:02,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:55:02,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:02,701 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:02,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:02,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:55:02,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:02,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:02,705 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:02,705 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:02,705 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:02,705 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:02,705 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:02,705 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:02,705 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-09 20:55:02,705 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 20:55:02,705 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:55:02,705 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-02-09 20:55:02,705 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:02,705 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:55:02,705 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:55:02,705 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:55:02,705 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-02-09 20:55:02,705 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 20:55:02,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:55:02,706 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:55:02,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:55:02,805 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 20:55:02,806 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 20:55:02,810 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(933): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-02-09 20:55:02,811 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-02-09 20:55:02,811 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:02,811 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-09 20:55:02,811 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:55:02,811 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-02-09 20:55:02,811 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-02-09 20:55:02,812 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:02,812 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:02,813 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:02,813 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:55:02,813 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:55:02,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:55:02,813 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:02,813 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 20:55:02,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:02,814 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:02,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 20:55:02,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:02,814 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:02,814 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-02-09 20:55:02,814 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:02,814 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-02-09 20:55:02,814 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:55:02,814 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-02-09 20:55:02,815 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 20:55:02,815 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 20:55:02,815 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675976096855.7b664758b0f2a40178d815ef9f2c6c7f. 2023-02-09 20:55:02,815 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675976096855.7b664758b0f2a40178d815ef9f2c6c7f. started... 2023-02-09 20:55:02,815 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 7b664758b0f2a40178d815ef9f2c6c7f 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-09 20:55:03,227 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512285016d40fc9f3491390e06bca7944fa52 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512285016d40fc9f3491390e06bca7944fa52 2023-02-09 20:55:03,632 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/7b664758b0f2a40178d815ef9f2c6c7f/.tmp/family1/24dfe1eda66945378999cfdebdd33e09 2023-02-09 20:55:03,637 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/7b664758b0f2a40178d815ef9f2c6c7f/.tmp/family1/24dfe1eda66945378999cfdebdd33e09 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/7b664758b0f2a40178d815ef9f2c6c7f/family1/24dfe1eda66945378999cfdebdd33e09 2023-02-09 20:55:03,641 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/7b664758b0f2a40178d815ef9f2c6c7f/family1/24dfe1eda66945378999cfdebdd33e09, entries=1, sequenceid=21, filesize=5.0 K 2023-02-09 20:55:03,641 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 7b664758b0f2a40178d815ef9f2c6c7f in 826ms, sequenceid=21, compaction requested=true 2023-02-09 20:55:03,641 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 7b664758b0f2a40178d815ef9f2c6c7f: 2023-02-09 20:55:03,641 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675976096855.7b664758b0f2a40178d815ef9f2c6c7f. 2023-02-09 20:55:03,642 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 20:55:03,642 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 20:55:03,642 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:03,642 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-02-09 20:55:03,642 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-02-09 20:55:03,643 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:03,643 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:03,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:03,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:55:03,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:55:03,643 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:03,643 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 20:55:03,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:55:03,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:55:03,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:03,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:03,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:55:03,644 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-02-09 20:55:03,645 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@58ad51a2[Count = 0] remaining members to acquire global barrier 2023-02-09 20:55:03,645 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-02-09 20:55:03,645 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:03,645 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:03,646 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:03,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:03,646 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-02-09 20:55:03,646 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-02-09 20:55:03,646 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:03,646 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase9.apache.org,40919,1675976022294' in zk 2023-02-09 20:55:03,646 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 20:55:03,648 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-02-09 20:55:03,648 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:03,648 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:55:03,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:03,648 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-02-09 20:55:03,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:55:03,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:55:03,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:55:03,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:55:03,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:03,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:03,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:55:03,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:03,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:03,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase9.apache.org,40919,1675976022294': 2023-02-09 20:55:03,650 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-02-09 20:55:03,650 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-02-09 20:55:03,650 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 20:55:03,650 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 20:55:03,650 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:03,650 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 20:55:03,652 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:03,652 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:03,652 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:03,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:03,652 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:55:03,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:03,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:55:03,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:55:03,652 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:55:03,652 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:03,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:55:03,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:55:03,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:03,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:03,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:55:03,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:03,653 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:03,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:03,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:55:03,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:03,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:03,655 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:03,655 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:55:03,655 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:03,655 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:55:03,655 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:03,655 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-09 20:55:03,655 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 20:55:03,655 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:03,655 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:55:03,655 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:55:03,655 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:03,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:55:03,655 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-02-09 20:55:03,655 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 20:55:03,655 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:03,655 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:03,656 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:55:03,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:55:03,756 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 20:55:03,756 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 20:55:03,760 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(933): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-02-09 20:55:03,761 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-02-09 20:55:03,761 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:03,761 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-09 20:55:03,761 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:55:03,761 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-02-09 20:55:03,761 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-02-09 20:55:03,762 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:03,762 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:03,763 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:03,763 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:55:03,763 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:55:03,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:55:03,763 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:03,763 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 20:55:03,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:03,764 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:03,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 20:55:03,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:03,764 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:03,764 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-02-09 20:55:03,764 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:03,764 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-02-09 20:55:03,764 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:55:03,764 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-02-09 20:55:03,764 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 20:55:03,764 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 20:55:03,764 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675976096855.7b664758b0f2a40178d815ef9f2c6c7f. 2023-02-09 20:55:03,764 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675976096855.7b664758b0f2a40178d815ef9f2c6c7f. started... 2023-02-09 20:55:03,765 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 7b664758b0f2a40178d815ef9f2c6c7f 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-09 20:55:04,176 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231380c1aa0261642efb05f1277f8becdcc to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151231380c1aa0261642efb05f1277f8becdcc 2023-02-09 20:55:04,581 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/7b664758b0f2a40178d815ef9f2c6c7f/.tmp/family1/797beb88f14045329caa21485aa7f8a6 2023-02-09 20:55:04,586 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/7b664758b0f2a40178d815ef9f2c6c7f/.tmp/family1/797beb88f14045329caa21485aa7f8a6 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/7b664758b0f2a40178d815ef9f2c6c7f/family1/797beb88f14045329caa21485aa7f8a6 2023-02-09 20:55:04,590 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/7b664758b0f2a40178d815ef9f2c6c7f/family1/797beb88f14045329caa21485aa7f8a6, entries=1, sequenceid=25, filesize=5.0 K 2023-02-09 20:55:04,590 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 7b664758b0f2a40178d815ef9f2c6c7f in 825ms, sequenceid=25, compaction requested=true 2023-02-09 20:55:04,590 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 7b664758b0f2a40178d815ef9f2c6c7f: 2023-02-09 20:55:04,590 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675976096855.7b664758b0f2a40178d815ef9f2c6c7f. 2023-02-09 20:55:04,590 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 20:55:04,590 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 20:55:04,590 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:04,591 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-02-09 20:55:04,591 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-02-09 20:55:04,593 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:04,593 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:04,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:04,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:55:04,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:55:04,593 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:04,593 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 20:55:04,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:55:04,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:55:04,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:04,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:04,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:55:04,594 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-02-09 20:55:04,594 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@8a6cf82[Count = 0] remaining members to acquire global barrier 2023-02-09 20:55:04,594 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-02-09 20:55:04,594 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:04,596 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:04,596 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:04,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:04,596 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-02-09 20:55:04,596 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-02-09 20:55:04,596 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:04,596 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 20:55:04,596 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase9.apache.org,40919,1675976022294' in zk 2023-02-09 20:55:04,597 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-02-09 20:55:04,597 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:04,597 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:55:04,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:04,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:55:04,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:55:04,597 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-02-09 20:55:04,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:55:04,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:55:04,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:04,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:04,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:55:04,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:04,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:04,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase9.apache.org,40919,1675976022294': 2023-02-09 20:55:04,599 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-02-09 20:55:04,599 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-02-09 20:55:04,599 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 20:55:04,599 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 20:55:04,599 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:04,600 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 20:55:04,601 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:04,601 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:04,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:04,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:55:04,601 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:04,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:04,601 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:55:04,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:55:04,601 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:04,601 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:55:04,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:55:04,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:55:04,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:04,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:04,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:55:04,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:04,602 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:04,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:04,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:55:04,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:04,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:04,607 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:04,607 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:04,607 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:04,607 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:55:04,607 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:04,607 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-09 20:55:04,607 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 20:55:04,607 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:04,607 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:55:04,607 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:55:04,607 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:55:04,607 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-02-09 20:55:04,607 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-02-09 20:55:04,608 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 20:55:04,607 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:04,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:55:04,608 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:04,608 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:55:04,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:55:04,708 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 20:55:04,708 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 20:55:04,712 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(933): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-02-09 20:55:04,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-02-09 20:55:04,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:04,713 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-09 20:55:04,713 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:55:04,713 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-02-09 20:55:04,713 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-02-09 20:55:04,714 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:04,714 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:04,717 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:04,717 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:55:04,717 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:55:04,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:55:04,718 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:04,718 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 20:55:04,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:04,718 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:04,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 20:55:04,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:04,718 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:04,719 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-02-09 20:55:04,719 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:04,719 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-02-09 20:55:04,719 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:55:04,719 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-02-09 20:55:04,719 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 20:55:04,719 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 20:55:04,719 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675976096855.7b664758b0f2a40178d815ef9f2c6c7f. 2023-02-09 20:55:04,719 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675976096855.7b664758b0f2a40178d815ef9f2c6c7f. started... 2023-02-09 20:55:04,719 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 7b664758b0f2a40178d815ef9f2c6c7f 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-09 20:55:05,130 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010172cfae8b63494046b47c03d920994d35 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2016010172cfae8b63494046b47c03d920994d35 2023-02-09 20:55:05,537 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/7b664758b0f2a40178d815ef9f2c6c7f/.tmp/family1/be926de8063e49d1a98a6b9bc0fae301 2023-02-09 20:55:05,541 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/7b664758b0f2a40178d815ef9f2c6c7f/.tmp/family1/be926de8063e49d1a98a6b9bc0fae301 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/7b664758b0f2a40178d815ef9f2c6c7f/family1/be926de8063e49d1a98a6b9bc0fae301 2023-02-09 20:55:05,544 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/7b664758b0f2a40178d815ef9f2c6c7f/family1/be926de8063e49d1a98a6b9bc0fae301, entries=1, sequenceid=29, filesize=5.0 K 2023-02-09 20:55:05,545 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 7b664758b0f2a40178d815ef9f2c6c7f in 826ms, sequenceid=29, compaction requested=true 2023-02-09 20:55:05,545 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 7b664758b0f2a40178d815ef9f2c6c7f: 2023-02-09 20:55:05,545 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675976096855.7b664758b0f2a40178d815ef9f2c6c7f. 2023-02-09 20:55:05,545 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 20:55:05,545 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 20:55:05,545 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:05,545 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-02-09 20:55:05,545 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-02-09 20:55:05,547 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:05,547 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:05,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:05,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:55:05,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:55:05,547 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:05,547 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 20:55:05,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:55:05,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:55:05,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:05,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:05,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:55:05,548 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-02-09 20:55:05,548 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3d60a79[Count = 0] remaining members to acquire global barrier 2023-02-09 20:55:05,548 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-02-09 20:55:05,548 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:05,549 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:05,549 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:05,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:05,549 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-02-09 20:55:05,549 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-02-09 20:55:05,549 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase9.apache.org,40919,1675976022294' in zk 2023-02-09 20:55:05,549 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:05,550 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 20:55:05,550 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:05,550 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-02-09 20:55:05,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:05,551 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:55:05,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:55:05,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:55:05,551 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-02-09 20:55:05,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:55:05,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:55:05,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:05,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:05,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:55:05,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:05,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:05,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase9.apache.org,40919,1675976022294': 2023-02-09 20:55:05,553 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-02-09 20:55:05,553 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-02-09 20:55:05,553 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 20:55:05,553 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 20:55:05,553 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:05,553 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 20:55:05,555 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:05,555 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:05,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:05,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:55:05,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:55:05,555 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:05,555 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:55:05,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:05,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:55:05,555 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:05,555 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:55:05,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:55:05,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:05,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:05,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:55:05,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:05,556 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:05,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:05,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:55:05,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:05,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:05,558 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:05,558 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:55:05,558 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:05,558 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:55:05,558 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-09 20:55:05,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:55:05,558 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 20:55:05,558 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:55:05,558 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:05,558 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:55:05,558 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:05,558 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:05,558 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:05,558 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-02-09 20:55:05,559 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:55:05,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:55:05,558 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:05,559 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 20:55:05,659 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 20:55:05,660 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 20:55:05,664 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(933): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-02-09 20:55:05,665 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-02-09 20:55:05,665 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:05,665 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-09 20:55:05,665 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:55:05,666 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-02-09 20:55:05,666 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-02-09 20:55:05,666 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:05,666 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:05,667 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:05,667 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:55:05,667 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:55:05,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:55:05,667 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:05,667 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 20:55:05,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:05,668 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:05,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 20:55:05,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:05,668 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:05,679 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-02-09 20:55:05,679 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:05,679 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-02-09 20:55:05,679 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:55:05,679 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-02-09 20:55:05,679 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 20:55:05,679 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 20:55:05,679 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675976096855.7b664758b0f2a40178d815ef9f2c6c7f. 2023-02-09 20:55:05,679 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675976096855.7b664758b0f2a40178d815ef9f2c6c7f. started... 2023-02-09 20:55:05,679 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 7b664758b0f2a40178d815ef9f2c6c7f 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-09 20:55:06,093 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601036286b89f94e0436b882b6a77da2e8d1e to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201601036286b89f94e0436b882b6a77da2e8d1e 2023-02-09 20:55:06,498 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/7b664758b0f2a40178d815ef9f2c6c7f/.tmp/family1/fcb037499b454817b5b251f7450a41d4 2023-02-09 20:55:06,503 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/7b664758b0f2a40178d815ef9f2c6c7f/.tmp/family1/fcb037499b454817b5b251f7450a41d4 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/7b664758b0f2a40178d815ef9f2c6c7f/family1/fcb037499b454817b5b251f7450a41d4 2023-02-09 20:55:06,507 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/7b664758b0f2a40178d815ef9f2c6c7f/family1/fcb037499b454817b5b251f7450a41d4, entries=1, sequenceid=33, filesize=5.0 K 2023-02-09 20:55:06,508 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 7b664758b0f2a40178d815ef9f2c6c7f in 829ms, sequenceid=33, compaction requested=true 2023-02-09 20:55:06,508 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 7b664758b0f2a40178d815ef9f2c6c7f: 2023-02-09 20:55:06,508 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675976096855.7b664758b0f2a40178d815ef9f2c6c7f. 2023-02-09 20:55:06,508 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 20:55:06,509 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 20:55:06,509 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:06,509 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-02-09 20:55:06,509 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-02-09 20:55:06,510 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:06,510 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:06,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:06,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:55:06,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:55:06,510 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:06,510 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 20:55:06,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:55:06,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:55:06,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:06,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:06,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:55:06,512 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-02-09 20:55:06,512 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-02-09 20:55:06,512 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4e7dddf9[Count = 0] remaining members to acquire global barrier 2023-02-09 20:55:06,512 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:06,514 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:06,514 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:06,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:06,514 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-02-09 20:55:06,514 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-02-09 20:55:06,514 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:06,514 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 20:55:06,514 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase9.apache.org,40919,1675976022294' in zk 2023-02-09 20:55:06,515 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:06,515 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-02-09 20:55:06,515 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:55:06,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:06,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:55:06,515 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-02-09 20:55:06,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:55:06,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:55:06,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:55:06,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:06,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:06,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:55:06,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:06,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:06,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase9.apache.org,40919,1675976022294': 2023-02-09 20:55:06,518 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-02-09 20:55:06,518 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-02-09 20:55:06,518 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 20:55:06,518 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 20:55:06,518 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:06,518 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 20:55:06,519 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:06,519 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:06,519 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:06,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:06,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:55:06,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:55:06,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:06,519 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:55:06,520 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:06,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:55:06,520 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:55:06,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:55:06,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:06,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:06,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:55:06,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:06,521 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:06,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:06,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:55:06,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:06,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:06,523 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:06,523 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:06,523 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:55:06,523 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:06,523 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:55:06,523 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:06,523 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:06,523 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:55:06,523 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-09 20:55:06,523 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 20:55:06,523 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:55:06,523 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:06,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:55:06,523 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:06,523 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-02-09 20:55:06,523 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 20:55:06,523 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-02-09 20:55:06,523 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:55:06,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:55:06,623 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 20:55:06,624 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 20:55:06,628 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(933): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-02-09 20:55:06,629 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-02-09 20:55:06,629 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:06,629 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-09 20:55:06,629 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:55:06,629 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-02-09 20:55:06,629 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-02-09 20:55:06,630 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:06,630 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:06,632 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:55:06,632 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:06,632 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:55:06,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:55:06,632 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:06,632 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 20:55:06,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:06,632 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:06,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 20:55:06,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:06,633 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:06,633 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-02-09 20:55:06,633 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:06,633 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-02-09 20:55:06,633 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:55:06,633 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-02-09 20:55:06,633 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 20:55:06,633 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 20:55:06,633 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675976096855.7b664758b0f2a40178d815ef9f2c6c7f. 2023-02-09 20:55:06,633 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675976096855.7b664758b0f2a40178d815ef9f2c6c7f. started... 2023-02-09 20:55:06,633 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 7b664758b0f2a40178d815ef9f2c6c7f 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-09 20:55:07,048 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201509075a7c095503c34fae893ab7771f8014ec to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201509075a7c095503c34fae893ab7771f8014ec 2023-02-09 20:55:07,453 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/7b664758b0f2a40178d815ef9f2c6c7f/.tmp/family1/cf56b74f0411470c9e028c9a8a7233b9 2023-02-09 20:55:07,458 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/7b664758b0f2a40178d815ef9f2c6c7f/.tmp/family1/cf56b74f0411470c9e028c9a8a7233b9 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/7b664758b0f2a40178d815ef9f2c6c7f/family1/cf56b74f0411470c9e028c9a8a7233b9 2023-02-09 20:55:07,461 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/7b664758b0f2a40178d815ef9f2c6c7f/family1/cf56b74f0411470c9e028c9a8a7233b9, entries=1, sequenceid=37, filesize=5.0 K 2023-02-09 20:55:07,462 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 7b664758b0f2a40178d815ef9f2c6c7f in 829ms, sequenceid=37, compaction requested=true 2023-02-09 20:55:07,462 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 7b664758b0f2a40178d815ef9f2c6c7f: 2023-02-09 20:55:07,462 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675976096855.7b664758b0f2a40178d815ef9f2c6c7f. 2023-02-09 20:55:07,462 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 20:55:07,462 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 20:55:07,462 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:07,462 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-02-09 20:55:07,462 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-02-09 20:55:07,464 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:07,464 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:07,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:07,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:55:07,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:55:07,464 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:07,464 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 20:55:07,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:55:07,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:55:07,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:07,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:07,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:55:07,466 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-02-09 20:55:07,466 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7c6fb5d5[Count = 0] remaining members to acquire global barrier 2023-02-09 20:55:07,466 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-02-09 20:55:07,466 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:07,467 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:07,467 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:07,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:07,467 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-02-09 20:55:07,467 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-02-09 20:55:07,467 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase9.apache.org,40919,1675976022294' in zk 2023-02-09 20:55:07,467 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:07,467 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 20:55:07,468 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:07,468 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-02-09 20:55:07,468 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:55:07,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:07,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:55:07,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:55:07,468 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-02-09 20:55:07,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:55:07,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:55:07,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:07,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:07,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:55:07,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:07,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:07,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase9.apache.org,40919,1675976022294': 2023-02-09 20:55:07,470 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-02-09 20:55:07,470 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-02-09 20:55:07,470 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 20:55:07,470 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 20:55:07,470 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:07,471 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 20:55:07,472 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:07,473 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:55:07,473 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:07,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:07,473 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:07,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:07,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:55:07,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:55:07,473 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:55:07,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:55:07,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:55:07,473 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:07,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:07,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:07,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:55:07,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:07,474 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:07,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:07,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:55:07,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:07,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:07,476 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:07,476 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:07,476 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:55:07,476 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:07,476 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-09 20:55:07,476 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 20:55:07,476 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:07,476 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:55:07,476 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:55:07,476 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:55:07,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:55:07,476 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:07,477 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-02-09 20:55:07,477 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 20:55:07,477 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:07,477 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:55:07,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:55:07,477 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:07,577 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 20:55:07,578 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 20:55:07,581 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(933): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-02-09 20:55:07,582 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-02-09 20:55:07,582 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:07,582 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-09 20:55:07,582 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:55:07,583 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-02-09 20:55:07,583 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-02-09 20:55:07,583 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:07,583 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:07,584 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:07,584 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:55:07,584 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:55:07,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:55:07,584 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:07,584 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 20:55:07,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:07,585 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:07,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 20:55:07,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:07,585 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:07,585 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-02-09 20:55:07,585 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:07,585 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-02-09 20:55:07,585 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:55:07,585 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-02-09 20:55:07,586 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 20:55:07,586 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 20:55:07,586 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675976096855.7b664758b0f2a40178d815ef9f2c6c7f. 2023-02-09 20:55:07,586 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675976096855.7b664758b0f2a40178d815ef9f2c6c7f. started... 2023-02-09 20:55:07,586 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 7b664758b0f2a40178d815ef9f2c6c7f 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-09 20:55:07,998 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511206fe249433eb84bd693d491e1a5361858 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511206fe249433eb84bd693d491e1a5361858 2023-02-09 20:55:08,403 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/7b664758b0f2a40178d815ef9f2c6c7f/.tmp/family1/b83a2830bb1b4aa290ba8172e224e6bd 2023-02-09 20:55:08,408 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/7b664758b0f2a40178d815ef9f2c6c7f/.tmp/family1/b83a2830bb1b4aa290ba8172e224e6bd as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/7b664758b0f2a40178d815ef9f2c6c7f/family1/b83a2830bb1b4aa290ba8172e224e6bd 2023-02-09 20:55:08,411 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/7b664758b0f2a40178d815ef9f2c6c7f/family1/b83a2830bb1b4aa290ba8172e224e6bd, entries=1, sequenceid=41, filesize=5.0 K 2023-02-09 20:55:08,412 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 7b664758b0f2a40178d815ef9f2c6c7f in 826ms, sequenceid=41, compaction requested=true 2023-02-09 20:55:08,412 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 7b664758b0f2a40178d815ef9f2c6c7f: 2023-02-09 20:55:08,412 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675976096855.7b664758b0f2a40178d815ef9f2c6c7f. 2023-02-09 20:55:08,412 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 20:55:08,413 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 20:55:08,413 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:08,413 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-02-09 20:55:08,413 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-02-09 20:55:08,414 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:08,414 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:08,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:08,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:55:08,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:55:08,414 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:08,414 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 20:55:08,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:55:08,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:55:08,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:08,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:08,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:55:08,415 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-02-09 20:55:08,416 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@420bbf05[Count = 0] remaining members to acquire global barrier 2023-02-09 20:55:08,416 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-02-09 20:55:08,416 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:08,418 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:08,418 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:08,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:08,418 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-02-09 20:55:08,418 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-02-09 20:55:08,418 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:08,418 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 20:55:08,418 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase9.apache.org,40919,1675976022294' in zk 2023-02-09 20:55:08,419 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:08,419 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-02-09 20:55:08,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:08,419 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:55:08,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:55:08,419 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-02-09 20:55:08,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:55:08,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:55:08,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:55:08,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:08,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:08,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:55:08,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:08,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:08,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase9.apache.org,40919,1675976022294': 2023-02-09 20:55:08,421 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-02-09 20:55:08,421 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-02-09 20:55:08,421 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 20:55:08,421 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 20:55:08,421 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:08,422 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 20:55:08,423 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:08,423 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:08,423 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:55:08,423 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:08,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:08,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:08,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:55:08,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:55:08,423 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:55:08,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:55:08,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:55:08,423 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:08,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:08,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:08,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:55:08,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:08,425 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:08,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:08,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:55:08,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:08,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:08,427 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:55:08,427 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:08,427 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:55:08,427 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:55:08,427 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:55:08,427 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-02-09 20:55:08,427 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-09 20:55:08,427 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 20:55:08,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:55:08,427 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:08,427 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:08,427 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:08,427 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:08,427 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:08,427 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:08,427 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-02-09 20:55:08,428 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 20:55:08,427 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:55:08,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:55:08,528 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 20:55:08,528 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 20:55:08,529 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=42951] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:08,531 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1675976025848] procedure2.ProcedureExecutor(1029): Stored pid=58, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-02-09 20:55:08,532 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=58, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-02-09 20:55:08,532 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1675976025848] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-09 20:55:08,532 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=58, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1675976708532 2023-02-09 20:55:08,534 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1675976025848] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-09 20:55:08,535 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1675976025848] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-02-09 20:55:08,535 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1675976025848] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-09 20:55:08,536 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1675976025848] zookeeper.ReadOnlyZKClient(139): Connect 0x0c2291c3 to 127.0.0.1:62089 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 20:55:08,541 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1675976025848] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7eb8b160, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 20:55:08,541 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-09 20:55:09,375 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010321779adb75d9468da3fc70fc3049a410 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2016010321779adb75d9468da3fc70fc3049a410 2023-02-09 20:55:09,376 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-09 20:55:09,388 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 20:55:09,389 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:36646, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 20:55:09,395 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-09 20:55:09,396 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:57402, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-09 20:55:09,406 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/c384d2f73439462089c231c5639d0dbf first=Optional[r3] last=Optional[r6] 2023-02-09 20:55:09,407 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675976096855.7b664758b0f2a40178d815ef9f2c6c7f., hostname=jenkins-hbase9.apache.org,40919,1675976022294, seqNum=2 for row with hfile group [{family1,hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/c384d2f73439462089c231c5639d0dbf}] 2023-02-09 20:55:09,411 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HStore(763): Validating hfile at hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/c384d2f73439462089c231c5639d0dbf for inclusion in 7b664758b0f2a40178d815ef9f2c6c7f/family1 2023-02-09 20:55:09,414 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-02-09 20:55:09,414 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HStore(777): Region bounds: first= last= 2023-02-09 20:55:09,414 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HRegion(2445): Flush status journal for 7b664758b0f2a40178d815ef9f2c6c7f: 2023-02-09 20:55:09,414 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/c384d2f73439462089c231c5639d0dbf to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__fbdhjd914qnvkn4mpaopde0in1ihekkqb2s96lcqi3204u5g2djo6f79t4i7p8ma/family1/c384d2f73439462089c231c5639d0dbf 2023-02-09 20:55:09,417 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__fbdhjd914qnvkn4mpaopde0in1ihekkqb2s96lcqi3204u5g2djo6f79t4i7p8ma/family1/c384d2f73439462089c231c5639d0dbf as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/7b664758b0f2a40178d815ef9f2c6c7f/family1/30d9ff00b454499d9817480d6572f7f8_SeqId_44_ 2023-02-09 20:55:09,417 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HStore(849): Loaded HFile hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__fbdhjd914qnvkn4mpaopde0in1ihekkqb2s96lcqi3204u5g2djo6f79t4i7p8ma/family1/c384d2f73439462089c231c5639d0dbf into 7b664758b0f2a40178d815ef9f2c6c7f/family1 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/7b664758b0f2a40178d815ef9f2c6c7f/family1/30d9ff00b454499d9817480d6572f7f8_SeqId_44_ - updating store file list. 2023-02-09 20:55:09,420 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HStore(882): Loaded HFile hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/7b664758b0f2a40178d815ef9f2c6c7f/family1/30d9ff00b454499d9817480d6572f7f8_SeqId_44_ into 7b664758b0f2a40178d815ef9f2c6c7f/family1 2023-02-09 20:55:09,421 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HStore(855): Successfully loaded hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__fbdhjd914qnvkn4mpaopde0in1ihekkqb2s96lcqi3204u5g2djo6f79t4i7p8ma/family1/c384d2f73439462089c231c5639d0dbf into 7b664758b0f2a40178d815ef9f2c6c7f/family1 (new location: hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/7b664758b0f2a40178d815ef9f2c6c7f/family1/30d9ff00b454499d9817480d6572f7f8_SeqId_44_) 2023-02-09 20:55:09,421 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__fbdhjd914qnvkn4mpaopde0in1ihekkqb2s96lcqi3204u5g2djo6f79t4i7p8ma/family1/c384d2f73439462089c231c5639d0dbf 2023-02-09 20:55:09,421 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-02-09 20:55:09,424 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51552 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-02-09 20:55:09,424 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HStore(1912): 7b664758b0f2a40178d815ef9f2c6c7f/family1 is initiating minor compaction 2023-02-09 20:55:09,424 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@d730bff; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-09 20:55:09,424 INFO [RS:0;jenkins-hbase9:40919-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 7b664758b0f2a40178d815ef9f2c6c7f/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675976096855.7b664758b0f2a40178d815ef9f2c6c7f. 2023-02-09 20:55:09,424 INFO [RS:0;jenkins-hbase9:40919-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/7b664758b0f2a40178d815ef9f2c6c7f/family1/6bfb7b92fbb448ecaedb082843bde28e, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/7b664758b0f2a40178d815ef9f2c6c7f/family1/295ad02c1f754c0883384ac1ffc9f536, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/7b664758b0f2a40178d815ef9f2c6c7f/family1/d89817c60c69445889fe12fb72e7809a, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/7b664758b0f2a40178d815ef9f2c6c7f/family1/24dfe1eda66945378999cfdebdd33e09, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/7b664758b0f2a40178d815ef9f2c6c7f/family1/797beb88f14045329caa21485aa7f8a6, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/7b664758b0f2a40178d815ef9f2c6c7f/family1/be926de8063e49d1a98a6b9bc0fae301, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/7b664758b0f2a40178d815ef9f2c6c7f/family1/fcb037499b454817b5b251f7450a41d4, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/7b664758b0f2a40178d815ef9f2c6c7f/family1/cf56b74f0411470c9e028c9a8a7233b9, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/7b664758b0f2a40178d815ef9f2c6c7f/family1/b83a2830bb1b4aa290ba8172e224e6bd, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/7b664758b0f2a40178d815ef9f2c6c7f/family1/30d9ff00b454499d9817480d6572f7f8_SeqId_44_] into tmpdir=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/7b664758b0f2a40178d815ef9f2c6c7f/.tmp, totalSize=50.3 K 2023-02-09 20:55:09,424 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] compactions.Compactor(207): Compacting 6bfb7b92fbb448ecaedb082843bde28e, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-02-09 20:55:09,424 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] compactions.Compactor(207): Compacting 295ad02c1f754c0883384ac1ffc9f536, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-02-09 20:55:09,424 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] compactions.Compactor(207): Compacting d89817c60c69445889fe12fb72e7809a, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-02-09 20:55:09,424 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] compactions.Compactor(207): Compacting 24dfe1eda66945378999cfdebdd33e09, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-02-09 20:55:09,424 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] compactions.Compactor(207): Compacting 797beb88f14045329caa21485aa7f8a6, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-02-09 20:55:09,424 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] compactions.Compactor(207): Compacting be926de8063e49d1a98a6b9bc0fae301, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-02-09 20:55:09,424 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] compactions.Compactor(207): Compacting fcb037499b454817b5b251f7450a41d4, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-02-09 20:55:09,425 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] compactions.Compactor(207): Compacting cf56b74f0411470c9e028c9a8a7233b9, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-02-09 20:55:09,425 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] compactions.Compactor(207): Compacting b83a2830bb1b4aa290ba8172e224e6bd, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-02-09 20:55:09,425 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] compactions.Compactor(207): Compacting 30d9ff00b454499d9817480d6572f7f8_SeqId_44_, keycount=4, bloomtype=ROW, size=5.6 K, encoding=NONE, compression=NONE, seqNum=45 2023-02-09 20:55:09,426 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-09 20:55:09,427 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 20:55:09,428 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512285016d40fc9f3491390e06bca7944fa52 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512285016d40fc9f3491390e06bca7944fa52 2023-02-09 20:55:09,429 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151231380c1aa0261642efb05f1277f8becdcc to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151231380c1aa0261642efb05f1277f8becdcc 2023-02-09 20:55:09,431 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2016010172cfae8b63494046b47c03d920994d35 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2016010172cfae8b63494046b47c03d920994d35 2023-02-09 20:55:09,432 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201601036286b89f94e0436b882b6a77da2e8d1e to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201601036286b89f94e0436b882b6a77da2e8d1e 2023-02-09 20:55:09,432 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 4 expired mob files are deleted 2023-02-09 20:55:09,432 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-02-09 20:55:09,432 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-09 20:55:09,432 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-09 20:55:09,432 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-09 20:55:09,432 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-09 20:55:09,432 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-09 20:55:09,432 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-09 20:55:09,433 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-09 20:55:09,433 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-09 20:55:09,460 INFO [RS:0;jenkins-hbase9:40919-shortCompactions-0] throttle.PressureAwareThroughputController(145): 7b664758b0f2a40178d815ef9f2c6c7f#family1#compaction#72 average throughput is 0.79 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-09 20:55:10,274 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/7b664758b0f2a40178d815ef9f2c6c7f/.tmp/family1/65393805bcbd438d9be48d0b0d2b9c56 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/7b664758b0f2a40178d815ef9f2c6c7f/family1/65393805bcbd438d9be48d0b0d2b9c56 2023-02-09 20:55:10,279 INFO [RS:0;jenkins-hbase9:40919-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 7b664758b0f2a40178d815ef9f2c6c7f/family1 of 7b664758b0f2a40178d815ef9f2c6c7f into 65393805bcbd438d9be48d0b0d2b9c56(size=6.8 K), total size for store is 197.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-09 20:55:10,279 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 7b664758b0f2a40178d815ef9f2c6c7f: 2023-02-09 20:55:10,279 INFO [RS:0;jenkins-hbase9:40919-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675976096855.7b664758b0f2a40178d815ef9f2c6c7f., storeName=family1, fileCount=10, fileSize=50.3 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.6 K), priority=2, time=1675976109424; duration=0sec 2023-02-09 20:55:10,279 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-09 20:55:10,279 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205c9591e4c53964699be5dbbbd77144b97 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151205c9591e4c53964699be5dbbbd77144b97 2023-02-09 20:55:10,280 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-09 20:55:10,303 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/464bacd28c1d4cf2826341d2e397cb49 first=Optional[r00] last=Optional[r2] 2023-02-09 20:55:10,303 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675976096855.7b664758b0f2a40178d815ef9f2c6c7f., hostname=jenkins-hbase9.apache.org,40919,1675976022294, seqNum=2 for row with hfile group [{family1,hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/464bacd28c1d4cf2826341d2e397cb49}] 2023-02-09 20:55:10,305 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HStore(763): Validating hfile at hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/464bacd28c1d4cf2826341d2e397cb49 for inclusion in 7b664758b0f2a40178d815ef9f2c6c7f/family1 2023-02-09 20:55:10,309 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-02-09 20:55:10,309 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HStore(777): Region bounds: first= last= 2023-02-09 20:55:10,309 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HRegion(2445): Flush status journal for 7b664758b0f2a40178d815ef9f2c6c7f: 2023-02-09 20:55:10,310 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/464bacd28c1d4cf2826341d2e397cb49 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__hmq133is2qe7o0ikk7qo2s3gf7hqm39evjl4vj5s8msnubq5j6mu0vfm1qfqkg6h/family1/464bacd28c1d4cf2826341d2e397cb49 2023-02-09 20:55:10,312 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__hmq133is2qe7o0ikk7qo2s3gf7hqm39evjl4vj5s8msnubq5j6mu0vfm1qfqkg6h/family1/464bacd28c1d4cf2826341d2e397cb49 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/7b664758b0f2a40178d815ef9f2c6c7f/family1/f9efdc4c02734cd79420408384444a44_SeqId_47_ 2023-02-09 20:55:10,312 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HStore(849): Loaded HFile hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__hmq133is2qe7o0ikk7qo2s3gf7hqm39evjl4vj5s8msnubq5j6mu0vfm1qfqkg6h/family1/464bacd28c1d4cf2826341d2e397cb49 into 7b664758b0f2a40178d815ef9f2c6c7f/family1 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/7b664758b0f2a40178d815ef9f2c6c7f/family1/f9efdc4c02734cd79420408384444a44_SeqId_47_ - updating store file list. 2023-02-09 20:55:10,315 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HStore(882): Loaded HFile hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/7b664758b0f2a40178d815ef9f2c6c7f/family1/f9efdc4c02734cd79420408384444a44_SeqId_47_ into 7b664758b0f2a40178d815ef9f2c6c7f/family1 2023-02-09 20:55:10,315 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HStore(855): Successfully loaded hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__hmq133is2qe7o0ikk7qo2s3gf7hqm39evjl4vj5s8msnubq5j6mu0vfm1qfqkg6h/family1/464bacd28c1d4cf2826341d2e397cb49 into 7b664758b0f2a40178d815ef9f2c6c7f/family1 (new location: hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/7b664758b0f2a40178d815ef9f2c6c7f/family1/f9efdc4c02734cd79420408384444a44_SeqId_47_) 2023-02-09 20:55:10,316 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__hmq133is2qe7o0ikk7qo2s3gf7hqm39evjl4vj5s8msnubq5j6mu0vfm1qfqkg6h/family1/464bacd28c1d4cf2826341d2e397cb49 2023-02-09 20:55:10,316 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-02-09 20:55:10,317 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 397422 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-02-09 20:55:10,317 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HStore(1912): 7b664758b0f2a40178d815ef9f2c6c7f/family1 is initiating minor compaction (all files) 2023-02-09 20:55:10,317 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@6da24861; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-09 20:55:10,317 INFO [RS:0;jenkins-hbase9:40919-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 7b664758b0f2a40178d815ef9f2c6c7f/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675976096855.7b664758b0f2a40178d815ef9f2c6c7f. 2023-02-09 20:55:10,317 INFO [RS:0;jenkins-hbase9:40919-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/7b664758b0f2a40178d815ef9f2c6c7f/family1/4f2c62a09be147ee83c82d5312317dc3, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/7b664758b0f2a40178d815ef9f2c6c7f/family1/65393805bcbd438d9be48d0b0d2b9c56, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/7b664758b0f2a40178d815ef9f2c6c7f/family1/f9efdc4c02734cd79420408384444a44_SeqId_47_] into tmpdir=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/7b664758b0f2a40178d815ef9f2c6c7f/.tmp, totalSize=388.1 K 2023-02-09 20:55:10,317 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] compactions.Compactor(207): Compacting 4f2c62a09be147ee83c82d5312317dc3, keycount=1000, bloomtype=ROW, size=190.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878845982 2023-02-09 20:55:10,318 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] compactions.Compactor(207): Compacting 65393805bcbd438d9be48d0b0d2b9c56, keycount=9, bloomtype=ROW, size=6.8 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621245982 2023-02-09 20:55:10,318 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] compactions.Compactor(207): Compacting f9efdc4c02734cd79420408384444a44_SeqId_47_, keycount=1002, bloomtype=ROW, size=190.9 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878845982 2023-02-09 20:55:10,318 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-09 20:55:10,319 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 20:55:10,320 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151130d1fca72c91d44b2d8f876aa6cd7de946 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151130d1fca72c91d44b2d8f876aa6cd7de946 2023-02-09 20:55:10,321 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015120151932f5bbdad42de9d699b81ab92ca87 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015120151932f5bbdad42de9d699b81ab92ca87 2023-02-09 20:55:10,322 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151205610505aff46042cab3dcd786a88c49d4 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151205610505aff46042cab3dcd786a88c49d4 2023-02-09 20:55:10,322 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 3 expired mob files are deleted 2023-02-09 20:55:10,322 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-02-09 20:55:10,323 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-09 20:55:10,323 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1675976025848] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-09 20:55:10,323 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1675976025848] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-09 20:55:10,324 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=58, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-02-09 20:55:10,325 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=58, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 1.7940 sec 2023-02-09 20:55:10,332 INFO [RS:0;jenkins-hbase9:40919-shortCompactions-0] throttle.PressureAwareThroughputController(145): 7b664758b0f2a40178d815ef9f2c6c7f#family1#compaction#73 average throughput is 25.66 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-09 20:55:10,362 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/7b664758b0f2a40178d815ef9f2c6c7f/family1/6bfb7b92fbb448ecaedb082843bde28e, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/7b664758b0f2a40178d815ef9f2c6c7f/family1/295ad02c1f754c0883384ac1ffc9f536, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/7b664758b0f2a40178d815ef9f2c6c7f/family1/d89817c60c69445889fe12fb72e7809a, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/7b664758b0f2a40178d815ef9f2c6c7f/family1/24dfe1eda66945378999cfdebdd33e09, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/7b664758b0f2a40178d815ef9f2c6c7f/family1/797beb88f14045329caa21485aa7f8a6, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/7b664758b0f2a40178d815ef9f2c6c7f/family1/be926de8063e49d1a98a6b9bc0fae301, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/7b664758b0f2a40178d815ef9f2c6c7f/family1/fcb037499b454817b5b251f7450a41d4, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/7b664758b0f2a40178d815ef9f2c6c7f/family1/cf56b74f0411470c9e028c9a8a7233b9, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/7b664758b0f2a40178d815ef9f2c6c7f/family1/b83a2830bb1b4aa290ba8172e224e6bd, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/7b664758b0f2a40178d815ef9f2c6c7f/family1/30d9ff00b454499d9817480d6572f7f8_SeqId_44_] to archive 2023-02-09 20:55:10,363 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 20:55:10,364 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/7b664758b0f2a40178d815ef9f2c6c7f/family1/6bfb7b92fbb448ecaedb082843bde28e to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/7b664758b0f2a40178d815ef9f2c6c7f/family1/6bfb7b92fbb448ecaedb082843bde28e 2023-02-09 20:55:10,365 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/7b664758b0f2a40178d815ef9f2c6c7f/family1/295ad02c1f754c0883384ac1ffc9f536 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/7b664758b0f2a40178d815ef9f2c6c7f/family1/295ad02c1f754c0883384ac1ffc9f536 2023-02-09 20:55:10,367 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/7b664758b0f2a40178d815ef9f2c6c7f/family1/d89817c60c69445889fe12fb72e7809a to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/7b664758b0f2a40178d815ef9f2c6c7f/family1/d89817c60c69445889fe12fb72e7809a 2023-02-09 20:55:10,368 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/7b664758b0f2a40178d815ef9f2c6c7f/family1/24dfe1eda66945378999cfdebdd33e09 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/7b664758b0f2a40178d815ef9f2c6c7f/family1/24dfe1eda66945378999cfdebdd33e09 2023-02-09 20:55:10,369 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/7b664758b0f2a40178d815ef9f2c6c7f/family1/797beb88f14045329caa21485aa7f8a6 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/7b664758b0f2a40178d815ef9f2c6c7f/family1/797beb88f14045329caa21485aa7f8a6 2023-02-09 20:55:10,376 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/7b664758b0f2a40178d815ef9f2c6c7f/family1/be926de8063e49d1a98a6b9bc0fae301 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/7b664758b0f2a40178d815ef9f2c6c7f/family1/be926de8063e49d1a98a6b9bc0fae301 2023-02-09 20:55:10,377 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/7b664758b0f2a40178d815ef9f2c6c7f/family1/fcb037499b454817b5b251f7450a41d4 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/7b664758b0f2a40178d815ef9f2c6c7f/family1/fcb037499b454817b5b251f7450a41d4 2023-02-09 20:55:10,379 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/7b664758b0f2a40178d815ef9f2c6c7f/family1/cf56b74f0411470c9e028c9a8a7233b9 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/7b664758b0f2a40178d815ef9f2c6c7f/family1/cf56b74f0411470c9e028c9a8a7233b9 2023-02-09 20:55:10,381 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/7b664758b0f2a40178d815ef9f2c6c7f/family1/b83a2830bb1b4aa290ba8172e224e6bd to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/7b664758b0f2a40178d815ef9f2c6c7f/family1/b83a2830bb1b4aa290ba8172e224e6bd 2023-02-09 20:55:10,382 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/7b664758b0f2a40178d815ef9f2c6c7f/family1/30d9ff00b454499d9817480d6572f7f8_SeqId_44_ to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/7b664758b0f2a40178d815ef9f2c6c7f/family1/30d9ff00b454499d9817480d6572f7f8_SeqId_44_ 2023-02-09 20:55:10,402 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.HMaster$12(2441): Client=jenkins//172.31.2.10 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-02-09 20:55:10,403 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure2.ProcedureExecutor(1029): Stored pid=59, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:10,814 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-02-09 20:55:10,815 DEBUG [PEWorker-2] util.FSTableDescriptors(519): Deleted hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000001 2023-02-09 20:55:10,815 INFO [PEWorker-2] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-02-09 20:55:10,817 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=60, ppid=59, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily}] 2023-02-09 20:55:10,819 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=7b664758b0f2a40178d815ef9f2c6c7f, REOPEN/MOVE}] 2023-02-09 20:55:10,819 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=7b664758b0f2a40178d815ef9f2c6c7f, REOPEN/MOVE 2023-02-09 20:55:10,820 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=7b664758b0f2a40178d815ef9f2c6c7f, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:10,820 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675976096855.7b664758b0f2a40178d815ef9f2c6c7f.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1675976110820"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675976110820"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675976110820"}]},"ts":"1675976110820"} 2023-02-09 20:55:10,821 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=62, ppid=61, state=RUNNABLE; CloseRegionProcedure 7b664758b0f2a40178d815ef9f2c6c7f, server=jenkins-hbase9.apache.org,40919,1675976022294}] 2023-02-09 20:55:10,973 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(109): Close 7b664758b0f2a40178d815ef9f2c6c7f 2023-02-09 20:55:10,973 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing 7b664758b0f2a40178d815ef9f2c6c7f, disabling compactions & flushes 2023-02-09 20:55:10,973 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1857): waiting for 1 compactions to complete for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675976096855.7b664758b0f2a40178d815ef9f2c6c7f. 2023-02-09 20:55:11,549 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/7b664758b0f2a40178d815ef9f2c6c7f/.tmp/family1/f6c05944a6a74899ae0f20e40a56b658 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/7b664758b0f2a40178d815ef9f2c6c7f/family1/f6c05944a6a74899ae0f20e40a56b658 2023-02-09 20:55:11,553 INFO [RS:0;jenkins-hbase9:40919-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 7b664758b0f2a40178d815ef9f2c6c7f/family1 of 7b664758b0f2a40178d815ef9f2c6c7f into f6c05944a6a74899ae0f20e40a56b658(size=192.0 K), total size for store is 192.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-09 20:55:11,553 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 7b664758b0f2a40178d815ef9f2c6c7f: 2023-02-09 20:55:11,553 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675976096855.7b664758b0f2a40178d815ef9f2c6c7f. 2023-02-09 20:55:11,553 INFO [RS:0;jenkins-hbase9:40919-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675976096855.7b664758b0f2a40178d815ef9f2c6c7f., storeName=family1, fileCount=3, fileSize=388.1 K (190.5 K, 6.8 K, 190.9 K), priority=2, time=1675976110317; duration=1sec 2023-02-09 20:55:11,553 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675976096855.7b664758b0f2a40178d815ef9f2c6c7f. 2023-02-09 20:55:11,553 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675976096855.7b664758b0f2a40178d815ef9f2c6c7f. after waiting 0 ms 2023-02-09 20:55:11,553 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-09 20:55:11,553 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675976096855.7b664758b0f2a40178d815ef9f2c6c7f. 2023-02-09 20:55:11,557 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675976096855.7b664758b0f2a40178d815ef9f2c6c7f.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/7b664758b0f2a40178d815ef9f2c6c7f/family1/4f2c62a09be147ee83c82d5312317dc3, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/7b664758b0f2a40178d815ef9f2c6c7f/family1/65393805bcbd438d9be48d0b0d2b9c56, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/7b664758b0f2a40178d815ef9f2c6c7f/family1/f9efdc4c02734cd79420408384444a44_SeqId_47_] to archive 2023-02-09 20:55:11,557 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675976096855.7b664758b0f2a40178d815ef9f2c6c7f.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 20:55:11,559 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675976096855.7b664758b0f2a40178d815ef9f2c6c7f.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/7b664758b0f2a40178d815ef9f2c6c7f/family1/4f2c62a09be147ee83c82d5312317dc3 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/7b664758b0f2a40178d815ef9f2c6c7f/family1/4f2c62a09be147ee83c82d5312317dc3 2023-02-09 20:55:11,560 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675976096855.7b664758b0f2a40178d815ef9f2c6c7f.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/7b664758b0f2a40178d815ef9f2c6c7f/family1/65393805bcbd438d9be48d0b0d2b9c56 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/7b664758b0f2a40178d815ef9f2c6c7f/family1/65393805bcbd438d9be48d0b0d2b9c56 2023-02-09 20:55:11,561 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675976096855.7b664758b0f2a40178d815ef9f2c6c7f.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/7b664758b0f2a40178d815ef9f2c6c7f/family1/f9efdc4c02734cd79420408384444a44_SeqId_47_ to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/7b664758b0f2a40178d815ef9f2c6c7f/family1/f9efdc4c02734cd79420408384444a44_SeqId_47_ 2023-02-09 20:55:11,565 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/7b664758b0f2a40178d815ef9f2c6c7f/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-02-09 20:55:11,566 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675976096855.7b664758b0f2a40178d815ef9f2c6c7f. 2023-02-09 20:55:11,566 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for 7b664758b0f2a40178d815ef9f2c6c7f: Waiting for close lock at 1675976110973Running coprocessor pre-close hooks at 1675976110973Disabling compacts and flushes for region at 1675976110973Disabling writes for close at 1675976111553 (+580 ms)Writing region close event to WAL at 1675976111562 (+9 ms)Running coprocessor post-close hooks at 1675976111565 (+3 ms)Closed at 1675976111566 (+1 ms) 2023-02-09 20:55:11,566 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(3509): Not adding moved region record: 7b664758b0f2a40178d815ef9f2c6c7f to self. 2023-02-09 20:55:11,567 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(147): Closed 7b664758b0f2a40178d815ef9f2c6c7f 2023-02-09 20:55:11,567 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=7b664758b0f2a40178d815ef9f2c6c7f, regionState=CLOSED 2023-02-09 20:55:11,567 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675976096855.7b664758b0f2a40178d815ef9f2c6c7f.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1675976111567"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675976111567"}]},"ts":"1675976111567"} 2023-02-09 20:55:11,569 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=62, resume processing ppid=61 2023-02-09 20:55:11,569 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=62, ppid=61, state=SUCCESS; CloseRegionProcedure 7b664758b0f2a40178d815ef9f2c6c7f, server=jenkins-hbase9.apache.org,40919,1675976022294 in 747 msec 2023-02-09 20:55:11,570 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=7b664758b0f2a40178d815ef9f2c6c7f, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase9.apache.org,40919,1675976022294; forceNewPlan=false, retain=true 2023-02-09 20:55:11,720 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=7b664758b0f2a40178d815ef9f2c6c7f, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:11,720 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675976096855.7b664758b0f2a40178d815ef9f2c6c7f.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1675976111720"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675976111720"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675976111720"}]},"ts":"1675976111720"} 2023-02-09 20:55:11,722 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=63, ppid=61, state=RUNNABLE; OpenRegionProcedure 7b664758b0f2a40178d815ef9f2c6c7f, server=jenkins-hbase9.apache.org,40919,1675976022294}] 2023-02-09 20:55:11,876 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675976096855.7b664758b0f2a40178d815ef9f2c6c7f. 2023-02-09 20:55:11,876 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 7b664758b0f2a40178d815ef9f2c6c7f, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675976096855.7b664758b0f2a40178d815ef9f2c6c7f.', STARTKEY => '', ENDKEY => ''} 2023-02-09 20:55:11,876 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 7b664758b0f2a40178d815ef9f2c6c7f 2023-02-09 20:55:11,876 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675976096855.7b664758b0f2a40178d815ef9f2c6c7f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 20:55:11,876 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for 7b664758b0f2a40178d815ef9f2c6c7f 2023-02-09 20:55:11,876 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for 7b664758b0f2a40178d815ef9f2c6c7f 2023-02-09 20:55:11,877 INFO [StoreOpener-7b664758b0f2a40178d815ef9f2c6c7f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 7b664758b0f2a40178d815ef9f2c6c7f 2023-02-09 20:55:11,878 DEBUG [StoreOpener-7b664758b0f2a40178d815ef9f2c6c7f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/7b664758b0f2a40178d815ef9f2c6c7f/family1 2023-02-09 20:55:11,878 DEBUG [StoreOpener-7b664758b0f2a40178d815ef9f2c6c7f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/7b664758b0f2a40178d815ef9f2c6c7f/family1 2023-02-09 20:55:11,879 INFO [StoreOpener-7b664758b0f2a40178d815ef9f2c6c7f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7b664758b0f2a40178d815ef9f2c6c7f columnFamilyName family1 2023-02-09 20:55:11,883 DEBUG [StoreOpener-7b664758b0f2a40178d815ef9f2c6c7f-1] regionserver.HStore(539): loaded hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/7b664758b0f2a40178d815ef9f2c6c7f/family1/f6c05944a6a74899ae0f20e40a56b658 2023-02-09 20:55:11,883 INFO [StoreOpener-7b664758b0f2a40178d815ef9f2c6c7f-1] regionserver.HStore(310): Store=7b664758b0f2a40178d815ef9f2c6c7f/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 20:55:11,884 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/7b664758b0f2a40178d815ef9f2c6c7f 2023-02-09 20:55:11,885 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/7b664758b0f2a40178d815ef9f2c6c7f 2023-02-09 20:55:11,887 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for 7b664758b0f2a40178d815ef9f2c6c7f 2023-02-09 20:55:11,888 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened 7b664758b0f2a40178d815ef9f2c6c7f; next sequenceid=51; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59889459, jitterRate=-0.10757751762866974}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-09 20:55:11,888 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for 7b664758b0f2a40178d815ef9f2c6c7f: Running coprocessor pre-open hook at 1675976111876Writing region info on filesystem at 1675976111876Initializing all the Stores at 1675976111877 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} at 1675976111877Cleaning up temporary data from old regions at 1675976111885 (+8 ms)Cleaning up detritus from prior splits at 1675976111885Running coprocessor post-open hooks at 1675976111888 (+3 ms)Region opened successfully at 1675976111888 2023-02-09 20:55:11,888 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675976096855.7b664758b0f2a40178d815ef9f2c6c7f., pid=63, masterSystemTime=1675976111873 2023-02-09 20:55:11,889 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675976096855.7b664758b0f2a40178d815ef9f2c6c7f. 2023-02-09 20:55:11,889 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675976096855.7b664758b0f2a40178d815ef9f2c6c7f. 2023-02-09 20:55:11,890 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=7b664758b0f2a40178d815ef9f2c6c7f, regionState=OPEN, openSeqNum=51, regionLocation=jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:11,890 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675976096855.7b664758b0f2a40178d815ef9f2c6c7f.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1675976111890"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675976111890"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675976111890"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675976111890"}]},"ts":"1675976111890"} 2023-02-09 20:55:11,892 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=63, resume processing ppid=61 2023-02-09 20:55:11,892 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=63, ppid=61, state=SUCCESS; OpenRegionProcedure 7b664758b0f2a40178d815ef9f2c6c7f, server=jenkins-hbase9.apache.org,40919,1675976022294 in 169 msec 2023-02-09 20:55:11,893 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=61, resume processing ppid=60 2023-02-09 20:55:11,893 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=61, ppid=60, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=7b664758b0f2a40178d815ef9f2c6c7f, REOPEN/MOVE in 1.0730 sec 2023-02-09 20:55:11,895 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=60, resume processing ppid=59 2023-02-09 20:55:11,895 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=60, ppid=59, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 1.0780 sec 2023-02-09 20:55:11,897 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=59, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 1.4930 sec 2023-02-09 20:55:11,897 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1227): Checking to see if procedure is done pid=59 2023-02-09 20:55:11,898 INFO [Listener at localhost/46855] compactions.TestMobCompactor(278): alter status finished 2023-02-09 20:55:11,899 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=42951] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:11,900 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1675976025848] procedure2.ProcedureExecutor(1029): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-02-09 20:55:11,901 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-02-09 20:55:11,902 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1675976025848] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-09 20:55:11,902 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1675976711902 2023-02-09 20:55:11,902 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1675976025848] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-09 20:55:11,903 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1675976025848] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-02-09 20:55:11,903 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1675976025848] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-09 20:55:11,903 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1675976025848] zookeeper.ReadOnlyZKClient(139): Connect 0x2a848208 to 127.0.0.1:62089 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 20:55:11,907 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1675976025848] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4c66f145, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 20:55:11,907 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-09 20:55:11,908 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-09 20:55:11,908 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-09 20:55:11,908 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-09 20:55:11,908 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-09 20:55:12,732 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128fbcccee9034f43bbb4d8c66277b7cc11 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151128fbcccee9034f43bbb4d8c66277b7cc11 2023-02-09 20:55:12,733 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-09 20:55:12,745 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 20:55:12,746 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:58764, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 20:55:12,753 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-09 20:55:12,755 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:52238, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-09 20:55:12,763 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/5f497beeb5324c1eb601b3d4cb6a632a first=Optional[r05] last=Optional[r8] 2023-02-09 20:55:12,763 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675976096855.7b664758b0f2a40178d815ef9f2c6c7f., hostname=jenkins-hbase9.apache.org,40919,1675976022294, seqNum=51 for row with hfile group [{family1,hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/5f497beeb5324c1eb601b3d4cb6a632a}] 2023-02-09 20:55:12,767 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HStore(763): Validating hfile at hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/5f497beeb5324c1eb601b3d4cb6a632a for inclusion in 7b664758b0f2a40178d815ef9f2c6c7f/family1 2023-02-09 20:55:12,769 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-02-09 20:55:12,769 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HStore(777): Region bounds: first= last= 2023-02-09 20:55:12,770 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HRegion(2445): Flush status journal for 7b664758b0f2a40178d815ef9f2c6c7f: 2023-02-09 20:55:12,770 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/5f497beeb5324c1eb601b3d4cb6a632a to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__fv763dtmcgq99rt3gs4tmn3aec395as9dkmn4iea00js5da6e2s74975g83e7jvt/family1/5f497beeb5324c1eb601b3d4cb6a632a 2023-02-09 20:55:12,772 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__fv763dtmcgq99rt3gs4tmn3aec395as9dkmn4iea00js5da6e2s74975g83e7jvt/family1/5f497beeb5324c1eb601b3d4cb6a632a as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/7b664758b0f2a40178d815ef9f2c6c7f/family1/2814c08eb31a41478bee26811c1afde9_SeqId_53_ 2023-02-09 20:55:12,773 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HStore(849): Loaded HFile hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__fv763dtmcgq99rt3gs4tmn3aec395as9dkmn4iea00js5da6e2s74975g83e7jvt/family1/5f497beeb5324c1eb601b3d4cb6a632a into 7b664758b0f2a40178d815ef9f2c6c7f/family1 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/7b664758b0f2a40178d815ef9f2c6c7f/family1/2814c08eb31a41478bee26811c1afde9_SeqId_53_ - updating store file list. 2023-02-09 20:55:12,776 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HStore(882): Loaded HFile hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/7b664758b0f2a40178d815ef9f2c6c7f/family1/2814c08eb31a41478bee26811c1afde9_SeqId_53_ into 7b664758b0f2a40178d815ef9f2c6c7f/family1 2023-02-09 20:55:12,776 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HStore(855): Successfully loaded hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__fv763dtmcgq99rt3gs4tmn3aec395as9dkmn4iea00js5da6e2s74975g83e7jvt/family1/5f497beeb5324c1eb601b3d4cb6a632a into 7b664758b0f2a40178d815ef9f2c6c7f/family1 (new location: hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/7b664758b0f2a40178d815ef9f2c6c7f/family1/2814c08eb31a41478bee26811c1afde9_SeqId_53_) 2023-02-09 20:55:12,777 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__fv763dtmcgq99rt3gs4tmn3aec395as9dkmn4iea00js5da6e2s74975g83e7jvt/family1/5f497beeb5324c1eb601b3d4cb6a632a 2023-02-09 20:55:12,778 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-09 20:55:12,779 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 20:55:12,780 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511206fe249433eb84bd693d491e1a5361858 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511206fe249433eb84bd693d491e1a5361858 2023-02-09 20:55:12,781 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151128a10c9f4fad70445e8952aaf5d450d5b5 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151128a10c9f4fad70445e8952aaf5d450d5b5 2023-02-09 20:55:12,781 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2 expired mob files are deleted 2023-02-09 20:55:12,781 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-02-09 20:55:12,782 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-09 20:55:12,782 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-09 20:55:12,782 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-09 20:55:12,782 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1675976025848] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-09 20:55:12,782 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1675976025848] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-09 20:55:12,783 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-02-09 20:55:12,784 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 883 msec 2023-02-09 20:55:12,836 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.HMaster$12(2441): Client=jenkins//172.31.2.10 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'DAILY'} 2023-02-09 20:55:12,837 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure2.ProcedureExecutor(1029): Stored pid=65, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:13,246 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000003 2023-02-09 20:55:13,247 DEBUG [PEWorker-1] util.FSTableDescriptors(519): Deleted hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-02-09 20:55:13,247 INFO [PEWorker-1] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000003 2023-02-09 20:55:13,249 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=66, ppid=65, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily}] 2023-02-09 20:55:13,251 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=7b664758b0f2a40178d815ef9f2c6c7f, REOPEN/MOVE}] 2023-02-09 20:55:13,251 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=7b664758b0f2a40178d815ef9f2c6c7f, REOPEN/MOVE 2023-02-09 20:55:13,252 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=7b664758b0f2a40178d815ef9f2c6c7f, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:13,252 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675976096855.7b664758b0f2a40178d815ef9f2c6c7f.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1675976113252"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675976113252"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675976113252"}]},"ts":"1675976113252"} 2023-02-09 20:55:13,253 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=68, ppid=67, state=RUNNABLE; CloseRegionProcedure 7b664758b0f2a40178d815ef9f2c6c7f, server=jenkins-hbase9.apache.org,40919,1675976022294}] 2023-02-09 20:55:13,405 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(109): Close 7b664758b0f2a40178d815ef9f2c6c7f 2023-02-09 20:55:13,405 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing 7b664758b0f2a40178d815ef9f2c6c7f, disabling compactions & flushes 2023-02-09 20:55:13,405 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675976096855.7b664758b0f2a40178d815ef9f2c6c7f. 2023-02-09 20:55:13,405 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675976096855.7b664758b0f2a40178d815ef9f2c6c7f. 2023-02-09 20:55:13,405 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675976096855.7b664758b0f2a40178d815ef9f2c6c7f. after waiting 0 ms 2023-02-09 20:55:13,405 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675976096855.7b664758b0f2a40178d815ef9f2c6c7f. 2023-02-09 20:55:13,410 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/7b664758b0f2a40178d815ef9f2c6c7f/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=50 2023-02-09 20:55:13,411 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675976096855.7b664758b0f2a40178d815ef9f2c6c7f. 2023-02-09 20:55:13,411 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for 7b664758b0f2a40178d815ef9f2c6c7f: Waiting for close lock at 1675976113405Running coprocessor pre-close hooks at 1675976113405Disabling compacts and flushes for region at 1675976113405Disabling writes for close at 1675976113405Writing region close event to WAL at 1675976113407 (+2 ms)Running coprocessor post-close hooks at 1675976113411 (+4 ms)Closed at 1675976113411 2023-02-09 20:55:13,411 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(3509): Not adding moved region record: 7b664758b0f2a40178d815ef9f2c6c7f to self. 2023-02-09 20:55:13,412 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(147): Closed 7b664758b0f2a40178d815ef9f2c6c7f 2023-02-09 20:55:13,412 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=7b664758b0f2a40178d815ef9f2c6c7f, regionState=CLOSED 2023-02-09 20:55:13,412 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675976096855.7b664758b0f2a40178d815ef9f2c6c7f.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1675976113412"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675976113412"}]},"ts":"1675976113412"} 2023-02-09 20:55:13,415 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=68, resume processing ppid=67 2023-02-09 20:55:13,415 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=68, ppid=67, state=SUCCESS; CloseRegionProcedure 7b664758b0f2a40178d815ef9f2c6c7f, server=jenkins-hbase9.apache.org,40919,1675976022294 in 160 msec 2023-02-09 20:55:13,415 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=7b664758b0f2a40178d815ef9f2c6c7f, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase9.apache.org,40919,1675976022294; forceNewPlan=false, retain=true 2023-02-09 20:55:13,566 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=7b664758b0f2a40178d815ef9f2c6c7f, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:13,566 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675976096855.7b664758b0f2a40178d815ef9f2c6c7f.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1675976113566"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675976113566"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675976113566"}]},"ts":"1675976113566"} 2023-02-09 20:55:13,567 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=69, ppid=67, state=RUNNABLE; OpenRegionProcedure 7b664758b0f2a40178d815ef9f2c6c7f, server=jenkins-hbase9.apache.org,40919,1675976022294}] 2023-02-09 20:55:13,721 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675976096855.7b664758b0f2a40178d815ef9f2c6c7f. 2023-02-09 20:55:13,721 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 7b664758b0f2a40178d815ef9f2c6c7f, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675976096855.7b664758b0f2a40178d815ef9f2c6c7f.', STARTKEY => '', ENDKEY => ''} 2023-02-09 20:55:13,722 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 7b664758b0f2a40178d815ef9f2c6c7f 2023-02-09 20:55:13,722 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675976096855.7b664758b0f2a40178d815ef9f2c6c7f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 20:55:13,722 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for 7b664758b0f2a40178d815ef9f2c6c7f 2023-02-09 20:55:13,722 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for 7b664758b0f2a40178d815ef9f2c6c7f 2023-02-09 20:55:13,723 INFO [StoreOpener-7b664758b0f2a40178d815ef9f2c6c7f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 7b664758b0f2a40178d815ef9f2c6c7f 2023-02-09 20:55:13,724 DEBUG [StoreOpener-7b664758b0f2a40178d815ef9f2c6c7f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/7b664758b0f2a40178d815ef9f2c6c7f/family1 2023-02-09 20:55:13,724 DEBUG [StoreOpener-7b664758b0f2a40178d815ef9f2c6c7f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/7b664758b0f2a40178d815ef9f2c6c7f/family1 2023-02-09 20:55:13,724 INFO [StoreOpener-7b664758b0f2a40178d815ef9f2c6c7f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7b664758b0f2a40178d815ef9f2c6c7f columnFamilyName family1 2023-02-09 20:55:13,729 DEBUG [StoreOpener-7b664758b0f2a40178d815ef9f2c6c7f-1] regionserver.HStore(539): loaded hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/7b664758b0f2a40178d815ef9f2c6c7f/family1/2814c08eb31a41478bee26811c1afde9_SeqId_53_ 2023-02-09 20:55:13,732 DEBUG [StoreOpener-7b664758b0f2a40178d815ef9f2c6c7f-1] regionserver.HStore(539): loaded hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/7b664758b0f2a40178d815ef9f2c6c7f/family1/f6c05944a6a74899ae0f20e40a56b658 2023-02-09 20:55:13,732 INFO [StoreOpener-7b664758b0f2a40178d815ef9f2c6c7f-1] regionserver.HStore(310): Store=7b664758b0f2a40178d815ef9f2c6c7f/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 20:55:13,733 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/7b664758b0f2a40178d815ef9f2c6c7f 2023-02-09 20:55:13,734 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/7b664758b0f2a40178d815ef9f2c6c7f 2023-02-09 20:55:13,737 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for 7b664758b0f2a40178d815ef9f2c6c7f 2023-02-09 20:55:13,738 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened 7b664758b0f2a40178d815ef9f2c6c7f; next sequenceid=56; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68744688, jitterRate=0.02437567710876465}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-09 20:55:13,738 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for 7b664758b0f2a40178d815ef9f2c6c7f: Running coprocessor pre-open hook at 1675976113722Writing region info on filesystem at 1675976113722Initializing all the Stores at 1675976113722Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'DAILY'} at 1675976113723 (+1 ms)Cleaning up temporary data from old regions at 1675976113735 (+12 ms)Cleaning up detritus from prior splits at 1675976113735Running coprocessor post-open hooks at 1675976113738 (+3 ms)Region opened successfully at 1675976113738 2023-02-09 20:55:13,738 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675976096855.7b664758b0f2a40178d815ef9f2c6c7f., pid=69, masterSystemTime=1675976113718 2023-02-09 20:55:13,740 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675976096855.7b664758b0f2a40178d815ef9f2c6c7f. 2023-02-09 20:55:13,740 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675976096855.7b664758b0f2a40178d815ef9f2c6c7f. 2023-02-09 20:55:13,740 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=7b664758b0f2a40178d815ef9f2c6c7f, regionState=OPEN, openSeqNum=56, regionLocation=jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:13,740 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675976096855.7b664758b0f2a40178d815ef9f2c6c7f.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1675976113740"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675976113740"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675976113740"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675976113740"}]},"ts":"1675976113740"} 2023-02-09 20:55:13,742 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=69, resume processing ppid=67 2023-02-09 20:55:13,742 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=69, ppid=67, state=SUCCESS; OpenRegionProcedure 7b664758b0f2a40178d815ef9f2c6c7f, server=jenkins-hbase9.apache.org,40919,1675976022294 in 174 msec 2023-02-09 20:55:13,743 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=67, resume processing ppid=66 2023-02-09 20:55:13,744 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=7b664758b0f2a40178d815ef9f2c6c7f, REOPEN/MOVE in 491 msec 2023-02-09 20:55:13,745 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=66, resume processing ppid=65 2023-02-09 20:55:13,745 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=66, ppid=65, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 495 msec 2023-02-09 20:55:13,746 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=65, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 909 msec 2023-02-09 20:55:13,747 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1227): Checking to see if procedure is done pid=65 2023-02-09 20:55:13,748 INFO [Listener at localhost/46855] compactions.TestMobCompactor(278): alter status finished 2023-02-09 20:55:13,749 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=42951] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'DAILY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-09 20:55:13,750 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1675976025848] procedure2.ProcedureExecutor(1029): Stored pid=70, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-02-09 20:55:13,751 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=70, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-02-09 20:55:13,752 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=70, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1675976713752 2023-02-09 20:55:13,752 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1675976025848] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-09 20:55:13,752 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1675976025848] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-09 20:55:13,753 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1675976025848] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 4 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-02-09 20:55:13,753 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1675976025848] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-09 20:55:13,754 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1675976025848] zookeeper.ReadOnlyZKClient(139): Connect 0x4ee38792 to 127.0.0.1:62089 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 20:55:13,758 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1675976025848] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@233e6ee5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 20:55:13,758 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151128 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-09 20:55:13,758 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151128 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-09 20:55:13,758 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151205 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-09 20:55:13,759 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151205 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-09 20:55:13,759 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160103 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-09 20:55:13,759 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160103 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-09 20:55:13,759 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-09 20:55:13,759 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-09 20:55:13,759 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1675976025848] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-09 20:55:13,759 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1675976025848] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-09 20:55:13,760 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=70, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-02-09 20:55:13,761 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=70, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 10 msec 2023-02-09 20:55:13,817 INFO [Listener at localhost/46855] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily Thread=251 (was 243) - Thread LEAK? -, OpenFileDescriptor=641 (was 611) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=118 (was 142), ProcessCount=168 (was 168), AvailableMemoryMB=10651 (was 10667) 2023-02-09 20:55:13,828 INFO [Listener at localhost/46855] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testGetAfterCompaction Thread=251, OpenFileDescriptor=641, MaxFileDescriptor=60000, SystemLoadAverage=118, ProcessCount=168, AvailableMemoryMB=10651 2023-02-09 20:55:13,830 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.HMaster$4(2102): Client=jenkins//172.31.2.10 create 'testGetAfterCompaction', {TABLE_ATTRIBUTES => {coprocessor$1 => '|org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro|1073741823|'}}, {NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-02-09 20:55:13,831 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure2.ProcedureExecutor(1029): Stored pid=71, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testGetAfterCompaction 2023-02-09 20:55:13,832 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_PRE_OPERATION 2023-02-09 20:55:13,833 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(697): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testGetAfterCompaction" procId is: 71 2023-02-09 20:55:13,833 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-09 20:55:13,833 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-02-09 20:55:13,834 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/.tmp/data/default/testGetAfterCompaction/19885aea7f08eabc6250cea5b51b5968 2023-02-09 20:55:13,835 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/.tmp/data/default/testGetAfterCompaction/19885aea7f08eabc6250cea5b51b5968 empty. 2023-02-09 20:55:13,835 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/.tmp/data/default/testGetAfterCompaction/19885aea7f08eabc6250cea5b51b5968 2023-02-09 20:55:13,835 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testGetAfterCompaction regions 2023-02-09 20:55:13,934 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-02-09 20:55:14,135 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-02-09 20:55:14,243 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/.tmp/data/default/testGetAfterCompaction/.tabledesc/.tableinfo.0000000001 2023-02-09 20:55:14,244 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(7671): creating {ENCODED => 19885aea7f08eabc6250cea5b51b5968, NAME => 'testGetAfterCompaction,,1675976113830.19885aea7f08eabc6250cea5b51b5968.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testGetAfterCompaction', {TABLE_ATTRIBUTES => {coprocessor$1 => '|org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro|1073741823|'}}, {NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/.tmp 2023-02-09 20:55:14,436 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-02-09 20:55:14,650 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(865): Instantiated testGetAfterCompaction,,1675976113830.19885aea7f08eabc6250cea5b51b5968.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 20:55:14,650 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1603): Closing 19885aea7f08eabc6250cea5b51b5968, disabling compactions & flushes 2023-02-09 20:55:14,650 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1625): Closing region testGetAfterCompaction,,1675976113830.19885aea7f08eabc6250cea5b51b5968. 2023-02-09 20:55:14,650 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testGetAfterCompaction,,1675976113830.19885aea7f08eabc6250cea5b51b5968. 2023-02-09 20:55:14,650 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1713): Acquired close lock on testGetAfterCompaction,,1675976113830.19885aea7f08eabc6250cea5b51b5968. after waiting 0 ms 2023-02-09 20:55:14,651 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1723): Updates disabled for region testGetAfterCompaction,,1675976113830.19885aea7f08eabc6250cea5b51b5968. 2023-02-09 20:55:14,651 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1837): Closed testGetAfterCompaction,,1675976113830.19885aea7f08eabc6250cea5b51b5968. 2023-02-09 20:55:14,651 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1557): Region close journal for 19885aea7f08eabc6250cea5b51b5968: Waiting for close lock at 1675976114650Disabling compacts and flushes for region at 1675976114650Disabling writes for close at 1675976114651 (+1 ms)Writing region close event to WAL at 1675976114651Closed at 1675976114651 2023-02-09 20:55:14,653 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_ADD_TO_META 2023-02-09 20:55:14,653 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testGetAfterCompaction,,1675976113830.19885aea7f08eabc6250cea5b51b5968.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1675976114653"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675976114653"}]},"ts":"1675976114653"} 2023-02-09 20:55:14,655 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-09 20:55:14,655 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-09 20:55:14,655 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675976114655"}]},"ts":"1675976114655"} 2023-02-09 20:55:14,656 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=ENABLING in hbase:meta 2023-02-09 20:55:14,660 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testGetAfterCompaction, region=19885aea7f08eabc6250cea5b51b5968, ASSIGN}] 2023-02-09 20:55:14,661 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testGetAfterCompaction, region=19885aea7f08eabc6250cea5b51b5968, ASSIGN 2023-02-09 20:55:14,661 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testGetAfterCompaction, region=19885aea7f08eabc6250cea5b51b5968, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,40919,1675976022294; forceNewPlan=false, retain=false 2023-02-09 20:55:14,812 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=19885aea7f08eabc6250cea5b51b5968, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:14,813 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testGetAfterCompaction,,1675976113830.19885aea7f08eabc6250cea5b51b5968.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1675976114812"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675976114812"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675976114812"}]},"ts":"1675976114812"} 2023-02-09 20:55:14,814 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=73, ppid=72, state=RUNNABLE; OpenRegionProcedure 19885aea7f08eabc6250cea5b51b5968, server=jenkins-hbase9.apache.org,40919,1675976022294}] 2023-02-09 20:55:14,937 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-02-09 20:55:14,968 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open testGetAfterCompaction,,1675976113830.19885aea7f08eabc6250cea5b51b5968. 2023-02-09 20:55:14,968 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 19885aea7f08eabc6250cea5b51b5968, NAME => 'testGetAfterCompaction,,1675976113830.19885aea7f08eabc6250cea5b51b5968.', STARTKEY => '', ENDKEY => ''} 2023-02-09 20:55:14,968 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro with path null and priority 1073741823 2023-02-09 20:55:14,970 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro from HTD of testGetAfterCompaction successfully. 2023-02-09 20:55:14,970 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testGetAfterCompaction 19885aea7f08eabc6250cea5b51b5968 2023-02-09 20:55:14,970 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated testGetAfterCompaction,,1675976113830.19885aea7f08eabc6250cea5b51b5968.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 20:55:14,970 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for 19885aea7f08eabc6250cea5b51b5968 2023-02-09 20:55:14,970 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for 19885aea7f08eabc6250cea5b51b5968 2023-02-09 20:55:14,971 INFO [StoreOpener-19885aea7f08eabc6250cea5b51b5968-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 19885aea7f08eabc6250cea5b51b5968 2023-02-09 20:55:14,973 DEBUG [StoreOpener-19885aea7f08eabc6250cea5b51b5968-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testGetAfterCompaction/19885aea7f08eabc6250cea5b51b5968/f1 2023-02-09 20:55:14,973 DEBUG [StoreOpener-19885aea7f08eabc6250cea5b51b5968-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testGetAfterCompaction/19885aea7f08eabc6250cea5b51b5968/f1 2023-02-09 20:55:14,973 INFO [StoreOpener-19885aea7f08eabc6250cea5b51b5968-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 19885aea7f08eabc6250cea5b51b5968 columnFamilyName f1 2023-02-09 20:55:14,974 INFO [StoreOpener-19885aea7f08eabc6250cea5b51b5968-1] regionserver.HStore(310): Store=19885aea7f08eabc6250cea5b51b5968/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 20:55:14,975 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testGetAfterCompaction/19885aea7f08eabc6250cea5b51b5968 2023-02-09 20:55:14,975 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testGetAfterCompaction/19885aea7f08eabc6250cea5b51b5968 2023-02-09 20:55:14,977 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for 19885aea7f08eabc6250cea5b51b5968 2023-02-09 20:55:14,979 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testGetAfterCompaction/19885aea7f08eabc6250cea5b51b5968/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 20:55:14,979 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened 19885aea7f08eabc6250cea5b51b5968; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64263899, jitterRate=-0.0423932820558548}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-09 20:55:14,980 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for 19885aea7f08eabc6250cea5b51b5968: Running coprocessor pre-open hook at 1675976114970Writing region info on filesystem at 1675976114970Initializing all the Stores at 1675976114971 (+1 ms)Instantiating store for column family {NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675976114971Cleaning up temporary data from old regions at 1675976114976 (+5 ms)Cleaning up detritus from prior splits at 1675976114976Running coprocessor post-open hooks at 1675976114980 (+4 ms)Region opened successfully at 1675976114980 2023-02-09 20:55:14,980 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testGetAfterCompaction,,1675976113830.19885aea7f08eabc6250cea5b51b5968., pid=73, masterSystemTime=1675976114965 2023-02-09 20:55:14,981 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testGetAfterCompaction,,1675976113830.19885aea7f08eabc6250cea5b51b5968. 2023-02-09 20:55:14,981 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened testGetAfterCompaction,,1675976113830.19885aea7f08eabc6250cea5b51b5968. 2023-02-09 20:55:14,982 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=19885aea7f08eabc6250cea5b51b5968, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:14,982 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testGetAfterCompaction,,1675976113830.19885aea7f08eabc6250cea5b51b5968.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1675976114982"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675976114982"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675976114982"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675976114982"}]},"ts":"1675976114982"} 2023-02-09 20:55:14,984 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=73, resume processing ppid=72 2023-02-09 20:55:14,984 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=73, ppid=72, state=SUCCESS; OpenRegionProcedure 19885aea7f08eabc6250cea5b51b5968, server=jenkins-hbase9.apache.org,40919,1675976022294 in 169 msec 2023-02-09 20:55:14,985 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=72, resume processing ppid=71 2023-02-09 20:55:14,985 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testGetAfterCompaction, region=19885aea7f08eabc6250cea5b51b5968, ASSIGN in 324 msec 2023-02-09 20:55:14,986 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-09 20:55:14,986 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675976114986"}]},"ts":"1675976114986"} 2023-02-09 20:55:14,987 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=ENABLED in hbase:meta 2023-02-09 20:55:14,989 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_POST_OPERATION 2023-02-09 20:55:14,989 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=71, state=SUCCESS; CreateTableProcedure table=testGetAfterCompaction in 1.1580 sec 2023-02-09 20:55:15,938 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-02-09 20:55:15,939 INFO [Listener at localhost/46855] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testGetAfterCompaction, procId: 71 completed 2023-02-09 20:55:15,939 DEBUG [Listener at localhost/46855] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testGetAfterCompaction get assigned. Timeout = 60000ms 2023-02-09 20:55:15,940 INFO [Listener at localhost/46855] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-09 20:55:15,944 INFO [Listener at localhost/46855] hbase.HBaseTestingUtility(3484): All regions for table testGetAfterCompaction assigned to meta. Checking AM states. 2023-02-09 20:55:15,944 INFO [Listener at localhost/46855] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-09 20:55:15,944 INFO [Listener at localhost/46855] hbase.HBaseTestingUtility(3504): All regions for table testGetAfterCompaction assigned. 2023-02-09 20:55:15,948 INFO [Listener at localhost/46855] regionserver.HRegion(2744): Flushing 19885aea7f08eabc6250cea5b51b5968 1/1 column families, dataSize=37 B heapSize=368 B 2023-02-09 20:55:16,363 INFO [Listener at localhost/46855] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023020908222b31495d4ee086bf93ee6cf7400e to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e2023020908222b31495d4ee086bf93ee6cf7400e 2023-02-09 20:55:16,589 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-09 20:55:16,589 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0c2291c3 to 127.0.0.1:62089 2023-02-09 20:55:16,589 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 20:55:16,589 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4ee38792 to 127.0.0.1:62089 2023-02-09 20:55:16,589 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 20:55:16,590 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-09 20:55:16,590 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2a848208 to 127.0.0.1:62089 2023-02-09 20:55:16,590 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 20:55:16,590 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x26c9a163 to 127.0.0.1:62089 2023-02-09 20:55:16,590 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 20:55:16,590 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-09 20:55:16,590 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5cedf3de to 127.0.0.1:62089 2023-02-09 20:55:16,590 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 20:55:16,590 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-09 20:55:16,590 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x36dbaa6e to 127.0.0.1:62089 2023-02-09 20:55:16,590 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 20:55:16,768 INFO [Listener at localhost/46855] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=37, hasBloomFilter=true, into tmp file hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testGetAfterCompaction/19885aea7f08eabc6250cea5b51b5968/.tmp/f1/816beafa9a1b44d09e25047ea05c9a55 2023-02-09 20:55:16,773 DEBUG [Listener at localhost/46855] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testGetAfterCompaction/19885aea7f08eabc6250cea5b51b5968/.tmp/f1/816beafa9a1b44d09e25047ea05c9a55 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testGetAfterCompaction/19885aea7f08eabc6250cea5b51b5968/f1/816beafa9a1b44d09e25047ea05c9a55 2023-02-09 20:55:16,776 INFO [Listener at localhost/46855] regionserver.HStore(1080): Added hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testGetAfterCompaction/19885aea7f08eabc6250cea5b51b5968/f1/816beafa9a1b44d09e25047ea05c9a55, entries=1, sequenceid=5, filesize=4.9 K 2023-02-09 20:55:16,777 INFO [Listener at localhost/46855] regionserver.HRegion(2947): Finished flush of dataSize ~37 B/37, heapSize ~352 B/352, currentSize=0 B/0 for 19885aea7f08eabc6250cea5b51b5968 in 829ms, sequenceid=5, compaction requested=false 2023-02-09 20:55:16,777 DEBUG [Listener at localhost/46855] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testGetAfterCompaction' 2023-02-09 20:55:16,778 DEBUG [Listener at localhost/46855] regionserver.HRegion(2445): Flush status journal for 19885aea7f08eabc6250cea5b51b5968: 2023-02-09 20:55:16,780 INFO [Listener at localhost/46855] regionserver.HRegion(2744): Flushing 19885aea7f08eabc6250cea5b51b5968 1/1 column families, dataSize=37 B heapSize=368 B 2023-02-09 20:55:17,119 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-09 20:55:17,191 INFO [Listener at localhost/46855] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023020967090e0d9e68464680390b1ab0092713 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e2023020967090e0d9e68464680390b1ab0092713 2023-02-09 20:55:17,596 INFO [Listener at localhost/46855] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=37, hasBloomFilter=true, into tmp file hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testGetAfterCompaction/19885aea7f08eabc6250cea5b51b5968/.tmp/f1/11d3709108b24ef1a448effbedef62c6 2023-02-09 20:55:17,600 DEBUG [Listener at localhost/46855] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testGetAfterCompaction/19885aea7f08eabc6250cea5b51b5968/.tmp/f1/11d3709108b24ef1a448effbedef62c6 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testGetAfterCompaction/19885aea7f08eabc6250cea5b51b5968/f1/11d3709108b24ef1a448effbedef62c6 2023-02-09 20:55:17,604 INFO [Listener at localhost/46855] regionserver.HStore(1080): Added hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testGetAfterCompaction/19885aea7f08eabc6250cea5b51b5968/f1/11d3709108b24ef1a448effbedef62c6, entries=1, sequenceid=9, filesize=4.9 K 2023-02-09 20:55:17,605 INFO [Listener at localhost/46855] regionserver.HRegion(2947): Finished flush of dataSize ~37 B/37, heapSize ~352 B/352, currentSize=0 B/0 for 19885aea7f08eabc6250cea5b51b5968 in 825ms, sequenceid=9, compaction requested=false 2023-02-09 20:55:17,605 DEBUG [Listener at localhost/46855] regionserver.HRegion(2445): Flush status journal for 19885aea7f08eabc6250cea5b51b5968: 2023-02-09 20:55:17,606 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=42951] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testGetAfterCompaction 2023-02-09 20:55:17,607 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1675976025848] procedure2.ProcedureExecutor(1029): Stored pid=74, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-02-09 20:55:17,608 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=74, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-02-09 20:55:17,608 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1675976025848] mob.MobUtils(833): start MOB compaction of files for table='testGetAfterCompaction', column='f1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-09 20:55:17,608 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=74, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1675976717608 2023-02-09 20:55:17,609 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1675976025848] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-02-09 20:55:17,609 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1675976025848] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 2 selected files, and 0 irrelevant files table 'testGetAfterCompaction' and column 'f1' 2023-02-09 20:55:17,609 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1675976025848] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testGetAfterCompaction' column='f1' 2023-02-09 20:55:17,609 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1675976025848] zookeeper.ReadOnlyZKClient(139): Connect 0x33ce62d8 to 127.0.0.1:62089 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 20:55:17,614 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1675976025848] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@63d76b02, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 20:55:17,615 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20230209 for table='testGetAfterCompaction' and column='f1' 2023-02-09 20:55:17,658 INFO [Listener at localhost/46855] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testGetAfterCompaction/19885aea7f08eabc6250cea5b51b5968/f1/11d3709108b24ef1a448effbedef62c6; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675976117596; access_time=1675976116781; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 20:55:17,658 INFO [Listener at localhost/46855] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testGetAfterCompaction/19885aea7f08eabc6250cea5b51b5968/f1/816beafa9a1b44d09e25047ea05c9a55; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675976116768; access_time=1675976115951; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 20:55:17,708 INFO [Listener at localhost/46855] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testGetAfterCompaction/19885aea7f08eabc6250cea5b51b5968/f1/11d3709108b24ef1a448effbedef62c6; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675976117596; access_time=1675976116781; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 20:55:17,709 INFO [Listener at localhost/46855] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testGetAfterCompaction/19885aea7f08eabc6250cea5b51b5968/f1/816beafa9a1b44d09e25047ea05c9a55; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675976116768; access_time=1675976115951; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 20:55:17,759 INFO [Listener at localhost/46855] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testGetAfterCompaction/19885aea7f08eabc6250cea5b51b5968/f1/11d3709108b24ef1a448effbedef62c6; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675976117596; access_time=1675976116781; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 20:55:17,759 INFO [Listener at localhost/46855] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testGetAfterCompaction/19885aea7f08eabc6250cea5b51b5968/f1/816beafa9a1b44d09e25047ea05c9a55; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675976116768; access_time=1675976115951; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 20:55:17,810 INFO [Listener at localhost/46855] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testGetAfterCompaction/19885aea7f08eabc6250cea5b51b5968/f1/11d3709108b24ef1a448effbedef62c6; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675976117596; access_time=1675976116781; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 20:55:17,810 INFO [Listener at localhost/46855] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testGetAfterCompaction/19885aea7f08eabc6250cea5b51b5968/f1/816beafa9a1b44d09e25047ea05c9a55; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675976116768; access_time=1675976115951; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 20:55:17,861 INFO [Listener at localhost/46855] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testGetAfterCompaction/19885aea7f08eabc6250cea5b51b5968/f1/11d3709108b24ef1a448effbedef62c6; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675976117596; access_time=1675976116781; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 20:55:17,861 INFO [Listener at localhost/46855] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testGetAfterCompaction/19885aea7f08eabc6250cea5b51b5968/f1/816beafa9a1b44d09e25047ea05c9a55; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675976116768; access_time=1675976115951; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 20:55:17,912 INFO [Listener at localhost/46855] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testGetAfterCompaction/19885aea7f08eabc6250cea5b51b5968/f1/11d3709108b24ef1a448effbedef62c6; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675976117596; access_time=1675976116781; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 20:55:17,912 INFO [Listener at localhost/46855] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testGetAfterCompaction/19885aea7f08eabc6250cea5b51b5968/f1/816beafa9a1b44d09e25047ea05c9a55; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675976116768; access_time=1675976115951; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 20:55:17,963 INFO [Listener at localhost/46855] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testGetAfterCompaction/19885aea7f08eabc6250cea5b51b5968/f1/11d3709108b24ef1a448effbedef62c6; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675976117596; access_time=1675976116781; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 20:55:17,963 INFO [Listener at localhost/46855] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testGetAfterCompaction/19885aea7f08eabc6250cea5b51b5968/f1/816beafa9a1b44d09e25047ea05c9a55; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675976116768; access_time=1675976115951; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 20:55:18,013 INFO [Listener at localhost/46855] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testGetAfterCompaction/19885aea7f08eabc6250cea5b51b5968/f1/11d3709108b24ef1a448effbedef62c6; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675976117596; access_time=1675976116781; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 20:55:18,014 INFO [Listener at localhost/46855] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testGetAfterCompaction/19885aea7f08eabc6250cea5b51b5968/f1/816beafa9a1b44d09e25047ea05c9a55; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675976116768; access_time=1675976115951; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 20:55:18,064 INFO [Listener at localhost/46855] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testGetAfterCompaction/19885aea7f08eabc6250cea5b51b5968/f1/11d3709108b24ef1a448effbedef62c6; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675976117596; access_time=1675976116781; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 20:55:18,064 INFO [Listener at localhost/46855] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testGetAfterCompaction/19885aea7f08eabc6250cea5b51b5968/f1/816beafa9a1b44d09e25047ea05c9a55; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675976116768; access_time=1675976115951; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 20:55:18,115 INFO [Listener at localhost/46855] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testGetAfterCompaction/19885aea7f08eabc6250cea5b51b5968/f1/11d3709108b24ef1a448effbedef62c6; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675976117596; access_time=1675976116781; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 20:55:18,115 INFO [Listener at localhost/46855] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testGetAfterCompaction/19885aea7f08eabc6250cea5b51b5968/f1/816beafa9a1b44d09e25047ea05c9a55; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675976116768; access_time=1675976115951; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 20:55:18,166 INFO [Listener at localhost/46855] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testGetAfterCompaction/19885aea7f08eabc6250cea5b51b5968/f1/11d3709108b24ef1a448effbedef62c6; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675976117596; access_time=1675976116781; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 20:55:18,166 INFO [Listener at localhost/46855] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testGetAfterCompaction/19885aea7f08eabc6250cea5b51b5968/f1/816beafa9a1b44d09e25047ea05c9a55; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675976116768; access_time=1675976115951; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 20:55:18,217 INFO [Listener at localhost/46855] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testGetAfterCompaction/19885aea7f08eabc6250cea5b51b5968/f1/11d3709108b24ef1a448effbedef62c6; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675976117596; access_time=1675976116781; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 20:55:18,217 INFO [Listener at localhost/46855] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testGetAfterCompaction/19885aea7f08eabc6250cea5b51b5968/f1/816beafa9a1b44d09e25047ea05c9a55; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675976116768; access_time=1675976115951; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 20:55:18,268 INFO [Listener at localhost/46855] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testGetAfterCompaction/19885aea7f08eabc6250cea5b51b5968/f1/11d3709108b24ef1a448effbedef62c6; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675976117596; access_time=1675976116781; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 20:55:18,268 INFO [Listener at localhost/46855] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testGetAfterCompaction/19885aea7f08eabc6250cea5b51b5968/f1/816beafa9a1b44d09e25047ea05c9a55; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675976116768; access_time=1675976115951; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 20:55:18,319 INFO [Listener at localhost/46855] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testGetAfterCompaction/19885aea7f08eabc6250cea5b51b5968/f1/11d3709108b24ef1a448effbedef62c6; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675976117596; access_time=1675976116781; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 20:55:18,319 INFO [Listener at localhost/46855] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testGetAfterCompaction/19885aea7f08eabc6250cea5b51b5968/f1/816beafa9a1b44d09e25047ea05c9a55; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675976116768; access_time=1675976115951; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 20:55:18,369 INFO [Listener at localhost/46855] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testGetAfterCompaction/19885aea7f08eabc6250cea5b51b5968/f1/11d3709108b24ef1a448effbedef62c6; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675976117596; access_time=1675976116781; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 20:55:18,370 INFO [Listener at localhost/46855] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testGetAfterCompaction/19885aea7f08eabc6250cea5b51b5968/f1/816beafa9a1b44d09e25047ea05c9a55; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675976116768; access_time=1675976115951; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 20:55:18,420 INFO [Listener at localhost/46855] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testGetAfterCompaction/19885aea7f08eabc6250cea5b51b5968/f1/11d3709108b24ef1a448effbedef62c6; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675976117596; access_time=1675976116781; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 20:55:18,420 INFO [Listener at localhost/46855] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testGetAfterCompaction/19885aea7f08eabc6250cea5b51b5968/f1/816beafa9a1b44d09e25047ea05c9a55; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675976116768; access_time=1675976115951; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 20:55:18,438 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230209b6db5a18f54a46049d91c9a4b386e5e7 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20230209b6db5a18f54a46049d91c9a4b386e5e7 2023-02-09 20:55:18,438 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230209 table='testGetAfterCompaction' column='f1' 2023-02-09 20:55:18,451 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 20:55:18,452 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:58768, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 20:55:18,458 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-09 20:55:18,459 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:52254, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-09 20:55:18,467 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20230209/f1/496dfb4a5d7441ab890876ede9984cbd first=Optional[r1] last=Optional[r2] 2023-02-09 20:55:18,467 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testGetAfterCompaction,,1675976113830.19885aea7f08eabc6250cea5b51b5968., hostname=jenkins-hbase9.apache.org,40919,1675976022294, seqNum=2 for row with hfile group [{f1,hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20230209/f1/496dfb4a5d7441ab890876ede9984cbd}] 2023-02-09 20:55:18,471 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HStore(763): Validating hfile at hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20230209/f1/496dfb4a5d7441ab890876ede9984cbd for inclusion in 19885aea7f08eabc6250cea5b51b5968/f1 2023-02-09 20:55:18,471 INFO [Listener at localhost/46855] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testGetAfterCompaction/19885aea7f08eabc6250cea5b51b5968/f1/11d3709108b24ef1a448effbedef62c6; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675976117596; access_time=1675976116781; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 20:55:18,471 INFO [Listener at localhost/46855] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testGetAfterCompaction/19885aea7f08eabc6250cea5b51b5968/f1/816beafa9a1b44d09e25047ea05c9a55; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675976116768; access_time=1675976115951; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 20:55:18,473 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HStore(775): HFile bounds: first=r1 last=r2 2023-02-09 20:55:18,473 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HStore(777): Region bounds: first= last= 2023-02-09 20:55:18,473 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HRegion(2445): Flush status journal for 19885aea7f08eabc6250cea5b51b5968: 2023-02-09 20:55:18,474 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20230209/f1/496dfb4a5d7441ab890876ede9984cbd to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/staging/jenkins__testGetAfterCompaction__qp52nrt6rajorloknqp3urc2cb16cbpo4be3jhrjarfgojjtkon692550gkcbj8t/f1/496dfb4a5d7441ab890876ede9984cbd 2023-02-09 20:55:18,476 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/staging/jenkins__testGetAfterCompaction__qp52nrt6rajorloknqp3urc2cb16cbpo4be3jhrjarfgojjtkon692550gkcbj8t/f1/496dfb4a5d7441ab890876ede9984cbd as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testGetAfterCompaction/19885aea7f08eabc6250cea5b51b5968/f1/d6a86971740d477a9f360e50a369c8f3_SeqId_12_ 2023-02-09 20:55:18,476 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HStore(849): Loaded HFile hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/staging/jenkins__testGetAfterCompaction__qp52nrt6rajorloknqp3urc2cb16cbpo4be3jhrjarfgojjtkon692550gkcbj8t/f1/496dfb4a5d7441ab890876ede9984cbd into 19885aea7f08eabc6250cea5b51b5968/f1 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testGetAfterCompaction/19885aea7f08eabc6250cea5b51b5968/f1/d6a86971740d477a9f360e50a369c8f3_SeqId_12_ - updating store file list. 2023-02-09 20:55:18,479 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HStore(882): Loaded HFile hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testGetAfterCompaction/19885aea7f08eabc6250cea5b51b5968/f1/d6a86971740d477a9f360e50a369c8f3_SeqId_12_ into 19885aea7f08eabc6250cea5b51b5968/f1 2023-02-09 20:55:18,479 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HStore(855): Successfully loaded hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/staging/jenkins__testGetAfterCompaction__qp52nrt6rajorloknqp3urc2cb16cbpo4be3jhrjarfgojjtkon692550gkcbj8t/f1/496dfb4a5d7441ab890876ede9984cbd into 19885aea7f08eabc6250cea5b51b5968/f1 (new location: hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testGetAfterCompaction/19885aea7f08eabc6250cea5b51b5968/f1/d6a86971740d477a9f360e50a369c8f3_SeqId_12_) 2023-02-09 20:55:18,480 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/staging/jenkins__testGetAfterCompaction__qp52nrt6rajorloknqp3urc2cb16cbpo4be3jhrjarfgojjtkon692550gkcbj8t/f1/496dfb4a5d7441ab890876ede9984cbd 2023-02-09 20:55:18,480 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HStore(1912): 19885aea7f08eabc6250cea5b51b5968/f1 is initiating minor compaction 2023-02-09 20:55:18,480 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@2b68a50c; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-09 20:55:18,480 INFO [RS:0;jenkins-hbase9:40919-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 19885aea7f08eabc6250cea5b51b5968/f1 in testGetAfterCompaction,,1675976113830.19885aea7f08eabc6250cea5b51b5968. 2023-02-09 20:55:18,480 INFO [RS:0;jenkins-hbase9:40919-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testGetAfterCompaction/19885aea7f08eabc6250cea5b51b5968/f1/11d3709108b24ef1a448effbedef62c6, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testGetAfterCompaction/19885aea7f08eabc6250cea5b51b5968/f1/d6a86971740d477a9f360e50a369c8f3_SeqId_12_] into tmpdir=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testGetAfterCompaction/19885aea7f08eabc6250cea5b51b5968/.tmp, totalSize=10.0 K 2023-02-09 20:55:18,480 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] compactions.Compactor(207): Compacting 11d3709108b24ef1a448effbedef62c6, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=9 2023-02-09 20:55:18,480 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] compactions.Compactor(207): Compacting d6a86971740d477a9f360e50a369c8f3_SeqId_12_, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13 2023-02-09 20:55:18,482 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230209 table='testGetAfterCompaction' column='f1' 2023-02-09 20:55:18,483 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 20:55:18,485 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e2023020908222b31495d4ee086bf93ee6cf7400e to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e2023020908222b31495d4ee086bf93ee6cf7400e 2023-02-09 20:55:18,486 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e2023020967090e0d9e68464680390b1ab0092713 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e2023020967090e0d9e68464680390b1ab0092713 2023-02-09 20:55:18,486 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testGetAfterCompaction 2 expired mob files are deleted 2023-02-09 20:55:18,486 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20230209' 2023-02-09 20:55:18,486 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20230209 for table='testGetAfterCompaction' and column='f1' 2023-02-09 20:55:18,486 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1675976025848] compactions.PartitionedMobCompactor(354): After compaction, there are 1 mob files. table='testGetAfterCompaction' column='f1' 2023-02-09 20:55:18,487 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1675976025848] mob.MobUtils(840): end MOB compaction of files for table='testGetAfterCompaction', column='f1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-09 20:55:18,488 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=74, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-02-09 20:55:18,489 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=74, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE in 881 msec 2023-02-09 20:55:18,491 INFO [RS:0;jenkins-hbase9:40919-shortCompactions-0] throttle.PressureAwareThroughputController(145): 19885aea7f08eabc6250cea5b51b5968#f1#compaction#76 average throughput is 0.05 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-09 20:55:18,522 INFO [Listener at localhost/46855] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testGetAfterCompaction/19885aea7f08eabc6250cea5b51b5968/f1/11d3709108b24ef1a448effbedef62c6; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675976117596; access_time=1675976116781; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 20:55:18,522 INFO [Listener at localhost/46855] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testGetAfterCompaction/19885aea7f08eabc6250cea5b51b5968/f1/816beafa9a1b44d09e25047ea05c9a55; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675976116768; access_time=1675976115951; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 20:55:18,522 INFO [Listener at localhost/46855] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testGetAfterCompaction/19885aea7f08eabc6250cea5b51b5968/f1/d6a86971740d477a9f360e50a369c8f3_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1675976118433; access_time=1675976117625; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-09 20:55:18,525 DEBUG [Listener at localhost/46855] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-09 20:55:18,529 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:58776, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-09 20:55:18,529 INFO [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=40919] regionserver.RSRpcServices(1662): Compacting testGetAfterCompaction,,1675976113830.19885aea7f08eabc6250cea5b51b5968. 2023-02-09 20:55:18,530 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=40919] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 2 compacting, 0 eligible, 16 blocking 2023-02-09 20:55:18,530 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=40919] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 0 files of size 0 starting at candidate #-1 after considering 0 permutations with 0 in ratio 2023-02-09 20:55:18,530 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=40919] compactions.SortedCompactionPolicy(232): Not compacting files because we only have 0 files ready for compaction. Need 3 to initiate. 2023-02-09 20:55:18,530 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=40919] regionserver.CompactSplit(415): Not compacting testGetAfterCompaction,,1675976113830.19885aea7f08eabc6250cea5b51b5968. because compaction request was cancelled 2023-02-09 20:55:18,582 INFO [Listener at localhost/46855] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testGetAfterCompaction/19885aea7f08eabc6250cea5b51b5968/f1/11d3709108b24ef1a448effbedef62c6; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675976117596; access_time=1675976116781; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 20:55:18,582 INFO [Listener at localhost/46855] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testGetAfterCompaction/19885aea7f08eabc6250cea5b51b5968/f1/816beafa9a1b44d09e25047ea05c9a55; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675976116768; access_time=1675976115951; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 20:55:18,582 INFO [Listener at localhost/46855] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testGetAfterCompaction/19885aea7f08eabc6250cea5b51b5968/f1/d6a86971740d477a9f360e50a369c8f3_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1675976118433; access_time=1675976117625; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-09 20:55:18,632 INFO [Listener at localhost/46855] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testGetAfterCompaction/19885aea7f08eabc6250cea5b51b5968/f1/11d3709108b24ef1a448effbedef62c6; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675976117596; access_time=1675976116781; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 20:55:18,633 INFO [Listener at localhost/46855] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testGetAfterCompaction/19885aea7f08eabc6250cea5b51b5968/f1/816beafa9a1b44d09e25047ea05c9a55; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675976116768; access_time=1675976115951; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 20:55:18,633 INFO [Listener at localhost/46855] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testGetAfterCompaction/19885aea7f08eabc6250cea5b51b5968/f1/d6a86971740d477a9f360e50a369c8f3_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1675976118433; access_time=1675976117625; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-09 20:55:18,683 INFO [Listener at localhost/46855] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testGetAfterCompaction/19885aea7f08eabc6250cea5b51b5968/f1/11d3709108b24ef1a448effbedef62c6; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675976117596; access_time=1675976116781; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 20:55:18,684 INFO [Listener at localhost/46855] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testGetAfterCompaction/19885aea7f08eabc6250cea5b51b5968/f1/816beafa9a1b44d09e25047ea05c9a55; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675976116768; access_time=1675976115951; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 20:55:18,684 INFO [Listener at localhost/46855] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testGetAfterCompaction/19885aea7f08eabc6250cea5b51b5968/f1/d6a86971740d477a9f360e50a369c8f3_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1675976118433; access_time=1675976117625; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-09 20:55:18,734 INFO [Listener at localhost/46855] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testGetAfterCompaction/19885aea7f08eabc6250cea5b51b5968/f1/11d3709108b24ef1a448effbedef62c6; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675976117596; access_time=1675976116781; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 20:55:18,734 INFO [Listener at localhost/46855] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testGetAfterCompaction/19885aea7f08eabc6250cea5b51b5968/f1/816beafa9a1b44d09e25047ea05c9a55; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675976116768; access_time=1675976115951; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 20:55:18,734 INFO [Listener at localhost/46855] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testGetAfterCompaction/19885aea7f08eabc6250cea5b51b5968/f1/d6a86971740d477a9f360e50a369c8f3_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1675976118433; access_time=1675976117625; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-09 20:55:18,785 INFO [Listener at localhost/46855] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testGetAfterCompaction/19885aea7f08eabc6250cea5b51b5968/f1/11d3709108b24ef1a448effbedef62c6; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675976117596; access_time=1675976116781; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 20:55:18,785 INFO [Listener at localhost/46855] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testGetAfterCompaction/19885aea7f08eabc6250cea5b51b5968/f1/816beafa9a1b44d09e25047ea05c9a55; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675976116768; access_time=1675976115951; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 20:55:18,785 INFO [Listener at localhost/46855] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testGetAfterCompaction/19885aea7f08eabc6250cea5b51b5968/f1/d6a86971740d477a9f360e50a369c8f3_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1675976118433; access_time=1675976117625; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-09 20:55:18,836 INFO [Listener at localhost/46855] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testGetAfterCompaction/19885aea7f08eabc6250cea5b51b5968/f1/11d3709108b24ef1a448effbedef62c6; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675976117596; access_time=1675976116781; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 20:55:18,836 INFO [Listener at localhost/46855] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testGetAfterCompaction/19885aea7f08eabc6250cea5b51b5968/f1/816beafa9a1b44d09e25047ea05c9a55; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675976116768; access_time=1675976115951; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 20:55:18,837 INFO [Listener at localhost/46855] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testGetAfterCompaction/19885aea7f08eabc6250cea5b51b5968/f1/d6a86971740d477a9f360e50a369c8f3_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1675976118433; access_time=1675976117625; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-09 20:55:18,887 INFO [Listener at localhost/46855] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testGetAfterCompaction/19885aea7f08eabc6250cea5b51b5968/f1/11d3709108b24ef1a448effbedef62c6; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675976117596; access_time=1675976116781; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 20:55:18,887 INFO [Listener at localhost/46855] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testGetAfterCompaction/19885aea7f08eabc6250cea5b51b5968/f1/816beafa9a1b44d09e25047ea05c9a55; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675976116768; access_time=1675976115951; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 20:55:18,888 INFO [Listener at localhost/46855] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testGetAfterCompaction/19885aea7f08eabc6250cea5b51b5968/f1/d6a86971740d477a9f360e50a369c8f3_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1675976118433; access_time=1675976117625; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-09 20:55:18,938 INFO [Listener at localhost/46855] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testGetAfterCompaction/19885aea7f08eabc6250cea5b51b5968/f1/11d3709108b24ef1a448effbedef62c6; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675976117596; access_time=1675976116781; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 20:55:18,939 INFO [Listener at localhost/46855] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testGetAfterCompaction/19885aea7f08eabc6250cea5b51b5968/f1/816beafa9a1b44d09e25047ea05c9a55; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675976116768; access_time=1675976115951; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 20:55:18,939 INFO [Listener at localhost/46855] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testGetAfterCompaction/19885aea7f08eabc6250cea5b51b5968/f1/d6a86971740d477a9f360e50a369c8f3_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1675976118433; access_time=1675976117625; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-09 20:55:18,989 INFO [Listener at localhost/46855] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testGetAfterCompaction/19885aea7f08eabc6250cea5b51b5968/f1/11d3709108b24ef1a448effbedef62c6; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675976117596; access_time=1675976116781; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 20:55:18,990 INFO [Listener at localhost/46855] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testGetAfterCompaction/19885aea7f08eabc6250cea5b51b5968/f1/816beafa9a1b44d09e25047ea05c9a55; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675976116768; access_time=1675976115951; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 20:55:18,990 INFO [Listener at localhost/46855] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testGetAfterCompaction/19885aea7f08eabc6250cea5b51b5968/f1/d6a86971740d477a9f360e50a369c8f3_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1675976118433; access_time=1675976117625; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-09 20:55:19,040 INFO [Listener at localhost/46855] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testGetAfterCompaction/19885aea7f08eabc6250cea5b51b5968/f1/11d3709108b24ef1a448effbedef62c6; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675976117596; access_time=1675976116781; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 20:55:19,041 INFO [Listener at localhost/46855] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testGetAfterCompaction/19885aea7f08eabc6250cea5b51b5968/f1/816beafa9a1b44d09e25047ea05c9a55; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675976116768; access_time=1675976115951; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 20:55:19,041 INFO [Listener at localhost/46855] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testGetAfterCompaction/19885aea7f08eabc6250cea5b51b5968/f1/d6a86971740d477a9f360e50a369c8f3_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1675976118433; access_time=1675976117625; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-09 20:55:19,091 INFO [Listener at localhost/46855] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testGetAfterCompaction/19885aea7f08eabc6250cea5b51b5968/f1/11d3709108b24ef1a448effbedef62c6; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675976117596; access_time=1675976116781; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 20:55:19,091 INFO [Listener at localhost/46855] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testGetAfterCompaction/19885aea7f08eabc6250cea5b51b5968/f1/816beafa9a1b44d09e25047ea05c9a55; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675976116768; access_time=1675976115951; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 20:55:19,092 INFO [Listener at localhost/46855] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testGetAfterCompaction/19885aea7f08eabc6250cea5b51b5968/f1/d6a86971740d477a9f360e50a369c8f3_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1675976118433; access_time=1675976117625; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-09 20:55:19,142 INFO [Listener at localhost/46855] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testGetAfterCompaction/19885aea7f08eabc6250cea5b51b5968/f1/11d3709108b24ef1a448effbedef62c6; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675976117596; access_time=1675976116781; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 20:55:19,142 INFO [Listener at localhost/46855] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testGetAfterCompaction/19885aea7f08eabc6250cea5b51b5968/f1/816beafa9a1b44d09e25047ea05c9a55; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675976116768; access_time=1675976115951; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 20:55:19,143 INFO [Listener at localhost/46855] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testGetAfterCompaction/19885aea7f08eabc6250cea5b51b5968/f1/d6a86971740d477a9f360e50a369c8f3_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1675976118433; access_time=1675976117625; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-09 20:55:19,193 INFO [Listener at localhost/46855] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testGetAfterCompaction/19885aea7f08eabc6250cea5b51b5968/f1/11d3709108b24ef1a448effbedef62c6; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675976117596; access_time=1675976116781; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 20:55:19,193 INFO [Listener at localhost/46855] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testGetAfterCompaction/19885aea7f08eabc6250cea5b51b5968/f1/816beafa9a1b44d09e25047ea05c9a55; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675976116768; access_time=1675976115951; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 20:55:19,194 INFO [Listener at localhost/46855] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testGetAfterCompaction/19885aea7f08eabc6250cea5b51b5968/f1/d6a86971740d477a9f360e50a369c8f3_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1675976118433; access_time=1675976117625; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-09 20:55:19,244 INFO [Listener at localhost/46855] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testGetAfterCompaction/19885aea7f08eabc6250cea5b51b5968/f1/11d3709108b24ef1a448effbedef62c6; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675976117596; access_time=1675976116781; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 20:55:19,244 INFO [Listener at localhost/46855] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testGetAfterCompaction/19885aea7f08eabc6250cea5b51b5968/f1/816beafa9a1b44d09e25047ea05c9a55; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675976116768; access_time=1675976115951; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 20:55:19,244 INFO [Listener at localhost/46855] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testGetAfterCompaction/19885aea7f08eabc6250cea5b51b5968/f1/d6a86971740d477a9f360e50a369c8f3_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1675976118433; access_time=1675976117625; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-09 20:55:19,295 INFO [Listener at localhost/46855] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testGetAfterCompaction/19885aea7f08eabc6250cea5b51b5968/f1/11d3709108b24ef1a448effbedef62c6; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675976117596; access_time=1675976116781; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 20:55:19,295 INFO [Listener at localhost/46855] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testGetAfterCompaction/19885aea7f08eabc6250cea5b51b5968/f1/816beafa9a1b44d09e25047ea05c9a55; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675976116768; access_time=1675976115951; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 20:55:19,295 INFO [Listener at localhost/46855] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testGetAfterCompaction/19885aea7f08eabc6250cea5b51b5968/f1/d6a86971740d477a9f360e50a369c8f3_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1675976118433; access_time=1675976117625; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-09 20:55:19,306 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testGetAfterCompaction/19885aea7f08eabc6250cea5b51b5968/.tmp/f1/52bf666b92a043d69b903f53c1624756 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testGetAfterCompaction/19885aea7f08eabc6250cea5b51b5968/f1/52bf666b92a043d69b903f53c1624756 2023-02-09 20:55:19,311 INFO [RS:0;jenkins-hbase9:40919-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 2 file(s) in 19885aea7f08eabc6250cea5b51b5968/f1 of 19885aea7f08eabc6250cea5b51b5968 into 52bf666b92a043d69b903f53c1624756(size=5.1 K), total size for store is 10.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-09 20:55:19,311 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 19885aea7f08eabc6250cea5b51b5968: 2023-02-09 20:55:19,311 INFO [RS:0;jenkins-hbase9:40919-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testGetAfterCompaction,,1675976113830.19885aea7f08eabc6250cea5b51b5968., storeName=f1, fileCount=2, fileSize=10.0 K (4.9 K, 5.1 K), priority=2, time=1675976118480; duration=0sec 2023-02-09 20:55:19,311 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-09 20:55:19,346 INFO [Listener at localhost/46855] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testGetAfterCompaction/19885aea7f08eabc6250cea5b51b5968/f1/11d3709108b24ef1a448effbedef62c6; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675976117596; access_time=1675976116781; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 20:55:19,346 INFO [Listener at localhost/46855] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testGetAfterCompaction/19885aea7f08eabc6250cea5b51b5968/f1/52bf666b92a043d69b903f53c1624756; isDirectory=false; length=5228; replication=1; blocksize=134217728; modification_time=1675976119301; access_time=1675976118485; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 20:55:19,346 INFO [Listener at localhost/46855] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testGetAfterCompaction/19885aea7f08eabc6250cea5b51b5968/f1/816beafa9a1b44d09e25047ea05c9a55; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675976116768; access_time=1675976115951; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 20:55:19,346 INFO [Listener at localhost/46855] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testGetAfterCompaction/19885aea7f08eabc6250cea5b51b5968/f1/d6a86971740d477a9f360e50a369c8f3_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1675976118433; access_time=1675976117625; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-09 20:55:19,357 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testGetAfterCompaction/19885aea7f08eabc6250cea5b51b5968/f1/11d3709108b24ef1a448effbedef62c6, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testGetAfterCompaction/19885aea7f08eabc6250cea5b51b5968/f1/d6a86971740d477a9f360e50a369c8f3_SeqId_12_] to archive 2023-02-09 20:55:19,357 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 20:55:19,359 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testGetAfterCompaction/19885aea7f08eabc6250cea5b51b5968/f1/11d3709108b24ef1a448effbedef62c6 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testGetAfterCompaction/19885aea7f08eabc6250cea5b51b5968/f1/11d3709108b24ef1a448effbedef62c6 2023-02-09 20:55:19,360 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testGetAfterCompaction/19885aea7f08eabc6250cea5b51b5968/f1/d6a86971740d477a9f360e50a369c8f3_SeqId_12_ to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testGetAfterCompaction/19885aea7f08eabc6250cea5b51b5968/f1/d6a86971740d477a9f360e50a369c8f3_SeqId_12_ 2023-02-09 20:55:19,397 INFO [Listener at localhost/46855] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testGetAfterCompaction/19885aea7f08eabc6250cea5b51b5968/f1/52bf666b92a043d69b903f53c1624756; isDirectory=false; length=5228; replication=1; blocksize=134217728; modification_time=1675976119301; access_time=1675976118485; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 20:55:19,397 INFO [Listener at localhost/46855] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testGetAfterCompaction/19885aea7f08eabc6250cea5b51b5968/f1/816beafa9a1b44d09e25047ea05c9a55; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675976116768; access_time=1675976115951; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-09 20:55:19,427 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-09 20:55:19,517 INFO [Listener at localhost/46855] client.HBaseAdmin$15(890): Started disable of testGetAfterCompaction 2023-02-09 20:55:19,521 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.HMaster$11(2405): Client=jenkins//172.31.2.10 disable testGetAfterCompaction 2023-02-09 20:55:19,526 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure2.ProcedureExecutor(1029): Stored pid=75, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testGetAfterCompaction 2023-02-09 20:55:19,529 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675976119529"}]},"ts":"1675976119529"} 2023-02-09 20:55:19,530 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=DISABLING in hbase:meta 2023-02-09 20:55:19,530 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1227): Checking to see if procedure is done pid=75 2023-02-09 20:55:19,536 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testGetAfterCompaction to state=DISABLING 2023-02-09 20:55:19,537 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=76, ppid=75, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testGetAfterCompaction, region=19885aea7f08eabc6250cea5b51b5968, UNASSIGN}] 2023-02-09 20:55:19,538 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=75, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testGetAfterCompaction, region=19885aea7f08eabc6250cea5b51b5968, UNASSIGN 2023-02-09 20:55:19,539 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=19885aea7f08eabc6250cea5b51b5968, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:19,539 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testGetAfterCompaction,,1675976113830.19885aea7f08eabc6250cea5b51b5968.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1675976119539"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675976119539"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675976119539"}]},"ts":"1675976119539"} 2023-02-09 20:55:19,540 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; CloseRegionProcedure 19885aea7f08eabc6250cea5b51b5968, server=jenkins-hbase9.apache.org,40919,1675976022294}] 2023-02-09 20:55:19,631 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1227): Checking to see if procedure is done pid=75 2023-02-09 20:55:19,691 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(109): Close 19885aea7f08eabc6250cea5b51b5968 2023-02-09 20:55:19,691 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing 19885aea7f08eabc6250cea5b51b5968, disabling compactions & flushes 2023-02-09 20:55:19,692 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region testGetAfterCompaction,,1675976113830.19885aea7f08eabc6250cea5b51b5968. 2023-02-09 20:55:19,692 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testGetAfterCompaction,,1675976113830.19885aea7f08eabc6250cea5b51b5968. 2023-02-09 20:55:19,692 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on testGetAfterCompaction,,1675976113830.19885aea7f08eabc6250cea5b51b5968. after waiting 0 ms 2023-02-09 20:55:19,692 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region testGetAfterCompaction,,1675976113830.19885aea7f08eabc6250cea5b51b5968. 2023-02-09 20:55:19,697 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testGetAfterCompaction/19885aea7f08eabc6250cea5b51b5968/recovered.edits/15.seqid, newMaxSeqId=15, maxSeqId=1 2023-02-09 20:55:19,697 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro 2023-02-09 20:55:19,698 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed testGetAfterCompaction,,1675976113830.19885aea7f08eabc6250cea5b51b5968. 2023-02-09 20:55:19,698 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for 19885aea7f08eabc6250cea5b51b5968: Waiting for close lock at 1675976119691Running coprocessor pre-close hooks at 1675976119691Disabling compacts and flushes for region at 1675976119691Disabling writes for close at 1675976119692 (+1 ms)Writing region close event to WAL at 1675976119694 (+2 ms)Running coprocessor post-close hooks at 1675976119697 (+3 ms)Closed at 1675976119698 (+1 ms) 2023-02-09 20:55:19,699 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(147): Closed 19885aea7f08eabc6250cea5b51b5968 2023-02-09 20:55:19,700 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=19885aea7f08eabc6250cea5b51b5968, regionState=CLOSED 2023-02-09 20:55:19,700 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testGetAfterCompaction,,1675976113830.19885aea7f08eabc6250cea5b51b5968.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1675976119699"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675976119699"}]},"ts":"1675976119699"} 2023-02-09 20:55:19,702 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=77, resume processing ppid=76 2023-02-09 20:55:19,702 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=77, ppid=76, state=SUCCESS; CloseRegionProcedure 19885aea7f08eabc6250cea5b51b5968, server=jenkins-hbase9.apache.org,40919,1675976022294 in 161 msec 2023-02-09 20:55:19,703 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=76, resume processing ppid=75 2023-02-09 20:55:19,703 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=76, ppid=75, state=SUCCESS; TransitRegionStateProcedure table=testGetAfterCompaction, region=19885aea7f08eabc6250cea5b51b5968, UNASSIGN in 165 msec 2023-02-09 20:55:19,703 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675976119703"}]},"ts":"1675976119703"} 2023-02-09 20:55:19,704 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=DISABLED in hbase:meta 2023-02-09 20:55:19,705 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testGetAfterCompaction to state=DISABLED 2023-02-09 20:55:19,707 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=75, state=SUCCESS; DisableTableProcedure table=testGetAfterCompaction in 184 msec 2023-02-09 20:55:19,832 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1227): Checking to see if procedure is done pid=75 2023-02-09 20:55:19,832 INFO [Listener at localhost/46855] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testGetAfterCompaction, procId: 75 completed 2023-02-09 20:55:19,836 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.HMaster$5(2215): Client=jenkins//172.31.2.10 delete testGetAfterCompaction 2023-02-09 20:55:19,842 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure2.ProcedureExecutor(1029): Stored pid=78, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testGetAfterCompaction 2023-02-09 20:55:19,843 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=78, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-02-09 20:55:19,845 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=78, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-02-09 20:55:19,845 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1227): Checking to see if procedure is done pid=78 2023-02-09 20:55:19,847 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/.tmp/data/default/testGetAfterCompaction/19885aea7f08eabc6250cea5b51b5968 2023-02-09 20:55:19,850 DEBUG [HFileArchiver-12] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/.tmp/data/default/testGetAfterCompaction/19885aea7f08eabc6250cea5b51b5968/f1, FileablePath, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/.tmp/data/default/testGetAfterCompaction/19885aea7f08eabc6250cea5b51b5968/recovered.edits] 2023-02-09 20:55:19,852 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/.tmp/data/default/testGetAfterCompaction/19885aea7f08eabc6250cea5b51b5968/f1/52bf666b92a043d69b903f53c1624756 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testGetAfterCompaction/19885aea7f08eabc6250cea5b51b5968/f1/52bf666b92a043d69b903f53c1624756 2023-02-09 20:55:19,853 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/.tmp/data/default/testGetAfterCompaction/19885aea7f08eabc6250cea5b51b5968/f1/816beafa9a1b44d09e25047ea05c9a55 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testGetAfterCompaction/19885aea7f08eabc6250cea5b51b5968/f1/816beafa9a1b44d09e25047ea05c9a55 2023-02-09 20:55:19,856 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/.tmp/data/default/testGetAfterCompaction/19885aea7f08eabc6250cea5b51b5968/recovered.edits/15.seqid to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testGetAfterCompaction/19885aea7f08eabc6250cea5b51b5968/recovered.edits/15.seqid 2023-02-09 20:55:19,857 DEBUG [HFileArchiver-12] backup.HFileArchiver(596): Deleted hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/.tmp/data/default/testGetAfterCompaction/19885aea7f08eabc6250cea5b51b5968 2023-02-09 20:55:19,857 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testGetAfterCompaction regions 2023-02-09 20:55:19,857 DEBUG [PEWorker-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0 2023-02-09 20:55:19,858 DEBUG [PEWorker-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1] 2023-02-09 20:55:19,861 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20230209b6db5a18f54a46049d91c9a4b386e5e7 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20230209b6db5a18f54a46049d91c9a4b386e5e7 2023-02-09 20:55:19,861 DEBUG [PEWorker-5] backup.HFileArchiver(596): Deleted hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0 2023-02-09 20:55:19,864 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=78, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-02-09 20:55:19,885 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testGetAfterCompaction from hbase:meta 2023-02-09 20:55:19,887 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testGetAfterCompaction' descriptor. 2023-02-09 20:55:19,889 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=78, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-02-09 20:55:19,889 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testGetAfterCompaction' from region states. 2023-02-09 20:55:19,889 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testGetAfterCompaction,,1675976113830.19885aea7f08eabc6250cea5b51b5968.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675976119889"}]},"ts":"9223372036854775807"} 2023-02-09 20:55:19,890 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-09 20:55:19,890 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 19885aea7f08eabc6250cea5b51b5968, NAME => 'testGetAfterCompaction,,1675976113830.19885aea7f08eabc6250cea5b51b5968.', STARTKEY => '', ENDKEY => ''}] 2023-02-09 20:55:19,891 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testGetAfterCompaction' as deleted. 2023-02-09 20:55:19,891 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1675976119891"}]},"ts":"9223372036854775807"} 2023-02-09 20:55:19,892 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testGetAfterCompaction state from META 2023-02-09 20:55:19,894 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=78, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-02-09 20:55:19,895 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=78, state=SUCCESS; DeleteTableProcedure table=testGetAfterCompaction in 57 msec 2023-02-09 20:55:19,946 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1227): Checking to see if procedure is done pid=78 2023-02-09 20:55:19,946 INFO [Listener at localhost/46855] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testGetAfterCompaction, procId: 78 completed 2023-02-09 20:55:19,959 INFO [Listener at localhost/46855] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testGetAfterCompaction Thread=236 (was 251), OpenFileDescriptor=594 (was 641), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=100 (was 118), ProcessCount=168 (was 168), AvailableMemoryMB=10640 (was 10651) 2023-02-09 20:55:19,969 INFO [Listener at localhost/46855] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testCompactionWithHFileLink Thread=236, OpenFileDescriptor=594, MaxFileDescriptor=60000, SystemLoadAverage=100, ProcessCount=168, AvailableMemoryMB=10640 2023-02-09 20:55:19,971 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.HMaster$4(2102): Client=jenkins//172.31.2.10 create 'testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-02-09 20:55:19,972 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure2.ProcedureExecutor(1029): Stored pid=79, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testCompactionWithHFileLink 2023-02-09 20:55:19,973 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_PRE_OPERATION 2023-02-09 20:55:19,973 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(697): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testCompactionWithHFileLink" procId is: 79 2023-02-09 20:55:19,973 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-09 20:55:19,974 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-02-09 20:55:19,975 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/.tmp/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5 2023-02-09 20:55:19,975 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/.tmp/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21 2023-02-09 20:55:19,975 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/.tmp/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b 2023-02-09 20:55:19,976 DEBUG [HFileArchiver-13] backup.HFileArchiver(153): Directory hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/.tmp/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5 empty. 2023-02-09 20:55:19,976 DEBUG [HFileArchiver-14] backup.HFileArchiver(153): Directory hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/.tmp/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21 empty. 2023-02-09 20:55:19,976 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/.tmp/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b empty. 2023-02-09 20:55:19,976 DEBUG [HFileArchiver-13] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/.tmp/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5 2023-02-09 20:55:19,976 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/.tmp/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b 2023-02-09 20:55:19,976 DEBUG [HFileArchiver-14] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/.tmp/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21 2023-02-09 20:55:19,976 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testCompactionWithHFileLink regions 2023-02-09 20:55:20,075 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-02-09 20:55:20,275 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-02-09 20:55:20,384 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/.tmp/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000001 2023-02-09 20:55:20,385 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(7671): creating {ENCODED => 9dee656d29adb7e6b7d42a643b66b07b, NAME => 'testCompactionWithHFileLink,2,1675976119971.9dee656d29adb7e6b7d42a643b66b07b.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/.tmp 2023-02-09 20:55:20,386 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(7671): creating {ENCODED => d3a98fcfad73ec6f98096a0e81049c21, NAME => 'testCompactionWithHFileLink,1,1675976119971.d3a98fcfad73ec6f98096a0e81049c21.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/.tmp 2023-02-09 20:55:20,386 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(7671): creating {ENCODED => fd99e712d029b1479ee16c3a0c467ce5, NAME => 'testCompactionWithHFileLink,,1675976119971.fd99e712d029b1479ee16c3a0c467ce5.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/.tmp 2023-02-09 20:55:20,576 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-02-09 20:55:20,794 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(865): Instantiated testCompactionWithHFileLink,2,1675976119971.9dee656d29adb7e6b7d42a643b66b07b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 20:55:20,794 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(865): Instantiated testCompactionWithHFileLink,,1675976119971.fd99e712d029b1479ee16c3a0c467ce5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 20:55:20,794 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(865): Instantiated testCompactionWithHFileLink,1,1675976119971.d3a98fcfad73ec6f98096a0e81049c21.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 20:55:20,794 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1603): Closing fd99e712d029b1479ee16c3a0c467ce5, disabling compactions & flushes 2023-02-09 20:55:20,794 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1603): Closing d3a98fcfad73ec6f98096a0e81049c21, disabling compactions & flushes 2023-02-09 20:55:20,794 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1625): Closing region testCompactionWithHFileLink,,1675976119971.fd99e712d029b1479ee16c3a0c467ce5. 2023-02-09 20:55:20,794 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testCompactionWithHFileLink,,1675976119971.fd99e712d029b1479ee16c3a0c467ce5. 2023-02-09 20:55:20,794 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1603): Closing 9dee656d29adb7e6b7d42a643b66b07b, disabling compactions & flushes 2023-02-09 20:55:20,794 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1713): Acquired close lock on testCompactionWithHFileLink,,1675976119971.fd99e712d029b1479ee16c3a0c467ce5. after waiting 0 ms 2023-02-09 20:55:20,794 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1625): Closing region testCompactionWithHFileLink,2,1675976119971.9dee656d29adb7e6b7d42a643b66b07b. 2023-02-09 20:55:20,794 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1723): Updates disabled for region testCompactionWithHFileLink,,1675976119971.fd99e712d029b1479ee16c3a0c467ce5. 2023-02-09 20:55:20,794 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1625): Closing region testCompactionWithHFileLink,1,1675976119971.d3a98fcfad73ec6f98096a0e81049c21. 2023-02-09 20:55:20,795 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1675976119971.d3a98fcfad73ec6f98096a0e81049c21. 2023-02-09 20:55:20,795 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1837): Closed testCompactionWithHFileLink,,1675976119971.fd99e712d029b1479ee16c3a0c467ce5. 2023-02-09 20:55:20,795 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1675976119971.9dee656d29adb7e6b7d42a643b66b07b. 2023-02-09 20:55:20,795 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1557): Region close journal for fd99e712d029b1479ee16c3a0c467ce5: Waiting for close lock at 1675976120794Disabling compacts and flushes for region at 1675976120794Disabling writes for close at 1675976120794Writing region close event to WAL at 1675976120795 (+1 ms)Closed at 1675976120795 2023-02-09 20:55:20,795 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1713): Acquired close lock on testCompactionWithHFileLink,1,1675976119971.d3a98fcfad73ec6f98096a0e81049c21. after waiting 0 ms 2023-02-09 20:55:20,795 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1723): Updates disabled for region testCompactionWithHFileLink,1,1675976119971.d3a98fcfad73ec6f98096a0e81049c21. 2023-02-09 20:55:20,795 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1713): Acquired close lock on testCompactionWithHFileLink,2,1675976119971.9dee656d29adb7e6b7d42a643b66b07b. after waiting 0 ms 2023-02-09 20:55:20,795 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1723): Updates disabled for region testCompactionWithHFileLink,2,1675976119971.9dee656d29adb7e6b7d42a643b66b07b. 2023-02-09 20:55:20,795 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1837): Closed testCompactionWithHFileLink,1,1675976119971.d3a98fcfad73ec6f98096a0e81049c21. 2023-02-09 20:55:20,795 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1837): Closed testCompactionWithHFileLink,2,1675976119971.9dee656d29adb7e6b7d42a643b66b07b. 2023-02-09 20:55:20,795 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1557): Region close journal for d3a98fcfad73ec6f98096a0e81049c21: Waiting for close lock at 1675976120794Disabling compacts and flushes for region at 1675976120794Disabling writes for close at 1675976120795 (+1 ms)Writing region close event to WAL at 1675976120795Closed at 1675976120795 2023-02-09 20:55:20,795 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1557): Region close journal for 9dee656d29adb7e6b7d42a643b66b07b: Waiting for close lock at 1675976120794Disabling compacts and flushes for region at 1675976120794Disabling writes for close at 1675976120795 (+1 ms)Writing region close event to WAL at 1675976120795Closed at 1675976120795 2023-02-09 20:55:20,797 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_ADD_TO_META 2023-02-09 20:55:20,798 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1675976119971.fd99e712d029b1479ee16c3a0c467ce5.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1675976120798"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675976120798"}]},"ts":"1675976120798"} 2023-02-09 20:55:20,798 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1675976119971.d3a98fcfad73ec6f98096a0e81049c21.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1675976120798"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675976120798"}]},"ts":"1675976120798"} 2023-02-09 20:55:20,798 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1675976119971.9dee656d29adb7e6b7d42a643b66b07b.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1675976120798"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675976120798"}]},"ts":"1675976120798"} 2023-02-09 20:55:20,800 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-02-09 20:55:20,800 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-09 20:55:20,800 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675976120800"}]},"ts":"1675976120800"} 2023-02-09 20:55:20,801 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLING in hbase:meta 2023-02-09 20:55:20,807 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=fd99e712d029b1479ee16c3a0c467ce5, ASSIGN}, {pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=d3a98fcfad73ec6f98096a0e81049c21, ASSIGN}, {pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=9dee656d29adb7e6b7d42a643b66b07b, ASSIGN}] 2023-02-09 20:55:20,808 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=fd99e712d029b1479ee16c3a0c467ce5, ASSIGN 2023-02-09 20:55:20,808 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=9dee656d29adb7e6b7d42a643b66b07b, ASSIGN 2023-02-09 20:55:20,808 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=d3a98fcfad73ec6f98096a0e81049c21, ASSIGN 2023-02-09 20:55:20,809 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=fd99e712d029b1479ee16c3a0c467ce5, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,40919,1675976022294; forceNewPlan=false, retain=false 2023-02-09 20:55:20,809 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=d3a98fcfad73ec6f98096a0e81049c21, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,40919,1675976022294; forceNewPlan=false, retain=false 2023-02-09 20:55:20,809 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=9dee656d29adb7e6b7d42a643b66b07b, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,40919,1675976022294; forceNewPlan=false, retain=false 2023-02-09 20:55:20,960 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=80 updating hbase:meta row=fd99e712d029b1479ee16c3a0c467ce5, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:20,960 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=d3a98fcfad73ec6f98096a0e81049c21, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:20,960 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=82 updating hbase:meta row=9dee656d29adb7e6b7d42a643b66b07b, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:20,960 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1675976119971.fd99e712d029b1479ee16c3a0c467ce5.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1675976120960"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675976120960"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675976120960"}]},"ts":"1675976120960"} 2023-02-09 20:55:20,961 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1675976119971.d3a98fcfad73ec6f98096a0e81049c21.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1675976120960"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675976120960"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675976120960"}]},"ts":"1675976120960"} 2023-02-09 20:55:20,961 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1675976119971.9dee656d29adb7e6b7d42a643b66b07b.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1675976120960"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675976120960"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675976120960"}]},"ts":"1675976120960"} 2023-02-09 20:55:20,962 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=83, ppid=80, state=RUNNABLE; OpenRegionProcedure fd99e712d029b1479ee16c3a0c467ce5, server=jenkins-hbase9.apache.org,40919,1675976022294}] 2023-02-09 20:55:20,962 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=84, ppid=81, state=RUNNABLE; OpenRegionProcedure d3a98fcfad73ec6f98096a0e81049c21, server=jenkins-hbase9.apache.org,40919,1675976022294}] 2023-02-09 20:55:20,964 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=85, ppid=82, state=RUNNABLE; OpenRegionProcedure 9dee656d29adb7e6b7d42a643b66b07b, server=jenkins-hbase9.apache.org,40919,1675976022294}] 2023-02-09 20:55:21,077 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-02-09 20:55:21,117 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,,1675976119971.fd99e712d029b1479ee16c3a0c467ce5. 2023-02-09 20:55:21,117 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => fd99e712d029b1479ee16c3a0c467ce5, NAME => 'testCompactionWithHFileLink,,1675976119971.fd99e712d029b1479ee16c3a0c467ce5.', STARTKEY => '', ENDKEY => '1'} 2023-02-09 20:55:21,118 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink fd99e712d029b1479ee16c3a0c467ce5 2023-02-09 20:55:21,118 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated testCompactionWithHFileLink,,1675976119971.fd99e712d029b1479ee16c3a0c467ce5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 20:55:21,118 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for fd99e712d029b1479ee16c3a0c467ce5 2023-02-09 20:55:21,118 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for fd99e712d029b1479ee16c3a0c467ce5 2023-02-09 20:55:21,119 INFO [StoreOpener-fd99e712d029b1479ee16c3a0c467ce5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region fd99e712d029b1479ee16c3a0c467ce5 2023-02-09 20:55:21,120 DEBUG [StoreOpener-fd99e712d029b1479ee16c3a0c467ce5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/family1 2023-02-09 20:55:21,120 DEBUG [StoreOpener-fd99e712d029b1479ee16c3a0c467ce5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/family1 2023-02-09 20:55:21,121 INFO [StoreOpener-fd99e712d029b1479ee16c3a0c467ce5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fd99e712d029b1479ee16c3a0c467ce5 columnFamilyName family1 2023-02-09 20:55:21,122 INFO [StoreOpener-fd99e712d029b1479ee16c3a0c467ce5-1] regionserver.HStore(310): Store=fd99e712d029b1479ee16c3a0c467ce5/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 20:55:21,122 INFO [StoreOpener-fd99e712d029b1479ee16c3a0c467ce5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region fd99e712d029b1479ee16c3a0c467ce5 2023-02-09 20:55:21,123 DEBUG [StoreOpener-fd99e712d029b1479ee16c3a0c467ce5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/family2 2023-02-09 20:55:21,123 DEBUG [StoreOpener-fd99e712d029b1479ee16c3a0c467ce5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/family2 2023-02-09 20:55:21,123 INFO [StoreOpener-fd99e712d029b1479ee16c3a0c467ce5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fd99e712d029b1479ee16c3a0c467ce5 columnFamilyName family2 2023-02-09 20:55:21,124 INFO [StoreOpener-fd99e712d029b1479ee16c3a0c467ce5-1] regionserver.HStore(310): Store=fd99e712d029b1479ee16c3a0c467ce5/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 20:55:21,125 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5 2023-02-09 20:55:21,125 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5 2023-02-09 20:55:21,127 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 20:55:21,128 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for fd99e712d029b1479ee16c3a0c467ce5 2023-02-09 20:55:21,129 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 20:55:21,130 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened fd99e712d029b1479ee16c3a0c467ce5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72694807, jitterRate=0.08323703706264496}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 20:55:21,130 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for fd99e712d029b1479ee16c3a0c467ce5: Running coprocessor pre-open hook at 1675976121118Writing region info on filesystem at 1675976121118Initializing all the Stores at 1675976121119 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675976121119Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675976121119Cleaning up temporary data from old regions at 1675976121126 (+7 ms)Cleaning up detritus from prior splits at 1675976121126Running coprocessor post-open hooks at 1675976121130 (+4 ms)Region opened successfully at 1675976121130 2023-02-09 20:55:21,131 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,,1675976119971.fd99e712d029b1479ee16c3a0c467ce5., pid=83, masterSystemTime=1675976121115 2023-02-09 20:55:21,132 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,,1675976119971.fd99e712d029b1479ee16c3a0c467ce5. 2023-02-09 20:55:21,132 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,,1675976119971.fd99e712d029b1479ee16c3a0c467ce5. 2023-02-09 20:55:21,132 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,2,1675976119971.9dee656d29adb7e6b7d42a643b66b07b. 2023-02-09 20:55:21,132 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 9dee656d29adb7e6b7d42a643b66b07b, NAME => 'testCompactionWithHFileLink,2,1675976119971.9dee656d29adb7e6b7d42a643b66b07b.', STARTKEY => '2', ENDKEY => ''} 2023-02-09 20:55:21,132 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=80 updating hbase:meta row=fd99e712d029b1479ee16c3a0c467ce5, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:21,132 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 9dee656d29adb7e6b7d42a643b66b07b 2023-02-09 20:55:21,132 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated testCompactionWithHFileLink,2,1675976119971.9dee656d29adb7e6b7d42a643b66b07b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 20:55:21,132 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,,1675976119971.fd99e712d029b1479ee16c3a0c467ce5.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1675976121132"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675976121132"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675976121132"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675976121132"}]},"ts":"1675976121132"} 2023-02-09 20:55:21,132 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for 9dee656d29adb7e6b7d42a643b66b07b 2023-02-09 20:55:21,133 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for 9dee656d29adb7e6b7d42a643b66b07b 2023-02-09 20:55:21,133 INFO [StoreOpener-9dee656d29adb7e6b7d42a643b66b07b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 9dee656d29adb7e6b7d42a643b66b07b 2023-02-09 20:55:21,135 DEBUG [StoreOpener-9dee656d29adb7e6b7d42a643b66b07b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/family1 2023-02-09 20:55:21,135 DEBUG [StoreOpener-9dee656d29adb7e6b7d42a643b66b07b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/family1 2023-02-09 20:55:21,135 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=83, resume processing ppid=80 2023-02-09 20:55:21,135 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=83, ppid=80, state=SUCCESS; OpenRegionProcedure fd99e712d029b1479ee16c3a0c467ce5, server=jenkins-hbase9.apache.org,40919,1675976022294 in 172 msec 2023-02-09 20:55:21,135 INFO [StoreOpener-9dee656d29adb7e6b7d42a643b66b07b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9dee656d29adb7e6b7d42a643b66b07b columnFamilyName family1 2023-02-09 20:55:21,136 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=80, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=fd99e712d029b1479ee16c3a0c467ce5, ASSIGN in 330 msec 2023-02-09 20:55:21,136 INFO [StoreOpener-9dee656d29adb7e6b7d42a643b66b07b-1] regionserver.HStore(310): Store=9dee656d29adb7e6b7d42a643b66b07b/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 20:55:21,136 INFO [StoreOpener-9dee656d29adb7e6b7d42a643b66b07b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 9dee656d29adb7e6b7d42a643b66b07b 2023-02-09 20:55:21,137 DEBUG [StoreOpener-9dee656d29adb7e6b7d42a643b66b07b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/family2 2023-02-09 20:55:21,137 DEBUG [StoreOpener-9dee656d29adb7e6b7d42a643b66b07b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/family2 2023-02-09 20:55:21,137 INFO [StoreOpener-9dee656d29adb7e6b7d42a643b66b07b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9dee656d29adb7e6b7d42a643b66b07b columnFamilyName family2 2023-02-09 20:55:21,138 INFO [StoreOpener-9dee656d29adb7e6b7d42a643b66b07b-1] regionserver.HStore(310): Store=9dee656d29adb7e6b7d42a643b66b07b/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 20:55:21,139 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b 2023-02-09 20:55:21,139 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b 2023-02-09 20:55:21,141 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 20:55:21,141 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for 9dee656d29adb7e6b7d42a643b66b07b 2023-02-09 20:55:21,143 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 20:55:21,143 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened 9dee656d29adb7e6b7d42a643b66b07b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62207307, jitterRate=-0.07303889095783234}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 20:55:21,143 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for 9dee656d29adb7e6b7d42a643b66b07b: Running coprocessor pre-open hook at 1675976121133Writing region info on filesystem at 1675976121133Initializing all the Stores at 1675976121133Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675976121133Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675976121133Cleaning up temporary data from old regions at 1675976121140 (+7 ms)Cleaning up detritus from prior splits at 1675976121140Running coprocessor post-open hooks at 1675976121143 (+3 ms)Region opened successfully at 1675976121143 2023-02-09 20:55:21,144 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,2,1675976119971.9dee656d29adb7e6b7d42a643b66b07b., pid=85, masterSystemTime=1675976121115 2023-02-09 20:55:21,145 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,2,1675976119971.9dee656d29adb7e6b7d42a643b66b07b. 2023-02-09 20:55:21,145 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,2,1675976119971.9dee656d29adb7e6b7d42a643b66b07b. 2023-02-09 20:55:21,145 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,1,1675976119971.d3a98fcfad73ec6f98096a0e81049c21. 2023-02-09 20:55:21,145 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => d3a98fcfad73ec6f98096a0e81049c21, NAME => 'testCompactionWithHFileLink,1,1675976119971.d3a98fcfad73ec6f98096a0e81049c21.', STARTKEY => '1', ENDKEY => '2'} 2023-02-09 20:55:21,145 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=82 updating hbase:meta row=9dee656d29adb7e6b7d42a643b66b07b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:21,145 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink d3a98fcfad73ec6f98096a0e81049c21 2023-02-09 20:55:21,145 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,2,1675976119971.9dee656d29adb7e6b7d42a643b66b07b.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1675976121145"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675976121145"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675976121145"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675976121145"}]},"ts":"1675976121145"} 2023-02-09 20:55:21,145 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated testCompactionWithHFileLink,1,1675976119971.d3a98fcfad73ec6f98096a0e81049c21.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 20:55:21,146 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for d3a98fcfad73ec6f98096a0e81049c21 2023-02-09 20:55:21,146 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for d3a98fcfad73ec6f98096a0e81049c21 2023-02-09 20:55:21,147 INFO [StoreOpener-d3a98fcfad73ec6f98096a0e81049c21-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region d3a98fcfad73ec6f98096a0e81049c21 2023-02-09 20:55:21,148 DEBUG [StoreOpener-d3a98fcfad73ec6f98096a0e81049c21-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/family1 2023-02-09 20:55:21,148 DEBUG [StoreOpener-d3a98fcfad73ec6f98096a0e81049c21-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/family1 2023-02-09 20:55:21,148 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=85, resume processing ppid=82 2023-02-09 20:55:21,148 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=85, ppid=82, state=SUCCESS; OpenRegionProcedure 9dee656d29adb7e6b7d42a643b66b07b, server=jenkins-hbase9.apache.org,40919,1675976022294 in 184 msec 2023-02-09 20:55:21,148 INFO [StoreOpener-d3a98fcfad73ec6f98096a0e81049c21-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d3a98fcfad73ec6f98096a0e81049c21 columnFamilyName family1 2023-02-09 20:55:21,149 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=82, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=9dee656d29adb7e6b7d42a643b66b07b, ASSIGN in 342 msec 2023-02-09 20:55:21,149 INFO [StoreOpener-d3a98fcfad73ec6f98096a0e81049c21-1] regionserver.HStore(310): Store=d3a98fcfad73ec6f98096a0e81049c21/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 20:55:21,149 INFO [StoreOpener-d3a98fcfad73ec6f98096a0e81049c21-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region d3a98fcfad73ec6f98096a0e81049c21 2023-02-09 20:55:21,150 DEBUG [StoreOpener-d3a98fcfad73ec6f98096a0e81049c21-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/family2 2023-02-09 20:55:21,150 DEBUG [StoreOpener-d3a98fcfad73ec6f98096a0e81049c21-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/family2 2023-02-09 20:55:21,151 INFO [StoreOpener-d3a98fcfad73ec6f98096a0e81049c21-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d3a98fcfad73ec6f98096a0e81049c21 columnFamilyName family2 2023-02-09 20:55:21,151 INFO [StoreOpener-d3a98fcfad73ec6f98096a0e81049c21-1] regionserver.HStore(310): Store=d3a98fcfad73ec6f98096a0e81049c21/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 20:55:21,152 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21 2023-02-09 20:55:21,152 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21 2023-02-09 20:55:21,154 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 20:55:21,154 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for d3a98fcfad73ec6f98096a0e81049c21 2023-02-09 20:55:21,156 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 20:55:21,157 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened d3a98fcfad73ec6f98096a0e81049c21; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69436818, jitterRate=0.03468921780586243}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 20:55:21,157 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for d3a98fcfad73ec6f98096a0e81049c21: Running coprocessor pre-open hook at 1675976121146Writing region info on filesystem at 1675976121146Initializing all the Stores at 1675976121146Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675976121146Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675976121146Cleaning up temporary data from old regions at 1675976121153 (+7 ms)Cleaning up detritus from prior splits at 1675976121153Running coprocessor post-open hooks at 1675976121157 (+4 ms)Region opened successfully at 1675976121157 2023-02-09 20:55:21,157 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,1,1675976119971.d3a98fcfad73ec6f98096a0e81049c21., pid=84, masterSystemTime=1675976121115 2023-02-09 20:55:21,158 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,1,1675976119971.d3a98fcfad73ec6f98096a0e81049c21. 2023-02-09 20:55:21,158 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,1,1675976119971.d3a98fcfad73ec6f98096a0e81049c21. 2023-02-09 20:55:21,159 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=d3a98fcfad73ec6f98096a0e81049c21, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:21,159 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,1,1675976119971.d3a98fcfad73ec6f98096a0e81049c21.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1675976121159"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675976121159"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675976121159"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675976121159"}]},"ts":"1675976121159"} 2023-02-09 20:55:21,161 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=84, resume processing ppid=81 2023-02-09 20:55:21,161 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=84, ppid=81, state=SUCCESS; OpenRegionProcedure d3a98fcfad73ec6f98096a0e81049c21, server=jenkins-hbase9.apache.org,40919,1675976022294 in 198 msec 2023-02-09 20:55:21,162 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=81, resume processing ppid=79 2023-02-09 20:55:21,162 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=81, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=d3a98fcfad73ec6f98096a0e81049c21, ASSIGN in 356 msec 2023-02-09 20:55:21,163 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-09 20:55:21,163 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675976121163"}]},"ts":"1675976121163"} 2023-02-09 20:55:21,164 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLED in hbase:meta 2023-02-09 20:55:21,166 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_POST_OPERATION 2023-02-09 20:55:21,167 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=79, state=SUCCESS; CreateTableProcedure table=testCompactionWithHFileLink in 1.1950 sec 2023-02-09 20:55:22,078 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-02-09 20:55:22,079 INFO [Listener at localhost/46855] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testCompactionWithHFileLink, procId: 79 completed 2023-02-09 20:55:22,085 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,,1675976119971.fd99e712d029b1479ee16c3a0c467ce5. with WAL disabled. Data may be lost in the event of a crash. 2023-02-09 20:55:22,086 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,1,1675976119971.d3a98fcfad73ec6f98096a0e81049c21. with WAL disabled. Data may be lost in the event of a crash. 2023-02-09 20:55:22,087 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,2,1675976119971.9dee656d29adb7e6b7d42a643b66b07b. with WAL disabled. Data may be lost in the event of a crash. 2023-02-09 20:55:22,089 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(933): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-02-09 20:55:22,091 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-02-09 20:55:22,091 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-02-09 20:55:22,091 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:55:22,091 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-02-09 20:55:22,091 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-02-09 20:55:22,091 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-09 20:55:22,091 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-09 20:55:22,092 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:55:22,092 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:22,092 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:55:22,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:55:22,093 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:22,093 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 20:55:22,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-09 20:55:22,093 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-09 20:55:22,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 20:55:22,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-09 20:55:22,093 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-02-09 20:55:22,094 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-02-09 20:55:22,094 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-02-09 20:55:22,094 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:55:22,094 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-02-09 20:55:22,094 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1675976119971.d3a98fcfad73ec6f98096a0e81049c21. 2023-02-09 20:55:22,094 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-09 20:55:22,094 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1675976119971.9dee656d29adb7e6b7d42a643b66b07b. 2023-02-09 20:55:22,094 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1675976119971.fd99e712d029b1479ee16c3a0c467ce5. 2023-02-09 20:55:22,094 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1675976119971.9dee656d29adb7e6b7d42a643b66b07b. started... 2023-02-09 20:55:22,094 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1675976119971.d3a98fcfad73ec6f98096a0e81049c21. started... 2023-02-09 20:55:22,094 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1675976119971.fd99e712d029b1479ee16c3a0c467ce5. started... 2023-02-09 20:55:22,094 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 20:55:22,095 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 9dee656d29adb7e6b7d42a643b66b07b 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-02-09 20:55:22,095 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing fd99e712d029b1479ee16c3a0c467ce5 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-02-09 20:55:22,095 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing d3a98fcfad73ec6f98096a0e81049c21 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-02-09 20:55:22,517 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230209da15212355094b199ba61e702d11757b to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230209da15212355094b199ba61e702d11757b 2023-02-09 20:55:22,517 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230209b1e9cbc26733498fb7dc0ad8994edf15 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230209b1e9cbc26733498fb7dc0ad8994edf15 2023-02-09 20:55:22,523 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023020946d52341946546bfa2faa21026abbf30 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023020946d52341946546bfa2faa21026abbf30 2023-02-09 20:55:22,922 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/.tmp/family1/7adfdbfb53834874af61c06653ea05d9 2023-02-09 20:55:22,923 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/.tmp/family1/8dffd447500b40ddbcd436ec073020e4 2023-02-09 20:55:22,927 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/.tmp/family1/cecce63cee614c1d85268b380746fc1f 2023-02-09 20:55:23,339 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202302095c5742f64ebb4297918a10abaf0e7d74 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202302095c5742f64ebb4297918a10abaf0e7d74 2023-02-09 20:55:23,340 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230209112df9ed6589400f8e173b856e29ffc1 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230209112df9ed6589400f8e173b856e29ffc1 2023-02-09 20:55:23,341 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202302096fe89508efe4423f8eaad35ebfde57f0 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202302096fe89508efe4423f8eaad35ebfde57f0 2023-02-09 20:55:23,745 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/.tmp/family2/39383c1ed4b64edca22dee4cc20a06cd 2023-02-09 20:55:23,745 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/.tmp/family2/b033bc8de43c48fe813afee249071e04 2023-02-09 20:55:23,746 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/.tmp/family2/f62e3e2786aa4157a19aba13c6283944 2023-02-09 20:55:23,750 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/.tmp/family1/7adfdbfb53834874af61c06653ea05d9 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/family1/7adfdbfb53834874af61c06653ea05d9 2023-02-09 20:55:23,750 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/.tmp/family1/cecce63cee614c1d85268b380746fc1f as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/family1/cecce63cee614c1d85268b380746fc1f 2023-02-09 20:55:23,750 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/.tmp/family1/8dffd447500b40ddbcd436ec073020e4 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/family1/8dffd447500b40ddbcd436ec073020e4 2023-02-09 20:55:23,754 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/family1/cecce63cee614c1d85268b380746fc1f, entries=4, sequenceid=5, filesize=5.4 K 2023-02-09 20:55:23,754 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/family1/7adfdbfb53834874af61c06653ea05d9, entries=4, sequenceid=5, filesize=5.4 K 2023-02-09 20:55:23,754 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/family1/8dffd447500b40ddbcd436ec073020e4, entries=4, sequenceid=5, filesize=5.4 K 2023-02-09 20:55:23,755 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/.tmp/family2/f62e3e2786aa4157a19aba13c6283944 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/family2/f62e3e2786aa4157a19aba13c6283944 2023-02-09 20:55:23,755 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/.tmp/family2/b033bc8de43c48fe813afee249071e04 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/family2/b033bc8de43c48fe813afee249071e04 2023-02-09 20:55:23,755 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/.tmp/family2/39383c1ed4b64edca22dee4cc20a06cd as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/family2/39383c1ed4b64edca22dee4cc20a06cd 2023-02-09 20:55:23,760 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/family2/f62e3e2786aa4157a19aba13c6283944, entries=2, sequenceid=5, filesize=5.1 K 2023-02-09 20:55:23,760 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/family2/b033bc8de43c48fe813afee249071e04, entries=2, sequenceid=5, filesize=5.1 K 2023-02-09 20:55:23,760 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for fd99e712d029b1479ee16c3a0c467ce5 in 1665ms, sequenceid=5, compaction requested=false 2023-02-09 20:55:23,761 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testCompactionWithHFileLink' 2023-02-09 20:55:23,761 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for fd99e712d029b1479ee16c3a0c467ce5: 2023-02-09 20:55:23,761 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1675976119971.fd99e712d029b1479ee16c3a0c467ce5. 2023-02-09 20:55:23,761 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/family2/39383c1ed4b64edca22dee4cc20a06cd, entries=2, sequenceid=5, filesize=5.1 K 2023-02-09 20:55:23,761 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-09 20:55:23,762 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 9dee656d29adb7e6b7d42a643b66b07b in 1667ms, sequenceid=5, compaction requested=false 2023-02-09 20:55:23,763 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 9dee656d29adb7e6b7d42a643b66b07b: 2023-02-09 20:55:23,763 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for d3a98fcfad73ec6f98096a0e81049c21 in 1668ms, sequenceid=5, compaction requested=false 2023-02-09 20:55:23,763 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1675976119971.9dee656d29adb7e6b7d42a643b66b07b. 2023-02-09 20:55:23,763 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for d3a98fcfad73ec6f98096a0e81049c21: 2023-02-09 20:55:23,763 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-09 20:55:23,763 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1675976119971.d3a98fcfad73ec6f98096a0e81049c21. 2023-02-09 20:55:23,763 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-09 20:55:23,763 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-09 20:55:23,763 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:23,763 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-02-09 20:55:23,763 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-02-09 20:55:23,766 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:23,766 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-09 20:55:23,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:23,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:55:23,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:55:23,767 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-09 20:55:23,767 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 20:55:23,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:55:23,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:55:23,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-09 20:55:23,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:23,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:55:23,769 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-02-09 20:55:23,769 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@713de0ff[Count = 0] remaining members to acquire global barrier 2023-02-09 20:55:23,769 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-02-09 20:55:23,769 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-09 20:55:23,770 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-09 20:55:23,770 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-09 20:55:23,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-09 20:55:23,771 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-02-09 20:55:23,771 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-02-09 20:55:23,771 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase9.apache.org,40919,1675976022294' in zk 2023-02-09 20:55:23,771 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:23,771 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 20:55:23,772 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-02-09 20:55:23,772 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:55:23,772 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:23,772 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-02-09 20:55:23,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:23,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:55:23,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:55:23,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:55:23,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:55:23,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-09 20:55:23,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:23,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:55:23,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-09 20:55:23,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:23,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase9.apache.org,40919,1675976022294': 2023-02-09 20:55:23,774 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-02-09 20:55:23,774 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-02-09 20:55:23,774 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 20:55:23,774 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 20:55:23,774 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-02-09 20:55:23,774 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 20:55:23,775 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-09 20:55:23,775 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-09 20:55:23,775 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-09 20:55:23,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-09 20:55:23,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-09 20:55:23,775 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:55:23,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:55:23,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:55:23,776 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:55:23,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:55:23,776 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:23,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:55:23,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-09 20:55:23,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-09 20:55:23,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:55:23,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-09 20:55:23,777 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:23,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:23,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:55:23,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-09 20:55:23,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:23,779 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:55:23,779 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:55:23,779 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:55:23,779 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-02-09 20:55:23,779 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 20:55:23,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:55:23,779 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:55:23,779 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:23,779 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-09 20:55:23,779 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-09 20:55:23,779 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:23,779 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-02-09 20:55:23,779 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:55:23,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:55:23,779 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-09 20:55:23,779 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 20:55:23,779 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-09 20:55:23,780 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-09 20:55:23,880 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 20:55:23,880 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 20:55:23,881 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,,1675976119971.fd99e712d029b1479ee16c3a0c467ce5. with WAL disabled. Data may be lost in the event of a crash. 2023-02-09 20:55:23,882 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,1,1675976119971.d3a98fcfad73ec6f98096a0e81049c21. with WAL disabled. Data may be lost in the event of a crash. 2023-02-09 20:55:23,882 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,2,1675976119971.9dee656d29adb7e6b7d42a643b66b07b. with WAL disabled. Data may be lost in the event of a crash. 2023-02-09 20:55:23,884 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(933): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-02-09 20:55:23,886 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-02-09 20:55:23,886 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-02-09 20:55:23,886 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-02-09 20:55:23,886 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:55:23,886 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-02-09 20:55:23,886 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-02-09 20:55:23,887 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-09 20:55:23,887 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-09 20:55:23,889 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:23,889 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:55:23,889 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:55:23,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:55:23,889 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:23,889 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 20:55:23,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-09 20:55:23,890 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-09 20:55:23,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 20:55:23,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-09 20:55:23,890 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-02-09 20:55:23,890 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-02-09 20:55:23,890 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-02-09 20:55:23,890 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-02-09 20:55:23,890 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:55:23,890 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-02-09 20:55:23,896 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1675976119971.d3a98fcfad73ec6f98096a0e81049c21. 2023-02-09 20:55:23,896 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1675976119971.d3a98fcfad73ec6f98096a0e81049c21. started... 2023-02-09 20:55:23,896 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1675976119971.9dee656d29adb7e6b7d42a643b66b07b. 2023-02-09 20:55:23,896 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1675976119971.9dee656d29adb7e6b7d42a643b66b07b. started... 2023-02-09 20:55:23,896 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-09 20:55:23,896 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 20:55:23,896 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing d3a98fcfad73ec6f98096a0e81049c21 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-02-09 20:55:23,896 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1675976119971.fd99e712d029b1479ee16c3a0c467ce5. 2023-02-09 20:55:23,896 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1675976119971.fd99e712d029b1479ee16c3a0c467ce5. started... 2023-02-09 20:55:23,896 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 9dee656d29adb7e6b7d42a643b66b07b 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-02-09 20:55:23,896 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing fd99e712d029b1479ee16c3a0c467ce5 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-02-09 20:55:23,920 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230209314a0b9217254e10b80045e601857690 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230209314a0b9217254e10b80045e601857690 2023-02-09 20:55:24,313 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202302094cd195d47b5e4378b7b7e975c1569dbb to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202302094cd195d47b5e4378b7b7e975c1569dbb 2023-02-09 20:55:24,318 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230209499d07c47b844887884c2cbec5562885 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230209499d07c47b844887884c2cbec5562885 2023-02-09 20:55:24,327 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/.tmp/family1/19be0e30a8ed4401bdaaaf7a7dd9875a 2023-02-09 20:55:24,718 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/.tmp/family1/80d6aeca24eb4e5aaa2d1e2e3735b803 2023-02-09 20:55:24,722 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/.tmp/family1/8a4fd3c0e795466fb8bcb12d2e892fa5 2023-02-09 20:55:24,732 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202302094002e9379daf4e94a0a0646dd285ab6b to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202302094002e9379daf4e94a0a0646dd285ab6b 2023-02-09 20:55:24,739 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302094c5a8e2c1dfe4a2e97768804a154fa62 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202302094c5a8e2c1dfe4a2e97768804a154fa62 2023-02-09 20:55:25,136 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230209baf731513ce1476690ee156f250822ff to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230209baf731513ce1476690ee156f250822ff 2023-02-09 20:55:25,137 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/.tmp/family2/634ca6469094417da516e2df95ebc29a 2023-02-09 20:55:25,141 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/.tmp/family1/80d6aeca24eb4e5aaa2d1e2e3735b803 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/family1/80d6aeca24eb4e5aaa2d1e2e3735b803 2023-02-09 20:55:25,144 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/.tmp/family2/65d11bd220904c5ebb12875f70b36894 2023-02-09 20:55:25,144 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/family1/80d6aeca24eb4e5aaa2d1e2e3735b803, entries=4, sequenceid=9, filesize=5.4 K 2023-02-09 20:55:25,145 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/.tmp/family2/634ca6469094417da516e2df95ebc29a as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/family2/634ca6469094417da516e2df95ebc29a 2023-02-09 20:55:25,148 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/.tmp/family1/19be0e30a8ed4401bdaaaf7a7dd9875a as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/family1/19be0e30a8ed4401bdaaaf7a7dd9875a 2023-02-09 20:55:25,149 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/family2/634ca6469094417da516e2df95ebc29a, entries=2, sequenceid=9, filesize=5.1 K 2023-02-09 20:55:25,150 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for d3a98fcfad73ec6f98096a0e81049c21 in 1254ms, sequenceid=9, compaction requested=false 2023-02-09 20:55:25,150 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for d3a98fcfad73ec6f98096a0e81049c21: 2023-02-09 20:55:25,150 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1675976119971.d3a98fcfad73ec6f98096a0e81049c21. 2023-02-09 20:55:25,150 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-09 20:55:25,152 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/family1/19be0e30a8ed4401bdaaaf7a7dd9875a, entries=4, sequenceid=9, filesize=5.4 K 2023-02-09 20:55:25,153 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/.tmp/family2/65d11bd220904c5ebb12875f70b36894 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/family2/65d11bd220904c5ebb12875f70b36894 2023-02-09 20:55:25,156 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/family2/65d11bd220904c5ebb12875f70b36894, entries=2, sequenceid=9, filesize=5.1 K 2023-02-09 20:55:25,157 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 9dee656d29adb7e6b7d42a643b66b07b in 1261ms, sequenceid=9, compaction requested=false 2023-02-09 20:55:25,157 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 9dee656d29adb7e6b7d42a643b66b07b: 2023-02-09 20:55:25,157 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1675976119971.9dee656d29adb7e6b7d42a643b66b07b. 2023-02-09 20:55:25,157 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-09 20:55:25,199 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-09 20:55:25,541 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/.tmp/family2/2965303a0eec417f93790a17caf709de 2023-02-09 20:55:25,545 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/.tmp/family1/8a4fd3c0e795466fb8bcb12d2e892fa5 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/family1/8a4fd3c0e795466fb8bcb12d2e892fa5 2023-02-09 20:55:25,549 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/family1/8a4fd3c0e795466fb8bcb12d2e892fa5, entries=4, sequenceid=9, filesize=5.4 K 2023-02-09 20:55:25,549 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/.tmp/family2/2965303a0eec417f93790a17caf709de as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/family2/2965303a0eec417f93790a17caf709de 2023-02-09 20:55:25,553 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/family2/2965303a0eec417f93790a17caf709de, entries=2, sequenceid=9, filesize=5.1 K 2023-02-09 20:55:25,554 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for fd99e712d029b1479ee16c3a0c467ce5 in 1658ms, sequenceid=9, compaction requested=false 2023-02-09 20:55:25,554 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for fd99e712d029b1479ee16c3a0c467ce5: 2023-02-09 20:55:25,554 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1675976119971.fd99e712d029b1479ee16c3a0c467ce5. 2023-02-09 20:55:25,554 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-09 20:55:25,554 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-09 20:55:25,554 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:25,554 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-02-09 20:55:25,554 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-02-09 20:55:25,556 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-09 20:55:25,556 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:25,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:25,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:55:25,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:55:25,556 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-09 20:55:25,556 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 20:55:25,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:55:25,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:55:25,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-09 20:55:25,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:25,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:55:25,557 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-02-09 20:55:25,557 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@510f6934[Count = 0] remaining members to acquire global barrier 2023-02-09 20:55:25,557 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-02-09 20:55:25,557 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-09 20:55:25,558 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-09 20:55:25,558 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-09 20:55:25,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-09 20:55:25,558 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-02-09 20:55:25,558 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-02-09 20:55:25,559 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase9.apache.org,40919,1675976022294' in zk 2023-02-09 20:55:25,559 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:25,559 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 20:55:25,562 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-02-09 20:55:25,562 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:25,562 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:55:25,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:25,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:55:25,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:55:25,562 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-02-09 20:55:25,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:55:25,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:55:25,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-09 20:55:25,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:25,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:55:25,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-09 20:55:25,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:25,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase9.apache.org,40919,1675976022294': 2023-02-09 20:55:25,564 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-02-09 20:55:25,564 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-02-09 20:55:25,564 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 20:55:25,564 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 20:55:25,564 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-02-09 20:55:25,564 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 20:55:25,565 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-09 20:55:25,565 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-09 20:55:25,565 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-09 20:55:25,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-09 20:55:25,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:55:25,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:55:25,565 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:55:25,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-09 20:55:25,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:55:25,566 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:25,566 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:55:25,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:55:25,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-09 20:55:25,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-09 20:55:25,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:55:25,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-09 20:55:25,567 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:25,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:25,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:55:25,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-09 20:55:25,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:25,569 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:55:25,569 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:25,569 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:55:25,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:55:25,569 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-02-09 20:55:25,569 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 20:55:25,569 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:55:25,569 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:55:25,569 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-09 20:55:25,569 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-09 20:55:25,569 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:55:25,569 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-02-09 20:55:25,569 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-02-09 20:55:25,569 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:25,569 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 20:55:25,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:55:25,569 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-09 20:55:25,570 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-09 20:55:25,570 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-09 20:55:25,670 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 20:55:25,671 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 20:55:25,672 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,,1675976119971.fd99e712d029b1479ee16c3a0c467ce5. with WAL disabled. Data may be lost in the event of a crash. 2023-02-09 20:55:25,672 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,1,1675976119971.d3a98fcfad73ec6f98096a0e81049c21. with WAL disabled. Data may be lost in the event of a crash. 2023-02-09 20:55:25,672 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,2,1675976119971.9dee656d29adb7e6b7d42a643b66b07b. with WAL disabled. Data may be lost in the event of a crash. 2023-02-09 20:55:25,674 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(933): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-02-09 20:55:25,676 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-02-09 20:55:25,676 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-02-09 20:55:25,676 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-02-09 20:55:25,676 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:55:25,676 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-02-09 20:55:25,676 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-02-09 20:55:25,676 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-09 20:55:25,676 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-09 20:55:25,678 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:25,678 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:55:25,678 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:55:25,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:55:25,678 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:25,678 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 20:55:25,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-09 20:55:25,678 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-09 20:55:25,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 20:55:25,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-09 20:55:25,679 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-02-09 20:55:25,679 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-02-09 20:55:25,679 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-02-09 20:55:25,679 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-02-09 20:55:25,679 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:55:25,679 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-02-09 20:55:25,679 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1675976119971.d3a98fcfad73ec6f98096a0e81049c21. 2023-02-09 20:55:25,679 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1675976119971.d3a98fcfad73ec6f98096a0e81049c21. started... 2023-02-09 20:55:25,679 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-09 20:55:25,679 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 20:55:25,679 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1675976119971.fd99e712d029b1479ee16c3a0c467ce5. 2023-02-09 20:55:25,679 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing d3a98fcfad73ec6f98096a0e81049c21 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-02-09 20:55:25,679 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1675976119971.9dee656d29adb7e6b7d42a643b66b07b. 2023-02-09 20:55:25,679 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1675976119971.9dee656d29adb7e6b7d42a643b66b07b. started... 2023-02-09 20:55:25,679 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1675976119971.fd99e712d029b1479ee16c3a0c467ce5. started... 2023-02-09 20:55:25,680 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing fd99e712d029b1479ee16c3a0c467ce5 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-02-09 20:55:25,680 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 9dee656d29adb7e6b7d42a643b66b07b 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-02-09 20:55:25,693 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202302090485249c391b4cb2996d41315057beec to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202302090485249c391b4cb2996d41315057beec 2023-02-09 20:55:26,095 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023020911445e993bcf46459549fcf84e73bd80 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023020911445e993bcf46459549fcf84e73bd80 2023-02-09 20:55:26,095 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302093369568549a549bb98dc4decbc478266 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202302093369568549a549bb98dc4decbc478266 2023-02-09 20:55:26,100 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/.tmp/family1/de4c1e2d17594300a65715819c3fd5fd 2023-02-09 20:55:26,501 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/.tmp/family1/05d738ce288648c08cfdbfdd1fac4f25 2023-02-09 20:55:26,501 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/.tmp/family1/a457362d693044eab95c30a529dc1a9d 2023-02-09 20:55:26,512 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230209c2970f41e4844e1eb3e0584ba3c96271 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230209c2970f41e4844e1eb3e0584ba3c96271 2023-02-09 20:55:26,514 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023020950c15f5f67a34a638959ccd2b5aa0fbe to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023020950c15f5f67a34a638959ccd2b5aa0fbe 2023-02-09 20:55:26,915 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230209b8b2bd45ed8d448e9e9a3bd52290cdf0 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230209b8b2bd45ed8d448e9e9a3bd52290cdf0 2023-02-09 20:55:26,917 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/.tmp/family2/89f4f2823dfa4779aee577ace6aee66e 2023-02-09 20:55:26,918 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/.tmp/family2/b03e6d792cd6417b9c3840efaceed27f 2023-02-09 20:55:26,919 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/.tmp/family2/5360d4e617fd4484833e455dcbfc891e 2023-02-09 20:55:26,921 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/.tmp/family1/de4c1e2d17594300a65715819c3fd5fd as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/family1/de4c1e2d17594300a65715819c3fd5fd 2023-02-09 20:55:26,922 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/.tmp/family1/a457362d693044eab95c30a529dc1a9d as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/family1/a457362d693044eab95c30a529dc1a9d 2023-02-09 20:55:26,923 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/.tmp/family1/05d738ce288648c08cfdbfdd1fac4f25 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/family1/05d738ce288648c08cfdbfdd1fac4f25 2023-02-09 20:55:26,925 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/family1/de4c1e2d17594300a65715819c3fd5fd, entries=4, sequenceid=13, filesize=5.4 K 2023-02-09 20:55:26,925 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/.tmp/family2/89f4f2823dfa4779aee577ace6aee66e as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/family2/89f4f2823dfa4779aee577ace6aee66e 2023-02-09 20:55:26,926 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/family1/a457362d693044eab95c30a529dc1a9d, entries=4, sequenceid=13, filesize=5.4 K 2023-02-09 20:55:26,926 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/.tmp/family2/b03e6d792cd6417b9c3840efaceed27f as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/family2/b03e6d792cd6417b9c3840efaceed27f 2023-02-09 20:55:26,927 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/family1/05d738ce288648c08cfdbfdd1fac4f25, entries=4, sequenceid=13, filesize=5.4 K 2023-02-09 20:55:26,928 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/.tmp/family2/5360d4e617fd4484833e455dcbfc891e as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/family2/5360d4e617fd4484833e455dcbfc891e 2023-02-09 20:55:26,930 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/family2/89f4f2823dfa4779aee577ace6aee66e, entries=2, sequenceid=13, filesize=5.1 K 2023-02-09 20:55:26,932 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/family2/b03e6d792cd6417b9c3840efaceed27f, entries=2, sequenceid=13, filesize=5.1 K 2023-02-09 20:55:26,932 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for d3a98fcfad73ec6f98096a0e81049c21 in 1253ms, sequenceid=13, compaction requested=true 2023-02-09 20:55:26,932 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for d3a98fcfad73ec6f98096a0e81049c21: 2023-02-09 20:55:26,932 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1675976119971.d3a98fcfad73ec6f98096a0e81049c21. 2023-02-09 20:55:26,932 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-09 20:55:26,932 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 9dee656d29adb7e6b7d42a643b66b07b in 1252ms, sequenceid=13, compaction requested=true 2023-02-09 20:55:26,932 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 9dee656d29adb7e6b7d42a643b66b07b: 2023-02-09 20:55:26,932 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1675976119971.9dee656d29adb7e6b7d42a643b66b07b. 2023-02-09 20:55:26,932 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-09 20:55:26,933 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/family2/5360d4e617fd4484833e455dcbfc891e, entries=2, sequenceid=13, filesize=5.1 K 2023-02-09 20:55:26,934 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for fd99e712d029b1479ee16c3a0c467ce5 in 1254ms, sequenceid=13, compaction requested=true 2023-02-09 20:55:26,934 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for fd99e712d029b1479ee16c3a0c467ce5: 2023-02-09 20:55:26,934 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1675976119971.fd99e712d029b1479ee16c3a0c467ce5. 2023-02-09 20:55:26,934 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-09 20:55:26,934 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-09 20:55:26,934 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:26,934 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-02-09 20:55:26,934 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-02-09 20:55:26,936 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:26,936 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-09 20:55:26,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:26,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:55:26,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:55:26,937 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-09 20:55:26,937 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 20:55:26,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:55:26,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:55:26,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-09 20:55:26,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:26,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:55:26,938 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-02-09 20:55:26,938 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@50cfafdd[Count = 0] remaining members to acquire global barrier 2023-02-09 20:55:26,938 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-02-09 20:55:26,938 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-09 20:55:26,939 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-09 20:55:26,939 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-09 20:55:26,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-09 20:55:26,939 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-02-09 20:55:26,939 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-02-09 20:55:26,939 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase9.apache.org,40919,1675976022294' in zk 2023-02-09 20:55:26,939 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:26,939 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 20:55:26,943 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:26,943 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-02-09 20:55:26,943 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:55:26,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:26,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:55:26,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:55:26,943 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-02-09 20:55:26,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:55:26,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:55:26,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-09 20:55:26,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:26,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:55:26,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-09 20:55:26,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:26,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase9.apache.org,40919,1675976022294': 2023-02-09 20:55:26,945 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-02-09 20:55:26,945 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-02-09 20:55:26,945 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 20:55:26,945 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 20:55:26,945 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-02-09 20:55:26,945 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 20:55:26,948 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-09 20:55:26,948 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-09 20:55:26,948 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:55:26,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-09 20:55:26,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:55:26,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:55:26,948 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-09 20:55:26,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-09 20:55:26,948 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:26,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:55:26,949 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:55:26,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:55:26,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-09 20:55:26,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-09 20:55:26,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:55:26,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-09 20:55:26,949 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:26,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:26,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:55:26,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-09 20:55:26,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:26,951 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:26,951 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:55:26,951 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-09 20:55:26,951 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:55:26,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:55:26,951 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:55:26,951 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-02-09 20:55:26,951 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 20:55:26,951 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-09 20:55:26,951 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:55:26,951 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-02-09 20:55:26,951 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:55:26,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:55:26,952 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-02-09 20:55:26,951 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:26,952 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 20:55:26,952 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-09 20:55:26,952 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-09 20:55:26,952 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-09 20:55:27,052 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 20:55:27,053 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 20:55:27,054 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,,1675976119971.fd99e712d029b1479ee16c3a0c467ce5. with WAL disabled. Data may be lost in the event of a crash. 2023-02-09 20:55:27,054 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,1,1675976119971.d3a98fcfad73ec6f98096a0e81049c21. with WAL disabled. Data may be lost in the event of a crash. 2023-02-09 20:55:27,054 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,2,1675976119971.9dee656d29adb7e6b7d42a643b66b07b. with WAL disabled. Data may be lost in the event of a crash. 2023-02-09 20:55:27,056 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(933): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-02-09 20:55:27,058 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-02-09 20:55:27,058 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-02-09 20:55:27,058 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-02-09 20:55:27,058 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:55:27,058 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-02-09 20:55:27,058 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-02-09 20:55:27,059 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-09 20:55:27,059 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-09 20:55:27,060 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:55:27,060 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:27,060 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:55:27,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:55:27,060 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:27,060 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 20:55:27,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-09 20:55:27,061 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-09 20:55:27,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 20:55:27,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-09 20:55:27,061 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-02-09 20:55:27,061 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-02-09 20:55:27,061 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-02-09 20:55:27,061 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-02-09 20:55:27,061 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:55:27,061 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-02-09 20:55:27,062 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1675976119971.d3a98fcfad73ec6f98096a0e81049c21. 2023-02-09 20:55:27,062 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1675976119971.d3a98fcfad73ec6f98096a0e81049c21. started... 2023-02-09 20:55:27,062 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing d3a98fcfad73ec6f98096a0e81049c21 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-02-09 20:55:27,066 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1675976119971.9dee656d29adb7e6b7d42a643b66b07b. 2023-02-09 20:55:27,066 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-09 20:55:27,066 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1675976119971.fd99e712d029b1479ee16c3a0c467ce5. 2023-02-09 20:55:27,066 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 20:55:27,066 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1675976119971.9dee656d29adb7e6b7d42a643b66b07b. started... 2023-02-09 20:55:27,066 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1675976119971.fd99e712d029b1479ee16c3a0c467ce5. started... 2023-02-09 20:55:27,066 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 9dee656d29adb7e6b7d42a643b66b07b 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-02-09 20:55:27,066 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing fd99e712d029b1479ee16c3a0c467ce5 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-02-09 20:55:27,099 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023020981663a075738408e88cb9321c351aca7 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023020981663a075738408e88cb9321c351aca7 2023-02-09 20:55:27,100 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202302093d7f1a01613642ecac1593478ee384b2 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202302093d7f1a01613642ecac1593478ee384b2 2023-02-09 20:55:27,498 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230209a129990bcee74ab49e2421e438d1ff4b to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230209a129990bcee74ab49e2421e438d1ff4b 2023-02-09 20:55:27,505 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/.tmp/family1/dfb7e51be254415f904bb5138d569daf 2023-02-09 20:55:27,506 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/.tmp/family1/59e1b573d3c840b3905af50afe4a392c 2023-02-09 20:55:27,903 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/.tmp/family1/30e774cd94d64d94a0e818dada82f5b4 2023-02-09 20:55:27,923 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230209cc36caad0b7c4eeb8a1a646a9c9c9d8e to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230209cc36caad0b7c4eeb8a1a646a9c9c9d8e 2023-02-09 20:55:27,927 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230209a0e6e571016540d5a539c9a74d619e12 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230209a0e6e571016540d5a539c9a74d619e12 2023-02-09 20:55:28,316 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230209a6fb2ff310114eb591e42d851abc9440 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230209a6fb2ff310114eb591e42d851abc9440 2023-02-09 20:55:28,327 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/.tmp/family2/9cb6df9bc6b944f89f1acc6aaa68461d 2023-02-09 20:55:28,330 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/.tmp/family1/dfb7e51be254415f904bb5138d569daf as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/family1/dfb7e51be254415f904bb5138d569daf 2023-02-09 20:55:28,331 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/.tmp/family2/cdbfdba21eb843e69d7a0678505b226e 2023-02-09 20:55:28,334 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/family1/dfb7e51be254415f904bb5138d569daf, entries=4, sequenceid=17, filesize=5.4 K 2023-02-09 20:55:28,335 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/.tmp/family2/9cb6df9bc6b944f89f1acc6aaa68461d as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/family2/9cb6df9bc6b944f89f1acc6aaa68461d 2023-02-09 20:55:28,335 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/.tmp/family1/59e1b573d3c840b3905af50afe4a392c as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/family1/59e1b573d3c840b3905af50afe4a392c 2023-02-09 20:55:28,338 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/family2/9cb6df9bc6b944f89f1acc6aaa68461d, entries=2, sequenceid=17, filesize=5.1 K 2023-02-09 20:55:28,338 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/family1/59e1b573d3c840b3905af50afe4a392c, entries=4, sequenceid=17, filesize=5.4 K 2023-02-09 20:55:28,339 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for d3a98fcfad73ec6f98096a0e81049c21 in 1277ms, sequenceid=17, compaction requested=true 2023-02-09 20:55:28,339 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for d3a98fcfad73ec6f98096a0e81049c21: 2023-02-09 20:55:28,339 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1675976119971.d3a98fcfad73ec6f98096a0e81049c21. 2023-02-09 20:55:28,339 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-09 20:55:28,339 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/.tmp/family2/cdbfdba21eb843e69d7a0678505b226e as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/family2/cdbfdba21eb843e69d7a0678505b226e 2023-02-09 20:55:28,342 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/family2/cdbfdba21eb843e69d7a0678505b226e, entries=2, sequenceid=17, filesize=5.1 K 2023-02-09 20:55:28,343 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for fd99e712d029b1479ee16c3a0c467ce5 in 1277ms, sequenceid=17, compaction requested=true 2023-02-09 20:55:28,343 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for fd99e712d029b1479ee16c3a0c467ce5: 2023-02-09 20:55:28,343 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1675976119971.fd99e712d029b1479ee16c3a0c467ce5. 2023-02-09 20:55:28,343 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-09 20:55:28,721 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/.tmp/family2/5c5f9538d1734402a79d6449d0577cf3 2023-02-09 20:55:28,725 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/.tmp/family1/30e774cd94d64d94a0e818dada82f5b4 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/family1/30e774cd94d64d94a0e818dada82f5b4 2023-02-09 20:55:28,728 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/family1/30e774cd94d64d94a0e818dada82f5b4, entries=4, sequenceid=17, filesize=5.4 K 2023-02-09 20:55:28,729 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/.tmp/family2/5c5f9538d1734402a79d6449d0577cf3 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/family2/5c5f9538d1734402a79d6449d0577cf3 2023-02-09 20:55:28,733 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/family2/5c5f9538d1734402a79d6449d0577cf3, entries=2, sequenceid=17, filesize=5.1 K 2023-02-09 20:55:28,733 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 9dee656d29adb7e6b7d42a643b66b07b in 1667ms, sequenceid=17, compaction requested=true 2023-02-09 20:55:28,733 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 9dee656d29adb7e6b7d42a643b66b07b: 2023-02-09 20:55:28,733 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1675976119971.9dee656d29adb7e6b7d42a643b66b07b. 2023-02-09 20:55:28,734 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-09 20:55:28,734 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-09 20:55:28,734 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:28,734 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-02-09 20:55:28,734 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-02-09 20:55:28,735 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-09 20:55:28,735 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:28,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:28,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:55:28,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:55:28,735 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-09 20:55:28,736 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 20:55:28,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:55:28,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:55:28,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-09 20:55:28,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:28,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:55:28,737 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-02-09 20:55:28,737 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4fa3d156[Count = 0] remaining members to acquire global barrier 2023-02-09 20:55:28,737 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-02-09 20:55:28,737 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-09 20:55:28,744 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-09 20:55:28,744 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-09 20:55:28,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-09 20:55:28,744 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-02-09 20:55:28,744 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-02-09 20:55:28,744 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase9.apache.org,40919,1675976022294' in zk 2023-02-09 20:55:28,744 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:28,744 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 20:55:28,745 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-02-09 20:55:28,745 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:28,745 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:55:28,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:28,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:55:28,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:55:28,745 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-02-09 20:55:28,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:55:28,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:55:28,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-09 20:55:28,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:28,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:55:28,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-09 20:55:28,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:28,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase9.apache.org,40919,1675976022294': 2023-02-09 20:55:28,747 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-02-09 20:55:28,747 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 20:55:28,747 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 20:55:28,747 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-02-09 20:55:28,747 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-02-09 20:55:28,747 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 20:55:28,749 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-09 20:55:28,749 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-09 20:55:28,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-09 20:55:28,749 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-09 20:55:28,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:55:28,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:55:28,749 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:55:28,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-09 20:55:28,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:55:28,749 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:28,749 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:55:28,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:55:28,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-09 20:55:28,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-09 20:55:28,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:55:28,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-09 20:55:28,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:28,750 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:28,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:55:28,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-09 20:55:28,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:28,752 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:28,752 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:55:28,752 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-09 20:55:28,753 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-02-09 20:55:28,753 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 20:55:28,753 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-09 20:55:28,753 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:55:28,753 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:55:28,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:55:28,753 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:55:28,753 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-02-09 20:55:28,753 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:28,753 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 20:55:28,753 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:55:28,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:55:28,753 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-09 20:55:28,753 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-09 20:55:28,753 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-09 20:55:28,853 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 20:55:28,854 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 20:55:28,864 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1580): Client=jenkins//172.31.2.10 snapshot request for:{ ss=snaptb-1675976128854 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-02-09 20:55:28,864 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1675976128864 (current time:1675976128864). 2023-02-09 20:55:28,864 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-09 20:55:28,865 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] zookeeper.ReadOnlyZKClient(139): Connect 0x1ec01330 to 127.0.0.1:62089 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 20:55:28,871 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@25628237, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 20:55:28,875 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 20:55:28,878 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:38938, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 20:55:28,879 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1ec01330 to 127.0.0.1:62089 2023-02-09 20:55:28,879 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 20:55:28,879 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-09 20:55:28,880 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb-1675976128854 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-02-09 20:55:28,888 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure2.ProcedureExecutor(1029): Stored pid=86, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-02-09 20:55:28,888 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=86, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-02-09 20:55:28,889 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=86, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE; timeout=600000, timestamp=1675976728889 2023-02-09 20:55:28,889 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb-1675976128854 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-02-09 20:55:28,889 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb-1675976128854 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink 2023-02-09 20:55:28,890 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=86, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-02-09 20:55:28,891 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1029): Stored pid=87, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-02-09 20:55:28,891 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=86, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE in 3 msec 2023-02-09 20:55:28,892 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=87, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-02-09 20:55:28,892 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=87, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED; timeout=600000, timestamp=1675976728892 2023-02-09 20:55:28,894 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb-1675976128854 table=testCompactionWithHFileLink type=FLUSH ttl=0 }'' to complete. (max 300000 ms per retry) 2023-02-09 20:55:28,894 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-09 20:55:28,994 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-09 20:55:28,996 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=snaptb-1675976128854 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-09 20:55:28,998 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb-1675976128854 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-02-09 20:55:28,998 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-09 20:55:29,198 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-09 20:55:29,199 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=snaptb-1675976128854 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-09 20:55:29,199 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb-1675976128854 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-02-09 20:55:29,199 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-02-09 20:55:29,300 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb-1675976128854 2023-02-09 20:55:29,300 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb-1675976128854' 2023-02-09 20:55:29,300 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-09 20:55:29,300 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb-1675976128854' starting 'acquire' 2023-02-09 20:55:29,300 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb-1675976128854', kicking off acquire phase on members. 2023-02-09 20:55:29,300 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb-1675976128854 2023-02-09 20:55:29,300 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb-1675976128854 2023-02-09 20:55:29,301 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb-1675976128854/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:29,301 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-09 20:55:29,301 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-09 20:55:29,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 20:55:29,302 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb-1675976128854/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:29,302 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 20:55:29,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb-1675976128854 2023-02-09 20:55:29,302 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb-1675976128854 2023-02-09 20:55:29,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 68 2023-02-09 20:55:29,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb-1675976128854 2023-02-09 20:55:29,302 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb-1675976128854 from table testCompactionWithHFileLink type FLUSH 2023-02-09 20:55:29,304 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb-1675976128854 2023-02-09 20:55:29,305 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb-1675976128854' with timeout 300000ms 2023-02-09 20:55:29,305 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-09 20:55:29,305 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb-1675976128854' starting 'acquire' stage 2023-02-09 20:55:29,305 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb-1675976128854' locally acquired 2023-02-09 20:55:29,305 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure (snaptb-1675976128854) in zk 2023-02-09 20:55:29,306 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb-1675976128854 2023-02-09 20:55:29,306 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1675976128854/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:29,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb-1675976128854/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:29,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:55:29,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-09 20:55:29,306 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb-1675976128854 2023-02-09 20:55:29,306 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb-1675976128854' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 20:55:29,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:55:29,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:55:29,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1675976128854 2023-02-09 20:55:29,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:29,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:55:29,307 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure 'snaptb-1675976128854' on coordinator 2023-02-09 20:55:29,307 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5107fa45[Count = 0] remaining members to acquire global barrier 2023-02-09 20:55:29,307 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb-1675976128854' starting 'in-barrier' execution. 2023-02-09 20:55:29,307 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb-1675976128854 2023-02-09 20:55:29,312 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1675976128854 2023-02-09 20:55:29,312 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb-1675976128854 2023-02-09 20:55:29,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb-1675976128854 2023-02-09 20:55:29,312 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb-1675976128854' received 'reached' from coordinator. 2023-02-09 20:55:29,312 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb-1675976128854/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:29,312 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 20:55:29,313 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,1,1675976119971.d3a98fcfad73ec6f98096a0e81049c21. 2023-02-09 20:55:29,313 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,2,1675976119971.9dee656d29adb7e6b7d42a643b66b07b. 2023-02-09 20:55:29,313 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 3 regions 2023-02-09 20:55:29,313 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,,1675976119971.fd99e712d029b1479ee16c3a0c467ce5. 2023-02-09 20:55:29,313 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-09 20:55:29,313 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,2,1675976119971.9dee656d29adb7e6b7d42a643b66b07b. started... 2023-02-09 20:55:29,313 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,1,1675976119971.d3a98fcfad73ec6f98096a0e81049c21. started... 2023-02-09 20:55:29,313 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,,1675976119971.fd99e712d029b1479ee16c3a0c467ce5. started... 2023-02-09 20:55:29,313 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 9dee656d29adb7e6b7d42a643b66b07b: 2023-02-09 20:55:29,313 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for d3a98fcfad73ec6f98096a0e81049c21: 2023-02-09 20:55:29,313 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for fd99e712d029b1479ee16c3a0c467ce5: 2023-02-09 20:55:29,314 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,2,1675976119971.9dee656d29adb7e6b7d42a643b66b07b.' region-info for snapshot=snaptb-1675976128854 2023-02-09 20:55:29,314 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,1,1675976119971.d3a98fcfad73ec6f98096a0e81049c21.' region-info for snapshot=snaptb-1675976128854 2023-02-09 20:55:29,314 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,,1675976119971.fd99e712d029b1479ee16c3a0c467ce5.' region-info for snapshot=snaptb-1675976128854 2023-02-09 20:55:29,319 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-09 20:55:29,319 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-09 20:55:29,319 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-09 20:55:29,323 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/family1/8dffd447500b40ddbcd436ec073020e4, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/family1/19be0e30a8ed4401bdaaaf7a7dd9875a, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/family1/a457362d693044eab95c30a529dc1a9d, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/family1/30e774cd94d64d94a0e818dada82f5b4] hfiles 2023-02-09 20:55:29,323 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/family1/7adfdbfb53834874af61c06653ea05d9, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/family1/8a4fd3c0e795466fb8bcb12d2e892fa5, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/family1/05d738ce288648c08cfdbfdd1fac4f25, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/family1/59e1b573d3c840b3905af50afe4a392c] hfiles 2023-02-09 20:55:29,323 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/family1/8dffd447500b40ddbcd436ec073020e4 for snapshot=snaptb-1675976128854 2023-02-09 20:55:29,323 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/family1/cecce63cee614c1d85268b380746fc1f, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/family1/80d6aeca24eb4e5aaa2d1e2e3735b803, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/family1/de4c1e2d17594300a65715819c3fd5fd, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/family1/dfb7e51be254415f904bb5138d569daf] hfiles 2023-02-09 20:55:29,323 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/family1/7adfdbfb53834874af61c06653ea05d9 for snapshot=snaptb-1675976128854 2023-02-09 20:55:29,323 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/family1/cecce63cee614c1d85268b380746fc1f for snapshot=snaptb-1675976128854 2023-02-09 20:55:29,473 INFO [regionserver/jenkins-hbase9:0.Chore.1] hbase.ScheduledChore(142): Chore: CompactedHFilesCleaner missed its start time 2023-02-09 20:55:29,473 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-09 20:55:29,473 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x33ce62d8 to 127.0.0.1:62089 2023-02-09 20:55:29,473 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 20:55:29,475 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/family1/8a4fd3c0e795466fb8bcb12d2e892fa5 for snapshot=snaptb-1675976128854 2023-02-09 20:55:29,475 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/family1/80d6aeca24eb4e5aaa2d1e2e3735b803 for snapshot=snaptb-1675976128854 2023-02-09 20:55:29,475 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/family1/05d738ce288648c08cfdbfdd1fac4f25 for snapshot=snaptb-1675976128854 2023-02-09 20:55:29,475 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/family1/19be0e30a8ed4401bdaaaf7a7dd9875a for snapshot=snaptb-1675976128854 2023-02-09 20:55:29,475 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/family1/59e1b573d3c840b3905af50afe4a392c for snapshot=snaptb-1675976128854 2023-02-09 20:55:29,475 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/family1/de4c1e2d17594300a65715819c3fd5fd for snapshot=snaptb-1675976128854 2023-02-09 20:55:29,475 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/family1/a457362d693044eab95c30a529dc1a9d for snapshot=snaptb-1675976128854 2023-02-09 20:55:29,475 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/family2/b033bc8de43c48fe813afee249071e04, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/family2/2965303a0eec417f93790a17caf709de, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/family2/5360d4e617fd4484833e455dcbfc891e, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/family2/cdbfdba21eb843e69d7a0678505b226e] hfiles 2023-02-09 20:55:29,475 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/family2/b033bc8de43c48fe813afee249071e04 for snapshot=snaptb-1675976128854 2023-02-09 20:55:29,475 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/family1/30e774cd94d64d94a0e818dada82f5b4 for snapshot=snaptb-1675976128854 2023-02-09 20:55:29,475 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/family1/dfb7e51be254415f904bb5138d569daf for snapshot=snaptb-1675976128854 2023-02-09 20:55:29,475 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/family2/39383c1ed4b64edca22dee4cc20a06cd, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/family2/65d11bd220904c5ebb12875f70b36894, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/family2/b03e6d792cd6417b9c3840efaceed27f, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/family2/5c5f9538d1734402a79d6449d0577cf3] hfiles 2023-02-09 20:55:29,475 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/family2/f62e3e2786aa4157a19aba13c6283944, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/family2/634ca6469094417da516e2df95ebc29a, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/family2/89f4f2823dfa4779aee577ace6aee66e, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/family2/9cb6df9bc6b944f89f1acc6aaa68461d] hfiles 2023-02-09 20:55:29,475 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/family2/f62e3e2786aa4157a19aba13c6283944 for snapshot=snaptb-1675976128854 2023-02-09 20:55:29,475 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/family2/39383c1ed4b64edca22dee4cc20a06cd for snapshot=snaptb-1675976128854 2023-02-09 20:55:29,475 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/family2/2965303a0eec417f93790a17caf709de for snapshot=snaptb-1675976128854 2023-02-09 20:55:29,475 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/family2/65d11bd220904c5ebb12875f70b36894 for snapshot=snaptb-1675976128854 2023-02-09 20:55:29,475 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/family2/634ca6469094417da516e2df95ebc29a for snapshot=snaptb-1675976128854 2023-02-09 20:55:29,476 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/family2/89f4f2823dfa4779aee577ace6aee66e for snapshot=snaptb-1675976128854 2023-02-09 20:55:29,476 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/family2/9cb6df9bc6b944f89f1acc6aaa68461d for snapshot=snaptb-1675976128854 2023-02-09 20:55:29,476 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/family2/b03e6d792cd6417b9c3840efaceed27f for snapshot=snaptb-1675976128854 2023-02-09 20:55:29,476 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/family2/5c5f9538d1734402a79d6449d0577cf3 for snapshot=snaptb-1675976128854 2023-02-09 20:55:29,476 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/family2/5360d4e617fd4484833e455dcbfc891e for snapshot=snaptb-1675976128854 2023-02-09 20:55:29,476 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/family2/cdbfdba21eb843e69d7a0678505b226e for snapshot=snaptb-1675976128854 2023-02-09 20:55:29,484 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,,1675976119971.fd99e712d029b1479ee16c3a0c467ce5. completed. 2023-02-09 20:55:29,484 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,,1675976119971.fd99e712d029b1479ee16c3a0c467ce5. 2023-02-09 20:55:29,485 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/3 local region snapshots. 2023-02-09 20:55:29,499 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-09 20:55:29,500 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=snaptb-1675976128854 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-09 20:55:29,500 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb-1675976128854 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-02-09 20:55:29,500 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-02-09 20:55:29,883 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,1,1675976119971.d3a98fcfad73ec6f98096a0e81049c21. completed. 2023-02-09 20:55:29,883 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,1,1675976119971.d3a98fcfad73ec6f98096a0e81049c21. 2023-02-09 20:55:29,883 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,2,1675976119971.9dee656d29adb7e6b7d42a643b66b07b. completed. 2023-02-09 20:55:29,883 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/3 local region snapshots. 2023-02-09 20:55:29,883 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,2,1675976119971.9dee656d29adb7e6b7d42a643b66b07b. 2023-02-09 20:55:29,883 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/3 local region snapshots. 2023-02-09 20:55:29,883 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 3 local region snapshots. 2023-02-09 20:55:29,883 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:29,883 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb-1675976128854' locally completed 2023-02-09 20:55:29,883 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb-1675976128854' completed for member 'jenkins-hbase9.apache.org,40919,1675976022294' in zk 2023-02-09 20:55:29,885 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb-1675976128854' has notified controller of completion 2023-02-09 20:55:29,885 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:55:29,885 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1675976128854/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:29,885 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb-1675976128854' completed. 2023-02-09 20:55:29,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb-1675976128854/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:29,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:55:29,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-09 20:55:29,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:55:29,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:55:29,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1675976128854 2023-02-09 20:55:29,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:29,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:55:29,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1675976128854 2023-02-09 20:55:29,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:29,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb-1675976128854' member 'jenkins-hbase9.apache.org,40919,1675976022294': 2023-02-09 20:55:29,887 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' released barrier for procedure'snaptb-1675976128854', counting down latch. Waiting for 0 more 2023-02-09 20:55:29,887 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb-1675976128854' execution completed 2023-02-09 20:55:29,887 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 20:55:29,887 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 20:55:29,887 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb-1675976128854 2023-02-09 20:55:29,888 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb-1675976128854including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-09 20:55:29,889 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1675976128854 2023-02-09 20:55:29,889 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1675976128854 2023-02-09 20:55:29,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb-1675976128854 2023-02-09 20:55:29,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:55:29,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-09 20:55:29,889 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb-1675976128854 2023-02-09 20:55:29,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb-1675976128854 2023-02-09 20:55:29,889 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-09 20:55:29,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:55:29,889 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-09 20:55:29,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 20:55:29,890 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb-1675976128854/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:29,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1675976128854 2023-02-09 20:55:29,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb-1675976128854 2023-02-09 20:55:29,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:55:29,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1675976128854 2023-02-09 20:55:29,890 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb-1675976128854/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:29,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:29,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:55:29,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1675976128854 2023-02-09 20:55:29,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:29,894 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1675976128854/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:29,894 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-09 20:55:29,894 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1675976128854 2023-02-09 20:55:29,894 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-09 20:55:29,894 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1675976128854 2023-02-09 20:55:29,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-09 20:55:29,894 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:55:29,894 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1675976128854/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:29,894 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-09 20:55:29,894 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1675976128854 2023-02-09 20:55:29,894 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb-1675976128854 2023-02-09 20:55:29,894 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1675976128854 2023-02-09 20:55:29,894 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-09 20:55:29,894 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testCompactionWithHFileLink 2023-02-09 20:55:29,894 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1675976128854 2023-02-09 20:55:29,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-09 20:55:29,894 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 0e7b6fa9e81bd62588edd7d77d6165e4, NAME => 'testCompactionWithHFileLink,.mob,0.0e7b6fa9e81bd62588edd7d77d6165e4.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb-1675976128854 2023-02-09 20:55:29,894 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-02-09 20:55:29,896 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202302090485249c391b4cb2996d41315057beec, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023020946d52341946546bfa2faa21026abbf30, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202302094cd195d47b5e4378b7b7e975c1569dbb, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023020981663a075738408e88cb9321c351aca7, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230209314a0b9217254e10b80045e601857690, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202302093369568549a549bb98dc4decbc478266, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230209a129990bcee74ab49e2421e438d1ff4b, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230209b1e9cbc26733498fb7dc0ad8994edf15, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023020911445e993bcf46459549fcf84e73bd80, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202302093d7f1a01613642ecac1593478ee384b2, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230209499d07c47b844887884c2cbec5562885, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230209da15212355094b199ba61e702d11757b] mob files 2023-02-09 20:55:29,896 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/12): hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202302090485249c391b4cb2996d41315057beec 2023-02-09 20:55:29,896 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/12): hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023020946d52341946546bfa2faa21026abbf30 2023-02-09 20:55:29,896 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (3/12): hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202302094cd195d47b5e4378b7b7e975c1569dbb 2023-02-09 20:55:29,896 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (4/12): hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023020981663a075738408e88cb9321c351aca7 2023-02-09 20:55:29,896 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (5/12): hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230209314a0b9217254e10b80045e601857690 2023-02-09 20:55:29,896 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (6/12): hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202302093369568549a549bb98dc4decbc478266 2023-02-09 20:55:29,896 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (7/12): hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230209a129990bcee74ab49e2421e438d1ff4b 2023-02-09 20:55:29,896 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (8/12): hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230209b1e9cbc26733498fb7dc0ad8994edf15 2023-02-09 20:55:29,896 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (9/12): hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023020911445e993bcf46459549fcf84e73bd80 2023-02-09 20:55:29,896 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (10/12): hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202302093d7f1a01613642ecac1593478ee384b2 2023-02-09 20:55:29,896 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (11/12): hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230209499d07c47b844887884c2cbec5562885 2023-02-09 20:55:29,896 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (12/12): hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230209da15212355094b199ba61e702d11757b 2023-02-09 20:55:29,897 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202302094002e9379daf4e94a0a0646dd285ab6b, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202302096fe89508efe4423f8eaad35ebfde57f0, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230209c2970f41e4844e1eb3e0584ba3c96271, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230209cc36caad0b7c4eeb8a1a646a9c9c9d8e, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230209112df9ed6589400f8e173b856e29ffc1, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202302094c5a8e2c1dfe4a2e97768804a154fa62, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023020950c15f5f67a34a638959ccd2b5aa0fbe, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230209a6fb2ff310114eb591e42d851abc9440, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202302095c5742f64ebb4297918a10abaf0e7d74, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230209a0e6e571016540d5a539c9a74d619e12, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230209b8b2bd45ed8d448e9e9a3bd52290cdf0, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230209baf731513ce1476690ee156f250822ff] mob files 2023-02-09 20:55:29,897 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/12): hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202302094002e9379daf4e94a0a0646dd285ab6b 2023-02-09 20:55:29,897 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/12): hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202302096fe89508efe4423f8eaad35ebfde57f0 2023-02-09 20:55:29,897 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (3/12): hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230209c2970f41e4844e1eb3e0584ba3c96271 2023-02-09 20:55:29,897 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (4/12): hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230209cc36caad0b7c4eeb8a1a646a9c9c9d8e 2023-02-09 20:55:29,897 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (5/12): hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230209112df9ed6589400f8e173b856e29ffc1 2023-02-09 20:55:29,897 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (6/12): hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202302094c5a8e2c1dfe4a2e97768804a154fa62 2023-02-09 20:55:29,897 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (7/12): hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023020950c15f5f67a34a638959ccd2b5aa0fbe 2023-02-09 20:55:29,898 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (8/12): hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230209a6fb2ff310114eb591e42d851abc9440 2023-02-09 20:55:29,898 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (9/12): hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202302095c5742f64ebb4297918a10abaf0e7d74 2023-02-09 20:55:29,898 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (10/12): hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230209a0e6e571016540d5a539c9a74d619e12 2023-02-09 20:55:29,898 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (11/12): hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230209b8b2bd45ed8d448e9e9a3bd52290cdf0 2023-02-09 20:55:29,898 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (12/12): hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230209baf731513ce1476690ee156f250822ff 2023-02-09 20:55:30,001 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-09 20:55:30,001 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=snaptb-1675976128854 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-09 20:55:30,001 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb-1675976128854 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-02-09 20:55:30,002 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-02-09 20:55:30,302 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb-1675976128854 2023-02-09 20:55:30,304 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/.hbase-snapshot/.tmp/snaptb-1675976128854 2023-02-09 20:55:30,755 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/.hbase-snapshot/.tmp/snaptb-1675976128854 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/.hbase-snapshot/snaptb-1675976128854 2023-02-09 20:55:31,002 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-09 20:55:31,003 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=snaptb-1675976128854 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-09 20:55:31,003 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb-1675976128854 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-02-09 20:55:31,003 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2428): (#6) Sleeping: 2000ms while waiting for snapshot completion. 2023-02-09 20:55:31,171 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb-1675976128854 of table testCompactionWithHFileLink completed 2023-02-09 20:55:31,172 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/.hbase-snapshot/.tmp/snaptb-1675976128854 2023-02-09 20:55:31,172 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/.hbase-snapshot/.tmp/snaptb-1675976128854 2023-02-09 20:55:31,172 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb-1675976128854 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink at 1675976128889Completed referencing HFiles for the mob region of table: testCompactionWithHFileLink at 1675976130302 (+1413 ms)Consolidate snapshot: snaptb-1675976128854 at 1675976130302Loading Region manifests for snaptb-1675976128854 at 1675976130303 (+1 ms)Writing data manifest for snaptb-1675976128854 at 1675976130315 (+12 ms)Verifying snapshot: snaptb-1675976128854 at 1675976130723 (+408 ms)Snapshot snaptb-1675976128854 of table testCompactionWithHFileLink completed at 1675976131171 (+448 ms) 2023-02-09 20:55:31,173 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=87, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-02-09 20:55:31,175 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=87, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED in 2.2820 sec 2023-02-09 20:55:33,003 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-09 20:55:33,004 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=snaptb-1675976128854 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-09 20:55:33,004 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb-1675976128854 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-09 20:55:33,034 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(933): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-02-09 20:55:33,036 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-02-09 20:55:33,036 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-02-09 20:55:33,036 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-02-09 20:55:33,036 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:55:33,036 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-02-09 20:55:33,036 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-02-09 20:55:33,037 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-09 20:55:33,037 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-09 20:55:33,038 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:55:33,038 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:33,038 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:55:33,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:55:33,038 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:33,038 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 20:55:33,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-09 20:55:33,039 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-09 20:55:33,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 20:55:33,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-09 20:55:33,039 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-02-09 20:55:33,039 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-02-09 20:55:33,039 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-02-09 20:55:33,039 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:55:33,039 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-02-09 20:55:33,039 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1675976119971.d3a98fcfad73ec6f98096a0e81049c21. 2023-02-09 20:55:33,040 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1675976119971.d3a98fcfad73ec6f98096a0e81049c21. started... 2023-02-09 20:55:33,040 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing d3a98fcfad73ec6f98096a0e81049c21 2/2 column families, dataSize=138 B heapSize=944 B 2023-02-09 20:55:33,040 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-09 20:55:33,040 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1675976119971.9dee656d29adb7e6b7d42a643b66b07b. 2023-02-09 20:55:33,040 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1675976119971.fd99e712d029b1479ee16c3a0c467ce5. 2023-02-09 20:55:33,040 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1675976119971.9dee656d29adb7e6b7d42a643b66b07b. started... 2023-02-09 20:55:33,040 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1675976119971.fd99e712d029b1479ee16c3a0c467ce5. started... 2023-02-09 20:55:33,040 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 20:55:33,040 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing fd99e712d029b1479ee16c3a0c467ce5 2/2 column families, dataSize=138 B heapSize=944 B 2023-02-09 20:55:33,040 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 9dee656d29adb7e6b7d42a643b66b07b 2/2 column families, dataSize=138 B heapSize=944 B 2023-02-09 20:55:33,457 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/.tmp/family1/c1a96fd1fe0744198e2c6c0ca8ef3b39 2023-02-09 20:55:33,461 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c1a96fd1fe0744198e2c6c0ca8ef3b39 2023-02-09 20:55:33,853 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/.tmp/family1/9e179eb1068f4b2188a76e558a93653a 2023-02-09 20:55:33,856 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9e179eb1068f4b2188a76e558a93653a 2023-02-09 20:55:33,858 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/.tmp/family1/50538a68a3a945eca0bb8f9054ad2758 2023-02-09 20:55:33,861 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 50538a68a3a945eca0bb8f9054ad2758 2023-02-09 20:55:34,270 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/.tmp/family2/f3f705904d1a4564a2d4c6d87fa219e9 2023-02-09 20:55:34,274 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f3f705904d1a4564a2d4c6d87fa219e9 2023-02-09 20:55:34,275 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/.tmp/family1/c1a96fd1fe0744198e2c6c0ca8ef3b39 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/family1/c1a96fd1fe0744198e2c6c0ca8ef3b39 2023-02-09 20:55:34,278 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c1a96fd1fe0744198e2c6c0ca8ef3b39 2023-02-09 20:55:34,279 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/family1/c1a96fd1fe0744198e2c6c0ca8ef3b39, entries=3, sequenceid=24, filesize=5.0 K 2023-02-09 20:55:34,279 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/.tmp/family2/f3f705904d1a4564a2d4c6d87fa219e9 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/family2/f3f705904d1a4564a2d4c6d87fa219e9 2023-02-09 20:55:34,283 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f3f705904d1a4564a2d4c6d87fa219e9 2023-02-09 20:55:34,283 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/family2/f3f705904d1a4564a2d4c6d87fa219e9, entries=1, sequenceid=24, filesize=5.0 K 2023-02-09 20:55:34,284 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 9dee656d29adb7e6b7d42a643b66b07b in 1244ms, sequenceid=24, compaction requested=true 2023-02-09 20:55:34,284 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 9dee656d29adb7e6b7d42a643b66b07b: 2023-02-09 20:55:34,284 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1675976119971.9dee656d29adb7e6b7d42a643b66b07b. 2023-02-09 20:55:34,284 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-09 20:55:34,668 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/.tmp/family2/d98b1057578e4ddea66ccf0eb8927334 2023-02-09 20:55:34,672 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d98b1057578e4ddea66ccf0eb8927334 2023-02-09 20:55:34,672 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/.tmp/family2/d466b94e18944d80aed5566071298fe1 2023-02-09 20:55:34,673 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/.tmp/family1/9e179eb1068f4b2188a76e558a93653a as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/family1/9e179eb1068f4b2188a76e558a93653a 2023-02-09 20:55:34,675 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d466b94e18944d80aed5566071298fe1 2023-02-09 20:55:34,676 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9e179eb1068f4b2188a76e558a93653a 2023-02-09 20:55:34,676 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/family1/9e179eb1068f4b2188a76e558a93653a, entries=3, sequenceid=24, filesize=5.0 K 2023-02-09 20:55:34,676 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/.tmp/family1/50538a68a3a945eca0bb8f9054ad2758 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/family1/50538a68a3a945eca0bb8f9054ad2758 2023-02-09 20:55:34,677 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/.tmp/family2/d98b1057578e4ddea66ccf0eb8927334 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/family2/d98b1057578e4ddea66ccf0eb8927334 2023-02-09 20:55:34,679 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 50538a68a3a945eca0bb8f9054ad2758 2023-02-09 20:55:34,680 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/family1/50538a68a3a945eca0bb8f9054ad2758, entries=3, sequenceid=24, filesize=5.0 K 2023-02-09 20:55:34,680 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d98b1057578e4ddea66ccf0eb8927334 2023-02-09 20:55:34,680 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/family2/d98b1057578e4ddea66ccf0eb8927334, entries=1, sequenceid=24, filesize=5.0 K 2023-02-09 20:55:34,680 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/.tmp/family2/d466b94e18944d80aed5566071298fe1 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/family2/d466b94e18944d80aed5566071298fe1 2023-02-09 20:55:34,680 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for d3a98fcfad73ec6f98096a0e81049c21 in 1640ms, sequenceid=24, compaction requested=true 2023-02-09 20:55:34,681 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for d3a98fcfad73ec6f98096a0e81049c21: 2023-02-09 20:55:34,681 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1675976119971.d3a98fcfad73ec6f98096a0e81049c21. 2023-02-09 20:55:34,681 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-09 20:55:34,683 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d466b94e18944d80aed5566071298fe1 2023-02-09 20:55:34,683 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/family2/d466b94e18944d80aed5566071298fe1, entries=1, sequenceid=24, filesize=5.0 K 2023-02-09 20:55:34,684 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for fd99e712d029b1479ee16c3a0c467ce5 in 1644ms, sequenceid=24, compaction requested=true 2023-02-09 20:55:34,684 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for fd99e712d029b1479ee16c3a0c467ce5: 2023-02-09 20:55:34,684 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1675976119971.fd99e712d029b1479ee16c3a0c467ce5. 2023-02-09 20:55:34,684 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-09 20:55:34,684 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-09 20:55:34,684 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:34,684 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-02-09 20:55:34,684 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-02-09 20:55:34,686 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:34,686 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-09 20:55:34,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:34,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:55:34,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:55:34,686 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-09 20:55:34,686 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 20:55:34,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:55:34,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:55:34,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-09 20:55:34,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:34,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:55:34,687 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-02-09 20:55:34,687 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-02-09 20:55:34,687 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7beb6f98[Count = 0] remaining members to acquire global barrier 2023-02-09 20:55:34,687 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-09 20:55:34,693 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-09 20:55:34,693 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-09 20:55:34,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-09 20:55:34,693 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-02-09 20:55:34,693 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-02-09 20:55:34,693 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:34,693 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 20:55:34,693 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase9.apache.org,40919,1675976022294' in zk 2023-02-09 20:55:34,694 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-02-09 20:55:34,694 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:34,694 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:55:34,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:34,694 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-02-09 20:55:34,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:55:34,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:55:34,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:55:34,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:55:34,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-09 20:55:34,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:34,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:55:34,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-09 20:55:34,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:34,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase9.apache.org,40919,1675976022294': 2023-02-09 20:55:34,696 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-02-09 20:55:34,696 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-02-09 20:55:34,696 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 20:55:34,696 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 20:55:34,696 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-02-09 20:55:34,696 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 20:55:34,698 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-09 20:55:34,698 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-09 20:55:34,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-09 20:55:34,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:55:34,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:55:34,698 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-09 20:55:34,698 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:55:34,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-09 20:55:34,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:55:34,698 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:34,698 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:55:34,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:55:34,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-09 20:55:34,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-09 20:55:34,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:55:34,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-09 20:55:34,699 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:34,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:34,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:55:34,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-09 20:55:34,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:34,701 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:34,701 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:55:34,701 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-09 20:55:34,701 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:55:34,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:55:34,701 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-09 20:55:34,701 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-02-09 20:55:34,701 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 20:55:34,701 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:55:34,701 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:55:34,701 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:34,701 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-02-09 20:55:34,702 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-09 20:55:34,702 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:55:34,702 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-02-09 20:55:34,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:55:34,702 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-09 20:55:34,702 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 20:55:34,702 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-09 20:55:34,802 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 20:55:34,803 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 20:55:34,803 DEBUG [Listener at localhost/46855] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-09 20:55:34,804 DEBUG [Listener at localhost/46855] regionserver.HStore(1912): d3a98fcfad73ec6f98096a0e81049c21/family1 is initiating major compaction (all files) 2023-02-09 20:55:34,804 INFO [Listener at localhost/46855] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-09 20:55:34,804 INFO [Listener at localhost/46855] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 20:55:34,804 INFO [Listener at localhost/46855] regionserver.HRegion(2258): Starting compaction of d3a98fcfad73ec6f98096a0e81049c21/family1 in testCompactionWithHFileLink,1,1675976119971.d3a98fcfad73ec6f98096a0e81049c21. 2023-02-09 20:55:34,804 INFO [Listener at localhost/46855] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/family1/cecce63cee614c1d85268b380746fc1f, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/family1/80d6aeca24eb4e5aaa2d1e2e3735b803, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/family1/de4c1e2d17594300a65715819c3fd5fd, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/family1/dfb7e51be254415f904bb5138d569daf, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/family1/9e179eb1068f4b2188a76e558a93653a] into tmpdir=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/.tmp, totalSize=26.7 K 2023-02-09 20:55:34,805 DEBUG [Listener at localhost/46855] compactions.Compactor(207): Compacting cecce63cee614c1d85268b380746fc1f, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1675976122086 2023-02-09 20:55:34,805 DEBUG [Listener at localhost/46855] compactions.Compactor(207): Compacting 80d6aeca24eb4e5aaa2d1e2e3735b803, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1675976123882 2023-02-09 20:55:34,805 DEBUG [Listener at localhost/46855] compactions.Compactor(207): Compacting de4c1e2d17594300a65715819c3fd5fd, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1675976125672 2023-02-09 20:55:34,806 DEBUG [Listener at localhost/46855] compactions.Compactor(207): Compacting dfb7e51be254415f904bb5138d569daf, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1675976127054 2023-02-09 20:55:34,806 DEBUG [Listener at localhost/46855] compactions.Compactor(207): Compacting 9e179eb1068f4b2188a76e558a93653a, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-02-09 20:55:34,818 INFO [Listener at localhost/46855] throttle.PressureAwareThroughputController(145): d3a98fcfad73ec6f98096a0e81049c21#family1#compaction#107 average throughput is 0.57 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-09 20:55:35,226 INFO [Listener at localhost/46855] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b2023020905bf600e94fe488081b311cfd5f585a0_del 2023-02-09 20:55:35,226 INFO [Listener at localhost/46855] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023020905bf600e94fe488081b311cfd5f585a0_del to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023020905bf600e94fe488081b311cfd5f585a0_del 2023-02-09 20:55:36,038 INFO [Listener at localhost/46855] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for eb3c647f585e48769122ed0073f93e85 2023-02-09 20:55:36,039 DEBUG [Listener at localhost/46855] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/.tmp/family1/eb3c647f585e48769122ed0073f93e85 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/family1/eb3c647f585e48769122ed0073f93e85 2023-02-09 20:55:36,042 INFO [Listener at localhost/46855] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for eb3c647f585e48769122ed0073f93e85 2023-02-09 20:55:36,043 INFO [Listener at localhost/46855] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in d3a98fcfad73ec6f98096a0e81049c21/family1 of d3a98fcfad73ec6f98096a0e81049c21 into eb3c647f585e48769122ed0073f93e85(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-09 20:55:36,043 DEBUG [Listener at localhost/46855] regionserver.HRegion(2288): Compaction status journal for d3a98fcfad73ec6f98096a0e81049c21: 2023-02-09 20:55:36,043 DEBUG [Listener at localhost/46855] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-09 20:55:36,043 DEBUG [Listener at localhost/46855] regionserver.HStore(1912): d3a98fcfad73ec6f98096a0e81049c21/family2 is initiating major compaction (all files) 2023-02-09 20:55:36,044 INFO [Listener at localhost/46855] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-09 20:55:36,044 INFO [Listener at localhost/46855] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 20:55:36,044 INFO [Listener at localhost/46855] regionserver.HRegion(2258): Starting compaction of d3a98fcfad73ec6f98096a0e81049c21/family2 in testCompactionWithHFileLink,1,1675976119971.d3a98fcfad73ec6f98096a0e81049c21. 2023-02-09 20:55:36,045 INFO [Listener at localhost/46855] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/family2/f62e3e2786aa4157a19aba13c6283944, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/family2/634ca6469094417da516e2df95ebc29a, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/family2/89f4f2823dfa4779aee577ace6aee66e, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/family2/9cb6df9bc6b944f89f1acc6aaa68461d, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/family2/d98b1057578e4ddea66ccf0eb8927334] into tmpdir=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/.tmp, totalSize=25.4 K 2023-02-09 20:55:36,045 DEBUG [Listener at localhost/46855] compactions.Compactor(207): Compacting f62e3e2786aa4157a19aba13c6283944, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1675976122086 2023-02-09 20:55:36,045 DEBUG [Listener at localhost/46855] compactions.Compactor(207): Compacting 634ca6469094417da516e2df95ebc29a, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1675976123882 2023-02-09 20:55:36,045 DEBUG [Listener at localhost/46855] compactions.Compactor(207): Compacting 89f4f2823dfa4779aee577ace6aee66e, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1675976125672 2023-02-09 20:55:36,046 DEBUG [Listener at localhost/46855] compactions.Compactor(207): Compacting 9cb6df9bc6b944f89f1acc6aaa68461d, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1675976127054 2023-02-09 20:55:36,046 DEBUG [Listener at localhost/46855] compactions.Compactor(207): Compacting d98b1057578e4ddea66ccf0eb8927334, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-02-09 20:55:36,057 INFO [Listener at localhost/46855] throttle.PressureAwareThroughputController(145): d3a98fcfad73ec6f98096a0e81049c21#family2#compaction#108 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-09 20:55:36,078 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/family1/cecce63cee614c1d85268b380746fc1f, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/family1/80d6aeca24eb4e5aaa2d1e2e3735b803, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/family1/de4c1e2d17594300a65715819c3fd5fd, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/family1/dfb7e51be254415f904bb5138d569daf, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/family1/9e179eb1068f4b2188a76e558a93653a] to archive 2023-02-09 20:55:36,079 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 20:55:36,080 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/family1/cecce63cee614c1d85268b380746fc1f to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/family1/cecce63cee614c1d85268b380746fc1f 2023-02-09 20:55:36,081 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/family1/80d6aeca24eb4e5aaa2d1e2e3735b803 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/family1/80d6aeca24eb4e5aaa2d1e2e3735b803 2023-02-09 20:55:36,082 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/family1/de4c1e2d17594300a65715819c3fd5fd to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/family1/de4c1e2d17594300a65715819c3fd5fd 2023-02-09 20:55:36,083 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/family1/dfb7e51be254415f904bb5138d569daf to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/family1/dfb7e51be254415f904bb5138d569daf 2023-02-09 20:55:36,084 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/family1/9e179eb1068f4b2188a76e558a93653a to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/family1/9e179eb1068f4b2188a76e558a93653a 2023-02-09 20:55:36,465 INFO [Listener at localhost/46855] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b202302096811b8606a594674b41bdfc20708f28c_del 2023-02-09 20:55:36,466 INFO [Listener at localhost/46855] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202302096811b8606a594674b41bdfc20708f28c_del to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202302096811b8606a594674b41bdfc20708f28c_del 2023-02-09 20:55:37,278 INFO [Listener at localhost/46855] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 449b624e34d3470baf3175b86d09ded4 2023-02-09 20:55:37,279 DEBUG [Listener at localhost/46855] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/.tmp/family2/449b624e34d3470baf3175b86d09ded4 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/family2/449b624e34d3470baf3175b86d09ded4 2023-02-09 20:55:37,282 INFO [Listener at localhost/46855] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 449b624e34d3470baf3175b86d09ded4 2023-02-09 20:55:37,283 INFO [Listener at localhost/46855] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in d3a98fcfad73ec6f98096a0e81049c21/family2 of d3a98fcfad73ec6f98096a0e81049c21 into 449b624e34d3470baf3175b86d09ded4(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-09 20:55:37,283 DEBUG [Listener at localhost/46855] regionserver.HRegion(2288): Compaction status journal for d3a98fcfad73ec6f98096a0e81049c21: 2023-02-09 20:55:37,283 DEBUG [Listener at localhost/46855] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-09 20:55:37,284 DEBUG [Listener at localhost/46855] regionserver.HStore(1912): 9dee656d29adb7e6b7d42a643b66b07b/family1 is initiating major compaction (all files) 2023-02-09 20:55:37,284 INFO [Listener at localhost/46855] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-09 20:55:37,284 INFO [Listener at localhost/46855] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 20:55:37,284 INFO [Listener at localhost/46855] regionserver.HRegion(2258): Starting compaction of 9dee656d29adb7e6b7d42a643b66b07b/family1 in testCompactionWithHFileLink,2,1675976119971.9dee656d29adb7e6b7d42a643b66b07b. 2023-02-09 20:55:37,284 INFO [Listener at localhost/46855] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/family1/8dffd447500b40ddbcd436ec073020e4, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/family1/19be0e30a8ed4401bdaaaf7a7dd9875a, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/family1/a457362d693044eab95c30a529dc1a9d, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/family1/30e774cd94d64d94a0e818dada82f5b4, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/family1/c1a96fd1fe0744198e2c6c0ca8ef3b39] into tmpdir=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/.tmp, totalSize=26.7 K 2023-02-09 20:55:37,284 DEBUG [Listener at localhost/46855] compactions.Compactor(207): Compacting 8dffd447500b40ddbcd436ec073020e4, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1675976122087 2023-02-09 20:55:37,285 DEBUG [Listener at localhost/46855] compactions.Compactor(207): Compacting 19be0e30a8ed4401bdaaaf7a7dd9875a, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1675976123882 2023-02-09 20:55:37,285 DEBUG [Listener at localhost/46855] compactions.Compactor(207): Compacting a457362d693044eab95c30a529dc1a9d, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1675976125672 2023-02-09 20:55:37,285 DEBUG [Listener at localhost/46855] compactions.Compactor(207): Compacting 30e774cd94d64d94a0e818dada82f5b4, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1675976127054 2023-02-09 20:55:37,285 DEBUG [Listener at localhost/46855] compactions.Compactor(207): Compacting c1a96fd1fe0744198e2c6c0ca8ef3b39, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-02-09 20:55:37,295 INFO [Listener at localhost/46855] throttle.PressureAwareThroughputController(145): 9dee656d29adb7e6b7d42a643b66b07b#family1#compaction#109 average throughput is 0.85 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-09 20:55:37,377 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/family2/f62e3e2786aa4157a19aba13c6283944, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/family2/634ca6469094417da516e2df95ebc29a, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/family2/89f4f2823dfa4779aee577ace6aee66e, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/family2/9cb6df9bc6b944f89f1acc6aaa68461d, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/family2/d98b1057578e4ddea66ccf0eb8927334] to archive 2023-02-09 20:55:37,378 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 20:55:37,380 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/family2/f62e3e2786aa4157a19aba13c6283944 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/family2/f62e3e2786aa4157a19aba13c6283944 2023-02-09 20:55:37,381 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/family2/634ca6469094417da516e2df95ebc29a to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/family2/634ca6469094417da516e2df95ebc29a 2023-02-09 20:55:37,382 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/family2/89f4f2823dfa4779aee577ace6aee66e to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/family2/89f4f2823dfa4779aee577ace6aee66e 2023-02-09 20:55:37,383 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/family2/9cb6df9bc6b944f89f1acc6aaa68461d to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/family2/9cb6df9bc6b944f89f1acc6aaa68461d 2023-02-09 20:55:37,384 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/family2/d98b1057578e4ddea66ccf0eb8927334 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/family2/d98b1057578e4ddea66ccf0eb8927334 2023-02-09 20:55:37,702 INFO [Listener at localhost/46855] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c2023020942523fe1fd9b49638fb4576fe674d492_del 2023-02-09 20:55:37,702 INFO [Listener at localhost/46855] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023020942523fe1fd9b49638fb4576fe674d492_del to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023020942523fe1fd9b49638fb4576fe674d492_del 2023-02-09 20:55:38,516 INFO [Listener at localhost/46855] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e6b1712da584424faeec552975e16ff3 2023-02-09 20:55:38,516 DEBUG [Listener at localhost/46855] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/.tmp/family1/e6b1712da584424faeec552975e16ff3 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/family1/e6b1712da584424faeec552975e16ff3 2023-02-09 20:55:38,520 INFO [Listener at localhost/46855] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e6b1712da584424faeec552975e16ff3 2023-02-09 20:55:38,521 INFO [Listener at localhost/46855] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 9dee656d29adb7e6b7d42a643b66b07b/family1 of 9dee656d29adb7e6b7d42a643b66b07b into e6b1712da584424faeec552975e16ff3(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-09 20:55:38,521 DEBUG [Listener at localhost/46855] regionserver.HRegion(2288): Compaction status journal for 9dee656d29adb7e6b7d42a643b66b07b: 2023-02-09 20:55:38,521 DEBUG [Listener at localhost/46855] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-09 20:55:38,521 DEBUG [Listener at localhost/46855] regionserver.HStore(1912): 9dee656d29adb7e6b7d42a643b66b07b/family2 is initiating major compaction (all files) 2023-02-09 20:55:38,521 INFO [Listener at localhost/46855] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-09 20:55:38,521 INFO [Listener at localhost/46855] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 20:55:38,521 INFO [Listener at localhost/46855] regionserver.HRegion(2258): Starting compaction of 9dee656d29adb7e6b7d42a643b66b07b/family2 in testCompactionWithHFileLink,2,1675976119971.9dee656d29adb7e6b7d42a643b66b07b. 2023-02-09 20:55:38,521 INFO [Listener at localhost/46855] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/family2/39383c1ed4b64edca22dee4cc20a06cd, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/family2/65d11bd220904c5ebb12875f70b36894, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/family2/b03e6d792cd6417b9c3840efaceed27f, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/family2/5c5f9538d1734402a79d6449d0577cf3, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/family2/f3f705904d1a4564a2d4c6d87fa219e9] into tmpdir=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/.tmp, totalSize=25.4 K 2023-02-09 20:55:38,522 DEBUG [Listener at localhost/46855] compactions.Compactor(207): Compacting 39383c1ed4b64edca22dee4cc20a06cd, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1675976122087 2023-02-09 20:55:38,522 DEBUG [Listener at localhost/46855] compactions.Compactor(207): Compacting 65d11bd220904c5ebb12875f70b36894, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1675976123882 2023-02-09 20:55:38,522 DEBUG [Listener at localhost/46855] compactions.Compactor(207): Compacting b03e6d792cd6417b9c3840efaceed27f, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1675976125672 2023-02-09 20:55:38,522 DEBUG [Listener at localhost/46855] compactions.Compactor(207): Compacting 5c5f9538d1734402a79d6449d0577cf3, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1675976127054 2023-02-09 20:55:38,523 DEBUG [Listener at localhost/46855] compactions.Compactor(207): Compacting f3f705904d1a4564a2d4c6d87fa219e9, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-02-09 20:55:38,533 INFO [Listener at localhost/46855] throttle.PressureAwareThroughputController(145): 9dee656d29adb7e6b7d42a643b66b07b#family2#compaction#110 average throughput is 0.35 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-09 20:55:38,580 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/family1/8dffd447500b40ddbcd436ec073020e4, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/family1/19be0e30a8ed4401bdaaaf7a7dd9875a, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/family1/a457362d693044eab95c30a529dc1a9d, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/family1/30e774cd94d64d94a0e818dada82f5b4, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/family1/c1a96fd1fe0744198e2c6c0ca8ef3b39] to archive 2023-02-09 20:55:38,581 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 20:55:38,582 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/family1/8dffd447500b40ddbcd436ec073020e4 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/family1/8dffd447500b40ddbcd436ec073020e4 2023-02-09 20:55:38,583 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/family1/19be0e30a8ed4401bdaaaf7a7dd9875a to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/family1/19be0e30a8ed4401bdaaaf7a7dd9875a 2023-02-09 20:55:38,584 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/family1/a457362d693044eab95c30a529dc1a9d to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/family1/a457362d693044eab95c30a529dc1a9d 2023-02-09 20:55:38,585 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/family1/30e774cd94d64d94a0e818dada82f5b4 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/family1/30e774cd94d64d94a0e818dada82f5b4 2023-02-09 20:55:38,586 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/family1/c1a96fd1fe0744198e2c6c0ca8ef3b39 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/family1/c1a96fd1fe0744198e2c6c0ca8ef3b39 2023-02-09 20:55:38,944 INFO [Listener at localhost/46855] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c2023020994b453d21a214a9b9d755efefcc93152_del 2023-02-09 20:55:38,944 INFO [Listener at localhost/46855] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023020994b453d21a214a9b9d755efefcc93152_del to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023020994b453d21a214a9b9d755efefcc93152_del 2023-02-09 20:55:39,757 INFO [Listener at localhost/46855] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 49539e95f0cc437db1f981429c39b06b 2023-02-09 20:55:39,758 DEBUG [Listener at localhost/46855] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/.tmp/family2/49539e95f0cc437db1f981429c39b06b as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/family2/49539e95f0cc437db1f981429c39b06b 2023-02-09 20:55:39,761 INFO [Listener at localhost/46855] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 49539e95f0cc437db1f981429c39b06b 2023-02-09 20:55:39,762 INFO [Listener at localhost/46855] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 9dee656d29adb7e6b7d42a643b66b07b/family2 of 9dee656d29adb7e6b7d42a643b66b07b into 49539e95f0cc437db1f981429c39b06b(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-09 20:55:39,762 DEBUG [Listener at localhost/46855] regionserver.HRegion(2288): Compaction status journal for 9dee656d29adb7e6b7d42a643b66b07b: 2023-02-09 20:55:39,762 DEBUG [Listener at localhost/46855] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-09 20:55:39,762 DEBUG [Listener at localhost/46855] regionserver.HStore(1912): fd99e712d029b1479ee16c3a0c467ce5/family1 is initiating major compaction (all files) 2023-02-09 20:55:39,762 INFO [Listener at localhost/46855] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-09 20:55:39,762 INFO [Listener at localhost/46855] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 20:55:39,763 INFO [Listener at localhost/46855] regionserver.HRegion(2258): Starting compaction of fd99e712d029b1479ee16c3a0c467ce5/family1 in testCompactionWithHFileLink,,1675976119971.fd99e712d029b1479ee16c3a0c467ce5. 2023-02-09 20:55:39,763 INFO [Listener at localhost/46855] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/family1/7adfdbfb53834874af61c06653ea05d9, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/family1/8a4fd3c0e795466fb8bcb12d2e892fa5, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/family1/05d738ce288648c08cfdbfdd1fac4f25, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/family1/59e1b573d3c840b3905af50afe4a392c, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/family1/50538a68a3a945eca0bb8f9054ad2758] into tmpdir=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/.tmp, totalSize=26.7 K 2023-02-09 20:55:39,763 DEBUG [Listener at localhost/46855] compactions.Compactor(207): Compacting 7adfdbfb53834874af61c06653ea05d9, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1675976122085 2023-02-09 20:55:39,764 DEBUG [Listener at localhost/46855] compactions.Compactor(207): Compacting 8a4fd3c0e795466fb8bcb12d2e892fa5, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1675976123881 2023-02-09 20:55:39,764 DEBUG [Listener at localhost/46855] compactions.Compactor(207): Compacting 05d738ce288648c08cfdbfdd1fac4f25, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1675976125672 2023-02-09 20:55:39,764 DEBUG [Listener at localhost/46855] compactions.Compactor(207): Compacting 59e1b573d3c840b3905af50afe4a392c, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1675976127054 2023-02-09 20:55:39,765 DEBUG [Listener at localhost/46855] compactions.Compactor(207): Compacting 50538a68a3a945eca0bb8f9054ad2758, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-02-09 20:55:39,777 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/family2/39383c1ed4b64edca22dee4cc20a06cd, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/family2/65d11bd220904c5ebb12875f70b36894, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/family2/b03e6d792cd6417b9c3840efaceed27f, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/family2/5c5f9538d1734402a79d6449d0577cf3, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/family2/f3f705904d1a4564a2d4c6d87fa219e9] to archive 2023-02-09 20:55:39,777 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 20:55:39,777 INFO [Listener at localhost/46855] throttle.PressureAwareThroughputController(145): fd99e712d029b1479ee16c3a0c467ce5#family1#compaction#111 average throughput is 0.34 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-09 20:55:39,778 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/family2/39383c1ed4b64edca22dee4cc20a06cd to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/family2/39383c1ed4b64edca22dee4cc20a06cd 2023-02-09 20:55:39,779 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/family2/65d11bd220904c5ebb12875f70b36894 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/family2/65d11bd220904c5ebb12875f70b36894 2023-02-09 20:55:39,781 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/family2/b03e6d792cd6417b9c3840efaceed27f to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/family2/b03e6d792cd6417b9c3840efaceed27f 2023-02-09 20:55:39,782 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/family2/5c5f9538d1734402a79d6449d0577cf3 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/family2/5c5f9538d1734402a79d6449d0577cf3 2023-02-09 20:55:39,782 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/family2/f3f705904d1a4564a2d4c6d87fa219e9 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/family2/f3f705904d1a4564a2d4c6d87fa219e9 2023-02-09 20:55:40,185 INFO [Listener at localhost/46855] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e2023020957c4bba237cd4a999cf271f22c6576f1_del 2023-02-09 20:55:40,185 INFO [Listener at localhost/46855] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023020957c4bba237cd4a999cf271f22c6576f1_del to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023020957c4bba237cd4a999cf271f22c6576f1_del 2023-02-09 20:55:40,998 INFO [Listener at localhost/46855] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c5068aae90d54bb39fb50d8dc2851978 2023-02-09 20:55:40,999 DEBUG [Listener at localhost/46855] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/.tmp/family1/c5068aae90d54bb39fb50d8dc2851978 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/family1/c5068aae90d54bb39fb50d8dc2851978 2023-02-09 20:55:41,002 INFO [Listener at localhost/46855] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c5068aae90d54bb39fb50d8dc2851978 2023-02-09 20:55:41,003 INFO [Listener at localhost/46855] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in fd99e712d029b1479ee16c3a0c467ce5/family1 of fd99e712d029b1479ee16c3a0c467ce5 into c5068aae90d54bb39fb50d8dc2851978(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-09 20:55:41,003 DEBUG [Listener at localhost/46855] regionserver.HRegion(2288): Compaction status journal for fd99e712d029b1479ee16c3a0c467ce5: 2023-02-09 20:55:41,003 DEBUG [Listener at localhost/46855] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-09 20:55:41,003 DEBUG [Listener at localhost/46855] regionserver.HStore(1912): fd99e712d029b1479ee16c3a0c467ce5/family2 is initiating major compaction (all files) 2023-02-09 20:55:41,003 INFO [Listener at localhost/46855] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-09 20:55:41,003 INFO [Listener at localhost/46855] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 20:55:41,003 INFO [Listener at localhost/46855] regionserver.HRegion(2258): Starting compaction of fd99e712d029b1479ee16c3a0c467ce5/family2 in testCompactionWithHFileLink,,1675976119971.fd99e712d029b1479ee16c3a0c467ce5. 2023-02-09 20:55:41,003 INFO [Listener at localhost/46855] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/family2/b033bc8de43c48fe813afee249071e04, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/family2/2965303a0eec417f93790a17caf709de, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/family2/5360d4e617fd4484833e455dcbfc891e, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/family2/cdbfdba21eb843e69d7a0678505b226e, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/family2/d466b94e18944d80aed5566071298fe1] into tmpdir=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/.tmp, totalSize=25.4 K 2023-02-09 20:55:41,004 DEBUG [Listener at localhost/46855] compactions.Compactor(207): Compacting b033bc8de43c48fe813afee249071e04, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1675976122085 2023-02-09 20:55:41,004 DEBUG [Listener at localhost/46855] compactions.Compactor(207): Compacting 2965303a0eec417f93790a17caf709de, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1675976123881 2023-02-09 20:55:41,004 DEBUG [Listener at localhost/46855] compactions.Compactor(207): Compacting 5360d4e617fd4484833e455dcbfc891e, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1675976125672 2023-02-09 20:55:41,005 DEBUG [Listener at localhost/46855] compactions.Compactor(207): Compacting cdbfdba21eb843e69d7a0678505b226e, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1675976127054 2023-02-09 20:55:41,005 DEBUG [Listener at localhost/46855] compactions.Compactor(207): Compacting d466b94e18944d80aed5566071298fe1, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-02-09 20:55:41,015 INFO [Listener at localhost/46855] throttle.PressureAwareThroughputController(145): fd99e712d029b1479ee16c3a0c467ce5#family2#compaction#112 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-09 20:55:41,074 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/family1/7adfdbfb53834874af61c06653ea05d9, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/family1/8a4fd3c0e795466fb8bcb12d2e892fa5, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/family1/05d738ce288648c08cfdbfdd1fac4f25, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/family1/59e1b573d3c840b3905af50afe4a392c, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/family1/50538a68a3a945eca0bb8f9054ad2758] to archive 2023-02-09 20:55:41,075 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 20:55:41,076 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/family1/7adfdbfb53834874af61c06653ea05d9 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/family1/7adfdbfb53834874af61c06653ea05d9 2023-02-09 20:55:41,077 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/family1/8a4fd3c0e795466fb8bcb12d2e892fa5 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/family1/8a4fd3c0e795466fb8bcb12d2e892fa5 2023-02-09 20:55:41,078 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/family1/05d738ce288648c08cfdbfdd1fac4f25 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/family1/05d738ce288648c08cfdbfdd1fac4f25 2023-02-09 20:55:41,079 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/family1/59e1b573d3c840b3905af50afe4a392c to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/family1/59e1b573d3c840b3905af50afe4a392c 2023-02-09 20:55:41,080 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/family1/50538a68a3a945eca0bb8f9054ad2758 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/family1/50538a68a3a945eca0bb8f9054ad2758 2023-02-09 20:55:41,423 INFO [Listener at localhost/46855] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20230209cdf97c35171443a888ec4056fbcaa500_del 2023-02-09 20:55:41,423 INFO [Listener at localhost/46855] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230209cdf97c35171443a888ec4056fbcaa500_del to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230209cdf97c35171443a888ec4056fbcaa500_del 2023-02-09 20:55:42,237 INFO [Listener at localhost/46855] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a730e56db52148d9935033f21c4c0c83 2023-02-09 20:55:42,238 DEBUG [Listener at localhost/46855] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/.tmp/family2/a730e56db52148d9935033f21c4c0c83 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/family2/a730e56db52148d9935033f21c4c0c83 2023-02-09 20:55:42,241 INFO [Listener at localhost/46855] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a730e56db52148d9935033f21c4c0c83 2023-02-09 20:55:42,242 INFO [Listener at localhost/46855] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in fd99e712d029b1479ee16c3a0c467ce5/family2 of fd99e712d029b1479ee16c3a0c467ce5 into a730e56db52148d9935033f21c4c0c83(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-09 20:55:42,242 DEBUG [Listener at localhost/46855] regionserver.HRegion(2288): Compaction status journal for fd99e712d029b1479ee16c3a0c467ce5: 2023-02-09 20:55:42,246 DEBUG [Listener at localhost/46855] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-09 20:55:42,250 DEBUG [Listener at localhost/46855] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-09 20:55:42,254 DEBUG [Listener at localhost/46855] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-09 20:55:42,254 DEBUG [Listener at localhost/46855] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-09 20:55:42,262 INFO [Listener at localhost/46855] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-02-09 20:55:42,276 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/family2/b033bc8de43c48fe813afee249071e04, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/family2/2965303a0eec417f93790a17caf709de, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/family2/5360d4e617fd4484833e455dcbfc891e, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/family2/cdbfdba21eb843e69d7a0678505b226e, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/family2/d466b94e18944d80aed5566071298fe1] to archive 2023-02-09 20:55:42,276 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 20:55:42,278 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/family2/b033bc8de43c48fe813afee249071e04 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/family2/b033bc8de43c48fe813afee249071e04 2023-02-09 20:55:42,280 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/family2/2965303a0eec417f93790a17caf709de to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/family2/2965303a0eec417f93790a17caf709de 2023-02-09 20:55:42,281 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/family2/5360d4e617fd4484833e455dcbfc891e to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/family2/5360d4e617fd4484833e455dcbfc891e 2023-02-09 20:55:42,282 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/family2/cdbfdba21eb843e69d7a0678505b226e to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/family2/cdbfdba21eb843e69d7a0678505b226e 2023-02-09 20:55:42,283 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/family2/d466b94e18944d80aed5566071298fe1 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/family2/d466b94e18944d80aed5566071298fe1 2023-02-09 20:55:42,297 INFO [Listener at localhost/46855] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 3 del files, 12 selected files, and 0 irrelevant files table 'testCompactionWithHFileLink' and column 'family1' 2023-02-09 20:55:42,300 INFO [Listener at localhost/46855] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e2023020957c4bba237cd4a999cf271f22c6576f1_del 2023-02-09 20:55:42,303 INFO [Listener at localhost/46855] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b2023020905bf600e94fe488081b311cfd5f585a0_del 2023-02-09 20:55:42,305 INFO [Listener at localhost/46855] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c2023020942523fe1fd9b49638fb4576fe674d492_del 2023-02-09 20:55:42,305 INFO [Listener at localhost/46855] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='testCompactionWithHFileLink' column='family1' 2023-02-09 20:55:42,306 DEBUG [Listener at localhost/46855] zookeeper.ReadOnlyZKClient(139): Connect 0x6bcd0d7c to 127.0.0.1:62089 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 20:55:42,310 DEBUG [Listener at localhost/46855] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@59b38038, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 20:55:42,310 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20230209 for table='testCompactionWithHFileLink' and column='family1' 2023-02-09 20:55:42,310 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20230209 for table='testCompactionWithHFileLink' and column='family1' 2023-02-09 20:55:42,311 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20230209 for table='testCompactionWithHFileLink' and column='family1' 2023-02-09 20:55:42,366 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023020922a5fbeae7464d709bf5216bbbd553ce to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023020922a5fbeae7464d709bf5216bbbd553ce 2023-02-09 20:55:42,367 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230209ea3f2dd63eea4d359ff3486a7ca128ae to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230209ea3f2dd63eea4d359ff3486a7ca128ae 2023-02-09 20:55:42,367 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230209 table='testCompactionWithHFileLink' column='family1' 2023-02-09 20:55:42,368 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230209 table='testCompactionWithHFileLink' column='family1' 2023-02-09 20:55:42,384 DEBUG [MobFileCompactionChore-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 20:55:42,389 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:49984, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 20:55:42,398 DEBUG [MobFileCompactionChore-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-09 20:55:42,404 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:38958, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-09 20:55:42,419 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230209/family1/84eb867616454f219305f6f81b7e2739 first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x07] 2023-02-09 20:55:42,419 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230209/family1/e1a2d826e5314e0889284b0c895a1836 first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x07] 2023-02-09 20:55:42,421 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testCompactionWithHFileLink,2,1675976119971.9dee656d29adb7e6b7d42a643b66b07b., hostname=jenkins-hbase9.apache.org,40919,1675976022294, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230209/family1/84eb867616454f219305f6f81b7e2739}] 2023-02-09 20:55:42,421 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testCompactionWithHFileLink,,1675976119971.fd99e712d029b1479ee16c3a0c467ce5., hostname=jenkins-hbase9.apache.org,40919,1675976022294, seqNum=2 for row with hfile group [{family1,hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230209/family1/e1a2d826e5314e0889284b0c895a1836}] 2023-02-09 20:55:42,425 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40919] regionserver.HStore(763): Validating hfile at hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230209/family1/84eb867616454f219305f6f81b7e2739 for inclusion in 9dee656d29adb7e6b7d42a643b66b07b/family1 2023-02-09 20:55:42,425 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HStore(763): Validating hfile at hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230209/family1/e1a2d826e5314e0889284b0c895a1836 for inclusion in fd99e712d029b1479ee16c3a0c467ce5/family1 2023-02-09 20:55:42,427 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40919] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x07 2023-02-09 20:55:42,427 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40919] regionserver.HStore(777): Region bounds: first=2 last= 2023-02-09 20:55:42,427 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x07 2023-02-09 20:55:42,427 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40919] regionserver.HRegion(2445): Flush status journal for 9dee656d29adb7e6b7d42a643b66b07b: 2023-02-09 20:55:42,427 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HStore(777): Region bounds: first= last=1 2023-02-09 20:55:42,427 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HRegion(2445): Flush status journal for fd99e712d029b1479ee16c3a0c467ce5: 2023-02-09 20:55:42,428 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40919] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230209/family1/84eb867616454f219305f6f81b7e2739 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/staging/jenkins__testCompactionWithHFileLink__catb8d124vpp9qb26l3s4ihcmjbib7n1qi0hb111omk0iqtofh807cpa741dlkqd/family1/84eb867616454f219305f6f81b7e2739 2023-02-09 20:55:42,428 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230209/family1/e1a2d826e5314e0889284b0c895a1836 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/staging/jenkins__testCompactionWithHFileLink__9me5627vbjb5d5qde3d5tlcsurfvi4sn0a2ij0793fk5vk5go5c7215cpcfv5hj2/family1/e1a2d826e5314e0889284b0c895a1836 2023-02-09 20:55:42,429 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40919] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/staging/jenkins__testCompactionWithHFileLink__catb8d124vpp9qb26l3s4ihcmjbib7n1qi0hb111omk0iqtofh807cpa741dlkqd/family1/84eb867616454f219305f6f81b7e2739 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/family1/cc931e87e561475fac6707e9508d7933_SeqId_29_ 2023-02-09 20:55:42,430 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/staging/jenkins__testCompactionWithHFileLink__9me5627vbjb5d5qde3d5tlcsurfvi4sn0a2ij0793fk5vk5go5c7215cpcfv5hj2/family1/e1a2d826e5314e0889284b0c895a1836 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/family1/e948ac72d95b4a3f908344b4be049e7c_SeqId_29_ 2023-02-09 20:55:42,430 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40919] regionserver.HStore(849): Loaded HFile hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/staging/jenkins__testCompactionWithHFileLink__catb8d124vpp9qb26l3s4ihcmjbib7n1qi0hb111omk0iqtofh807cpa741dlkqd/family1/84eb867616454f219305f6f81b7e2739 into 9dee656d29adb7e6b7d42a643b66b07b/family1 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/family1/cc931e87e561475fac6707e9508d7933_SeqId_29_ - updating store file list. 2023-02-09 20:55:42,430 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HStore(849): Loaded HFile hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/staging/jenkins__testCompactionWithHFileLink__9me5627vbjb5d5qde3d5tlcsurfvi4sn0a2ij0793fk5vk5go5c7215cpcfv5hj2/family1/e1a2d826e5314e0889284b0c895a1836 into fd99e712d029b1479ee16c3a0c467ce5/family1 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/family1/e948ac72d95b4a3f908344b4be049e7c_SeqId_29_ - updating store file list. 2023-02-09 20:55:42,433 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40919] regionserver.HStore(882): Loaded HFile hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/family1/cc931e87e561475fac6707e9508d7933_SeqId_29_ into 9dee656d29adb7e6b7d42a643b66b07b/family1 2023-02-09 20:55:42,434 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HStore(882): Loaded HFile hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/family1/e948ac72d95b4a3f908344b4be049e7c_SeqId_29_ into fd99e712d029b1479ee16c3a0c467ce5/family1 2023-02-09 20:55:42,434 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40919] regionserver.HStore(855): Successfully loaded hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/staging/jenkins__testCompactionWithHFileLink__catb8d124vpp9qb26l3s4ihcmjbib7n1qi0hb111omk0iqtofh807cpa741dlkqd/family1/84eb867616454f219305f6f81b7e2739 into 9dee656d29adb7e6b7d42a643b66b07b/family1 (new location: hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/family1/cc931e87e561475fac6707e9508d7933_SeqId_29_) 2023-02-09 20:55:42,434 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HStore(855): Successfully loaded hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/staging/jenkins__testCompactionWithHFileLink__9me5627vbjb5d5qde3d5tlcsurfvi4sn0a2ij0793fk5vk5go5c7215cpcfv5hj2/family1/e1a2d826e5314e0889284b0c895a1836 into fd99e712d029b1479ee16c3a0c467ce5/family1 (new location: hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/family1/e948ac72d95b4a3f908344b4be049e7c_SeqId_29_) 2023-02-09 20:55:42,434 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40919] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/staging/jenkins__testCompactionWithHFileLink__catb8d124vpp9qb26l3s4ihcmjbib7n1qi0hb111omk0iqtofh807cpa741dlkqd/family1/84eb867616454f219305f6f81b7e2739 2023-02-09 20:55:42,434 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/staging/jenkins__testCompactionWithHFileLink__9me5627vbjb5d5qde3d5tlcsurfvi4sn0a2ij0793fk5vk5go5c7215cpcfv5hj2/family1/e1a2d826e5314e0889284b0c895a1836 2023-02-09 20:55:42,437 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230209 table='testCompactionWithHFileLink' column='family1' 2023-02-09 20:55:42,437 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230209 table='testCompactionWithHFileLink' column='family1' 2023-02-09 20:55:42,437 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 20:55:42,438 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 20:55:42,439 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023020911445e993bcf46459549fcf84e73bd80 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023020911445e993bcf46459549fcf84e73bd80 2023-02-09 20:55:42,439 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230209314a0b9217254e10b80045e601857690 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230209314a0b9217254e10b80045e601857690 2023-02-09 20:55:42,440 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202302093d7f1a01613642ecac1593478ee384b2 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202302093d7f1a01613642ecac1593478ee384b2 2023-02-09 20:55:42,441 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202302093369568549a549bb98dc4decbc478266 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202302093369568549a549bb98dc4decbc478266 2023-02-09 20:55:42,442 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230209499d07c47b844887884c2cbec5562885 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230209499d07c47b844887884c2cbec5562885 2023-02-09 20:55:42,442 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230209a129990bcee74ab49e2421e438d1ff4b to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230209a129990bcee74ab49e2421e438d1ff4b 2023-02-09 20:55:42,443 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230209b1e9cbc26733498fb7dc0ad8994edf15 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230209b1e9cbc26733498fb7dc0ad8994edf15 2023-02-09 20:55:42,443 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-02-09 20:55:42,443 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230209da15212355094b199ba61e702d11757b to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230209da15212355094b199ba61e702d11757b 2023-02-09 20:55:42,443 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230209' 2023-02-09 20:55:42,443 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-02-09 20:55:42,443 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230209' 2023-02-09 20:55:42,443 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20230209 for table='testCompactionWithHFileLink' and column='family1' 2023-02-09 20:55:42,444 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20230209 for table='testCompactionWithHFileLink' and column='family1' 2023-02-09 20:55:43,165 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023020975a49e0ffd5e40a2afb535f3c4fcf5c4 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023020975a49e0ffd5e40a2afb535f3c4fcf5c4 2023-02-09 20:55:43,166 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230209 table='testCompactionWithHFileLink' column='family1' 2023-02-09 20:55:43,197 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230209/family1/c9bdb38e35fb4fbb83b88618173efc02 first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x07] 2023-02-09 20:55:43,198 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testCompactionWithHFileLink,1,1675976119971.d3a98fcfad73ec6f98096a0e81049c21., hostname=jenkins-hbase9.apache.org,40919,1675976022294, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230209/family1/c9bdb38e35fb4fbb83b88618173efc02}] 2023-02-09 20:55:43,200 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40919] regionserver.HStore(763): Validating hfile at hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230209/family1/c9bdb38e35fb4fbb83b88618173efc02 for inclusion in d3a98fcfad73ec6f98096a0e81049c21/family1 2023-02-09 20:55:43,202 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40919] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x07 2023-02-09 20:55:43,202 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40919] regionserver.HStore(777): Region bounds: first=1 last=2 2023-02-09 20:55:43,202 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40919] regionserver.HRegion(2445): Flush status journal for d3a98fcfad73ec6f98096a0e81049c21: 2023-02-09 20:55:43,204 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40919] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230209/family1/c9bdb38e35fb4fbb83b88618173efc02 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/staging/jenkins__testCompactionWithHFileLink__ffvccio3ersruim67mqerq8v8btsqu9r9m0ae8ulbio174ktskc9oj5oreusmhpm/family1/c9bdb38e35fb4fbb83b88618173efc02 2023-02-09 20:55:43,206 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40919] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/staging/jenkins__testCompactionWithHFileLink__ffvccio3ersruim67mqerq8v8btsqu9r9m0ae8ulbio174ktskc9oj5oreusmhpm/family1/c9bdb38e35fb4fbb83b88618173efc02 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/family1/fd074ec1e50f46829b7b383e85dc5614_SeqId_29_ 2023-02-09 20:55:43,206 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40919] regionserver.HStore(849): Loaded HFile hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/staging/jenkins__testCompactionWithHFileLink__ffvccio3ersruim67mqerq8v8btsqu9r9m0ae8ulbio174ktskc9oj5oreusmhpm/family1/c9bdb38e35fb4fbb83b88618173efc02 into d3a98fcfad73ec6f98096a0e81049c21/family1 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/family1/fd074ec1e50f46829b7b383e85dc5614_SeqId_29_ - updating store file list. 2023-02-09 20:55:43,209 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40919] regionserver.HStore(882): Loaded HFile hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/family1/fd074ec1e50f46829b7b383e85dc5614_SeqId_29_ into d3a98fcfad73ec6f98096a0e81049c21/family1 2023-02-09 20:55:43,209 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40919] regionserver.HStore(855): Successfully loaded hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/staging/jenkins__testCompactionWithHFileLink__ffvccio3ersruim67mqerq8v8btsqu9r9m0ae8ulbio174ktskc9oj5oreusmhpm/family1/c9bdb38e35fb4fbb83b88618173efc02 into d3a98fcfad73ec6f98096a0e81049c21/family1 (new location: hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/family1/fd074ec1e50f46829b7b383e85dc5614_SeqId_29_) 2023-02-09 20:55:43,209 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40919] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/staging/jenkins__testCompactionWithHFileLink__ffvccio3ersruim67mqerq8v8btsqu9r9m0ae8ulbio174ktskc9oj5oreusmhpm/family1/c9bdb38e35fb4fbb83b88618173efc02 2023-02-09 20:55:43,211 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230209 table='testCompactionWithHFileLink' column='family1' 2023-02-09 20:55:43,211 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 20:55:43,212 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202302090485249c391b4cb2996d41315057beec to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202302090485249c391b4cb2996d41315057beec 2023-02-09 20:55:43,213 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023020946d52341946546bfa2faa21026abbf30 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023020946d52341946546bfa2faa21026abbf30 2023-02-09 20:55:43,214 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202302094cd195d47b5e4378b7b7e975c1569dbb to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202302094cd195d47b5e4378b7b7e975c1569dbb 2023-02-09 20:55:43,215 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023020981663a075738408e88cb9321c351aca7 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023020981663a075738408e88cb9321c351aca7 2023-02-09 20:55:43,215 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-02-09 20:55:43,215 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230209' 2023-02-09 20:55:43,215 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20230209 for table='testCompactionWithHFileLink' and column='family1' 2023-02-09 20:55:43,215 INFO [Listener at localhost/46855] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testCompactionWithHFileLink' column='family1' 2023-02-09 20:55:43,215 INFO [Listener at localhost/46855] compactions.PartitionedMobCompactor(364): After a mob compaction with all files selected, archiving the del files for table='testCompactionWithHFileLink' and column='family1' 2023-02-09 20:55:43,216 INFO [Listener at localhost/46855] compactions.PartitionedMobCompactor(367): [hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023020957c4bba237cd4a999cf271f22c6576f1_del] 2023-02-09 20:55:43,216 DEBUG [Listener at localhost/46855] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 20:55:43,217 DEBUG [Listener at localhost/46855] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023020957c4bba237cd4a999cf271f22c6576f1_del to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023020957c4bba237cd4a999cf271f22c6576f1_del 2023-02-09 20:55:43,217 INFO [Listener at localhost/46855] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-02-09 20:55:43,217 INFO [Listener at localhost/46855] compactions.PartitionedMobCompactor(367): [hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023020905bf600e94fe488081b311cfd5f585a0_del] 2023-02-09 20:55:43,217 DEBUG [Listener at localhost/46855] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 20:55:43,218 DEBUG [Listener at localhost/46855] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023020905bf600e94fe488081b311cfd5f585a0_del to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023020905bf600e94fe488081b311cfd5f585a0_del 2023-02-09 20:55:43,219 INFO [Listener at localhost/46855] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-02-09 20:55:43,219 INFO [Listener at localhost/46855] compactions.PartitionedMobCompactor(367): [hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023020942523fe1fd9b49638fb4576fe674d492_del] 2023-02-09 20:55:43,219 DEBUG [Listener at localhost/46855] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 20:55:43,220 DEBUG [Listener at localhost/46855] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023020942523fe1fd9b49638fb4576fe674d492_del to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023020942523fe1fd9b49638fb4576fe674d492_del 2023-02-09 20:55:43,220 INFO [Listener at localhost/46855] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-02-09 20:55:43,223 DEBUG [Listener at localhost/46855] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-09 20:55:43,224 DEBUG [Listener at localhost/46855] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-09 20:55:43,227 DEBUG [Listener at localhost/46855] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-09 20:55:43,228 DEBUG [Listener at localhost/46855] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-09 20:55:43,232 INFO [Listener at localhost/46855] client.HBaseAdmin$15(890): Started disable of testCompactionWithHFileLink 2023-02-09 20:55:43,233 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42951] master.HMaster$11(2405): Client=jenkins//172.31.2.10 disable testCompactionWithHFileLink 2023-02-09 20:55:43,233 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42951] procedure2.ProcedureExecutor(1029): Stored pid=88, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testCompactionWithHFileLink 2023-02-09 20:55:43,235 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42951] master.MasterRpcServices(1227): Checking to see if procedure is done pid=88 2023-02-09 20:55:43,235 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675976143235"}]},"ts":"1675976143235"} 2023-02-09 20:55:43,237 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=DISABLING in hbase:meta 2023-02-09 20:55:43,238 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testCompactionWithHFileLink to state=DISABLING 2023-02-09 20:55:43,238 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=89, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=fd99e712d029b1479ee16c3a0c467ce5, UNASSIGN}, {pid=90, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=d3a98fcfad73ec6f98096a0e81049c21, UNASSIGN}, {pid=91, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=9dee656d29adb7e6b7d42a643b66b07b, UNASSIGN}] 2023-02-09 20:55:43,239 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=90, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=d3a98fcfad73ec6f98096a0e81049c21, UNASSIGN 2023-02-09 20:55:43,240 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=9dee656d29adb7e6b7d42a643b66b07b, UNASSIGN 2023-02-09 20:55:43,240 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=89, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=fd99e712d029b1479ee16c3a0c467ce5, UNASSIGN 2023-02-09 20:55:43,240 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=90 updating hbase:meta row=d3a98fcfad73ec6f98096a0e81049c21, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:43,240 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=9dee656d29adb7e6b7d42a643b66b07b, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:43,240 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=89 updating hbase:meta row=fd99e712d029b1479ee16c3a0c467ce5, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:43,240 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1675976119971.d3a98fcfad73ec6f98096a0e81049c21.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1675976143240"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675976143240"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675976143240"}]},"ts":"1675976143240"} 2023-02-09 20:55:43,240 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1675976119971.9dee656d29adb7e6b7d42a643b66b07b.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1675976143240"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675976143240"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675976143240"}]},"ts":"1675976143240"} 2023-02-09 20:55:43,240 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1675976119971.fd99e712d029b1479ee16c3a0c467ce5.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1675976143240"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675976143240"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675976143240"}]},"ts":"1675976143240"} 2023-02-09 20:55:43,241 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=92, ppid=90, state=RUNNABLE; CloseRegionProcedure d3a98fcfad73ec6f98096a0e81049c21, server=jenkins-hbase9.apache.org,40919,1675976022294}] 2023-02-09 20:55:43,242 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=93, ppid=91, state=RUNNABLE; CloseRegionProcedure 9dee656d29adb7e6b7d42a643b66b07b, server=jenkins-hbase9.apache.org,40919,1675976022294}] 2023-02-09 20:55:43,242 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=94, ppid=89, state=RUNNABLE; CloseRegionProcedure fd99e712d029b1479ee16c3a0c467ce5, server=jenkins-hbase9.apache.org,40919,1675976022294}] 2023-02-09 20:55:43,336 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42951] master.MasterRpcServices(1227): Checking to see if procedure is done pid=88 2023-02-09 20:55:43,393 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(109): Close fd99e712d029b1479ee16c3a0c467ce5 2023-02-09 20:55:43,393 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing fd99e712d029b1479ee16c3a0c467ce5, disabling compactions & flushes 2023-02-09 20:55:43,393 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region testCompactionWithHFileLink,,1675976119971.fd99e712d029b1479ee16c3a0c467ce5. 2023-02-09 20:55:43,393 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testCompactionWithHFileLink,,1675976119971.fd99e712d029b1479ee16c3a0c467ce5. 2023-02-09 20:55:43,393 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on testCompactionWithHFileLink,,1675976119971.fd99e712d029b1479ee16c3a0c467ce5. after waiting 0 ms 2023-02-09 20:55:43,393 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region testCompactionWithHFileLink,,1675976119971.fd99e712d029b1479ee16c3a0c467ce5. 2023-02-09 20:55:43,400 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-02-09 20:55:43,400 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed testCompactionWithHFileLink,,1675976119971.fd99e712d029b1479ee16c3a0c467ce5. 2023-02-09 20:55:43,400 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for fd99e712d029b1479ee16c3a0c467ce5: Waiting for close lock at 1675976143393Running coprocessor pre-close hooks at 1675976143393Disabling compacts and flushes for region at 1675976143393Disabling writes for close at 1675976143393Writing region close event to WAL at 1675976143397 (+4 ms)Running coprocessor post-close hooks at 1675976143400 (+3 ms)Closed at 1675976143400 2023-02-09 20:55:43,402 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(147): Closed fd99e712d029b1479ee16c3a0c467ce5 2023-02-09 20:55:43,402 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(109): Close 9dee656d29adb7e6b7d42a643b66b07b 2023-02-09 20:55:43,402 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing 9dee656d29adb7e6b7d42a643b66b07b, disabling compactions & flushes 2023-02-09 20:55:43,402 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region testCompactionWithHFileLink,2,1675976119971.9dee656d29adb7e6b7d42a643b66b07b. 2023-02-09 20:55:43,402 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1675976119971.9dee656d29adb7e6b7d42a643b66b07b. 2023-02-09 20:55:43,402 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on testCompactionWithHFileLink,2,1675976119971.9dee656d29adb7e6b7d42a643b66b07b. after waiting 0 ms 2023-02-09 20:55:43,402 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region testCompactionWithHFileLink,2,1675976119971.9dee656d29adb7e6b7d42a643b66b07b. 2023-02-09 20:55:43,402 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=89 updating hbase:meta row=fd99e712d029b1479ee16c3a0c467ce5, regionState=CLOSED 2023-02-09 20:55:43,402 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1675976119971.fd99e712d029b1479ee16c3a0c467ce5.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1675976143402"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675976143402"}]},"ts":"1675976143402"} 2023-02-09 20:55:43,406 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=94, resume processing ppid=89 2023-02-09 20:55:43,406 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=94, ppid=89, state=SUCCESS; CloseRegionProcedure fd99e712d029b1479ee16c3a0c467ce5, server=jenkins-hbase9.apache.org,40919,1675976022294 in 162 msec 2023-02-09 20:55:43,406 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-02-09 20:55:43,407 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=89, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=fd99e712d029b1479ee16c3a0c467ce5, UNASSIGN in 168 msec 2023-02-09 20:55:43,407 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed testCompactionWithHFileLink,2,1675976119971.9dee656d29adb7e6b7d42a643b66b07b. 2023-02-09 20:55:43,407 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for 9dee656d29adb7e6b7d42a643b66b07b: Waiting for close lock at 1675976143402Running coprocessor pre-close hooks at 1675976143402Disabling compacts and flushes for region at 1675976143402Disabling writes for close at 1675976143402Writing region close event to WAL at 1675976143404 (+2 ms)Running coprocessor post-close hooks at 1675976143407 (+3 ms)Closed at 1675976143407 2023-02-09 20:55:43,408 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(147): Closed 9dee656d29adb7e6b7d42a643b66b07b 2023-02-09 20:55:43,408 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(109): Close d3a98fcfad73ec6f98096a0e81049c21 2023-02-09 20:55:43,408 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing d3a98fcfad73ec6f98096a0e81049c21, disabling compactions & flushes 2023-02-09 20:55:43,408 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region testCompactionWithHFileLink,1,1675976119971.d3a98fcfad73ec6f98096a0e81049c21. 2023-02-09 20:55:43,408 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1675976119971.d3a98fcfad73ec6f98096a0e81049c21. 2023-02-09 20:55:43,408 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on testCompactionWithHFileLink,1,1675976119971.d3a98fcfad73ec6f98096a0e81049c21. after waiting 0 ms 2023-02-09 20:55:43,408 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region testCompactionWithHFileLink,1,1675976119971.d3a98fcfad73ec6f98096a0e81049c21. 2023-02-09 20:55:43,409 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=9dee656d29adb7e6b7d42a643b66b07b, regionState=CLOSED 2023-02-09 20:55:43,409 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1675976119971.9dee656d29adb7e6b7d42a643b66b07b.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1675976143409"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675976143409"}]},"ts":"1675976143409"} 2023-02-09 20:55:43,412 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=93, resume processing ppid=91 2023-02-09 20:55:43,412 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=93, ppid=91, state=SUCCESS; CloseRegionProcedure 9dee656d29adb7e6b7d42a643b66b07b, server=jenkins-hbase9.apache.org,40919,1675976022294 in 169 msec 2023-02-09 20:55:43,413 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=91, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=9dee656d29adb7e6b7d42a643b66b07b, UNASSIGN in 174 msec 2023-02-09 20:55:43,413 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-02-09 20:55:43,414 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed testCompactionWithHFileLink,1,1675976119971.d3a98fcfad73ec6f98096a0e81049c21. 2023-02-09 20:55:43,414 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for d3a98fcfad73ec6f98096a0e81049c21: Waiting for close lock at 1675976143408Running coprocessor pre-close hooks at 1675976143408Disabling compacts and flushes for region at 1675976143408Disabling writes for close at 1675976143408Writing region close event to WAL at 1675976143410 (+2 ms)Running coprocessor post-close hooks at 1675976143413 (+3 ms)Closed at 1675976143414 (+1 ms) 2023-02-09 20:55:43,415 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(147): Closed d3a98fcfad73ec6f98096a0e81049c21 2023-02-09 20:55:43,415 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=90 updating hbase:meta row=d3a98fcfad73ec6f98096a0e81049c21, regionState=CLOSED 2023-02-09 20:55:43,415 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1675976119971.d3a98fcfad73ec6f98096a0e81049c21.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1675976143415"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675976143415"}]},"ts":"1675976143415"} 2023-02-09 20:55:43,417 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=92, resume processing ppid=90 2023-02-09 20:55:43,417 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=92, ppid=90, state=SUCCESS; CloseRegionProcedure d3a98fcfad73ec6f98096a0e81049c21, server=jenkins-hbase9.apache.org,40919,1675976022294 in 175 msec 2023-02-09 20:55:43,418 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=90, resume processing ppid=88 2023-02-09 20:55:43,418 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=90, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=d3a98fcfad73ec6f98096a0e81049c21, UNASSIGN in 179 msec 2023-02-09 20:55:43,418 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675976143418"}]},"ts":"1675976143418"} 2023-02-09 20:55:43,419 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=DISABLED in hbase:meta 2023-02-09 20:55:43,420 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testCompactionWithHFileLink to state=DISABLED 2023-02-09 20:55:43,422 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=88, state=SUCCESS; DisableTableProcedure table=testCompactionWithHFileLink in 188 msec 2023-02-09 20:55:43,443 DEBUG [regionserver/jenkins-hbase9:0.Chore.1] throttle.PressureAwareCompactionThroughputController(103): CompactionPressure is 0.0, tune throughput to 50.00 MB/second 2023-02-09 20:55:43,537 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42951] master.MasterRpcServices(1227): Checking to see if procedure is done pid=88 2023-02-09 20:55:43,537 INFO [Listener at localhost/46855] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testCompactionWithHFileLink, procId: 88 completed 2023-02-09 20:55:43,550 INFO [Listener at localhost/46855] client.HBaseAdmin(2586): Taking restore-failsafe snapshot: hbase-failsafe-snaptb-1675976128854-1675976143550 2023-02-09 20:55:43,551 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42951] master.MasterRpcServices(1580): Client=jenkins//172.31.2.10 snapshot request for:{ ss=hbase-failsafe-snaptb-1675976128854-1675976143550 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-02-09 20:55:43,551 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42951] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1675976143551 (current time:1675976143551). 2023-02-09 20:55:43,551 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42951] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-09 20:55:43,552 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42951] zookeeper.ReadOnlyZKClient(139): Connect 0x0b241d6e to 127.0.0.1:62089 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 20:55:43,563 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42951] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4010c689, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 20:55:43,564 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42951] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 20:55:43,566 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:49986, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 20:55:43,566 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42951] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0b241d6e to 127.0.0.1:62089 2023-02-09 20:55:43,566 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42951] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 20:55:43,567 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42951] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-09 20:55:43,567 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42951] snapshot.SnapshotManager(659): Table is disabled, running snapshot entirely on master for { ss=hbase-failsafe-snaptb-1675976128854-1675976143550 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-02-09 20:55:43,569 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42951] procedure2.ProcedureExecutor(1029): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-02-09 20:55:43,570 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-02-09 20:55:43,570 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE; timeout=600000, timestamp=1675976743570 2023-02-09 20:55:43,570 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running DISABLED table snapshot hbase-failsafe-snaptb-1675976128854-1675976143550 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink 2023-02-09 20:55:43,570 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42951] snapshot.SnapshotManager(664): Started snapshot: { ss=hbase-failsafe-snaptb-1675976128854-1675976143550 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-02-09 20:55:43,571 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=hbase-failsafe-snaptb-1675976128854-1675976143550 table=testCompactionWithHFileLink type=FLUSH ttl=0 }'' to complete. (max 300000 ms per retry) 2023-02-09 20:55:43,571 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-09 20:55:43,671 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-09 20:55:43,672 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42951] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1675976128854-1675976143550 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-09 20:55:43,672 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42951] snapshot.SnapshotManager(404): Snapshoting '{ ss=hbase-failsafe-snaptb-1675976128854-1675976143550 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-02-09 20:55:43,672 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-09 20:55:43,873 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-09 20:55:43,873 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42951] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1675976128854-1675976143550 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-09 20:55:43,873 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42951] snapshot.SnapshotManager(404): Snapshoting '{ ss=hbase-failsafe-snaptb-1675976128854-1675976143550 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-02-09 20:55:43,874 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-02-09 20:55:43,977 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.DisabledTableSnapshotHandler(97): Starting to write region info and WALs for regions for offline snapshot:{ ss=hbase-failsafe-snaptb-1675976128854-1675976143550 table=testCompactionWithHFileLink type=DISABLED ttl=0 } 2023-02-09 20:55:43,979 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-02-09 20:55:43,979 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-02-09 20:55:43,979 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-02-09 20:55:43,979 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-02-09 20:55:43,979 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-02-09 20:55:43,979 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-02-09 20:55:43,979 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-02-09 20:55:43,979 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-02-09 20:55:43,982 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/family1/eb3c647f585e48769122ed0073f93e85, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/family1/fd074ec1e50f46829b7b383e85dc5614_SeqId_29_] hfiles 2023-02-09 20:55:43,982 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/family1/c5068aae90d54bb39fb50d8dc2851978, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/family1/e948ac72d95b4a3f908344b4be049e7c_SeqId_29_] hfiles 2023-02-09 20:55:43,982 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/family1/eb3c647f585e48769122ed0073f93e85 2023-02-09 20:55:43,982 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/family1/cc931e87e561475fac6707e9508d7933_SeqId_29_, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/family1/e6b1712da584424faeec552975e16ff3] hfiles 2023-02-09 20:55:43,982 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/family1/fd074ec1e50f46829b7b383e85dc5614_SeqId_29_ 2023-02-09 20:55:43,982 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/family1/c5068aae90d54bb39fb50d8dc2851978 2023-02-09 20:55:43,982 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/family1/cc931e87e561475fac6707e9508d7933_SeqId_29_ 2023-02-09 20:55:43,982 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/family1/e948ac72d95b4a3f908344b4be049e7c_SeqId_29_ 2023-02-09 20:55:43,982 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/family1/e6b1712da584424faeec552975e16ff3 2023-02-09 20:55:43,982 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023020975a49e0ffd5e40a2afb535f3c4fcf5c4, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023020922a5fbeae7464d709bf5216bbbd553ce, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230209ea3f2dd63eea4d359ff3486a7ca128ae] hfiles 2023-02-09 20:55:43,982 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (1/3): hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023020975a49e0ffd5e40a2afb535f3c4fcf5c4 2023-02-09 20:55:43,982 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (2/3): hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023020922a5fbeae7464d709bf5216bbbd553ce 2023-02-09 20:55:43,983 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (3/3): hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230209ea3f2dd63eea4d359ff3486a7ca128ae 2023-02-09 20:55:43,983 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/family2/449b624e34d3470baf3175b86d09ded4] hfiles 2023-02-09 20:55:43,983 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/family2/449b624e34d3470baf3175b86d09ded4 2023-02-09 20:55:43,983 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/family2/a730e56db52148d9935033f21c4c0c83] hfiles 2023-02-09 20:55:43,983 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/family2/a730e56db52148d9935033f21c4c0c83 2023-02-09 20:55:43,983 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/family2/49539e95f0cc437db1f981429c39b06b] hfiles 2023-02-09 20:55:43,983 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/family2/49539e95f0cc437db1f981429c39b06b 2023-02-09 20:55:43,988 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202302094002e9379daf4e94a0a0646dd285ab6b, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202302096811b8606a594674b41bdfc20708f28c_del, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202302096fe89508efe4423f8eaad35ebfde57f0, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230209c2970f41e4844e1eb3e0584ba3c96271, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230209cc36caad0b7c4eeb8a1a646a9c9c9d8e, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230209112df9ed6589400f8e173b856e29ffc1, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202302094c5a8e2c1dfe4a2e97768804a154fa62, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023020950c15f5f67a34a638959ccd2b5aa0fbe, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023020994b453d21a214a9b9d755efefcc93152_del, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230209a6fb2ff310114eb591e42d851abc9440, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202302095c5742f64ebb4297918a10abaf0e7d74, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230209a0e6e571016540d5a539c9a74d619e12, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230209b8b2bd45ed8d448e9e9a3bd52290cdf0, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230209baf731513ce1476690ee156f250822ff, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230209cdf97c35171443a888ec4056fbcaa500_del] hfiles 2023-02-09 20:55:43,988 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (1/15): hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202302094002e9379daf4e94a0a0646dd285ab6b 2023-02-09 20:55:43,989 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (2/15): hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202302096811b8606a594674b41bdfc20708f28c_del 2023-02-09 20:55:43,989 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (3/15): hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202302096fe89508efe4423f8eaad35ebfde57f0 2023-02-09 20:55:43,989 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (4/15): hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230209c2970f41e4844e1eb3e0584ba3c96271 2023-02-09 20:55:43,989 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (5/15): hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230209cc36caad0b7c4eeb8a1a646a9c9c9d8e 2023-02-09 20:55:43,989 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (6/15): hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230209112df9ed6589400f8e173b856e29ffc1 2023-02-09 20:55:43,989 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (7/15): hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202302094c5a8e2c1dfe4a2e97768804a154fa62 2023-02-09 20:55:43,989 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (8/15): hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023020950c15f5f67a34a638959ccd2b5aa0fbe 2023-02-09 20:55:43,989 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (9/15): hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023020994b453d21a214a9b9d755efefcc93152_del 2023-02-09 20:55:43,989 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (10/15): hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230209a6fb2ff310114eb591e42d851abc9440 2023-02-09 20:55:43,989 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (11/15): hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202302095c5742f64ebb4297918a10abaf0e7d74 2023-02-09 20:55:43,989 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (12/15): hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230209a0e6e571016540d5a539c9a74d619e12 2023-02-09 20:55:43,989 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (13/15): hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230209b8b2bd45ed8d448e9e9a3bd52290cdf0 2023-02-09 20:55:43,989 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (14/15): hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230209baf731513ce1476690ee156f250822ff 2023-02-09 20:55:43,989 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (15/15): hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230209cdf97c35171443a888ec4056fbcaa500_del 2023-02-09 20:55:44,174 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-09 20:55:44,175 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42951] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1675976128854-1675976143550 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-09 20:55:44,175 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42951] snapshot.SnapshotManager(404): Snapshoting '{ ss=hbase-failsafe-snaptb-1675976128854-1675976143550 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-02-09 20:55:44,175 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-02-09 20:55:44,395 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.DisabledTableSnapshotHandler(120): Marking snapshot{ ss=hbase-failsafe-snaptb-1675976128854-1675976143550 table=testCompactionWithHFileLink type=DISABLED ttl=0 } as finished. 2023-02-09 20:55:44,395 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for hbase-failsafe-snaptb-1675976128854-1675976143550 2023-02-09 20:55:44,395 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1675976128854-1675976143550 2023-02-09 20:55:44,675 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-09 20:55:44,676 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42951] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1675976128854-1675976143550 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-09 20:55:44,676 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42951] snapshot.SnapshotManager(404): Snapshoting '{ ss=hbase-failsafe-snaptb-1675976128854-1675976143550 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-02-09 20:55:44,676 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-02-09 20:55:44,822 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1675976128854-1675976143550 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/.hbase-snapshot/hbase-failsafe-snaptb-1675976128854-1675976143550 2023-02-09 20:55:45,237 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot hbase-failsafe-snaptb-1675976128854-1675976143550 of table testCompactionWithHFileLink completed 2023-02-09 20:55:45,237 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1675976128854-1675976143550 2023-02-09 20:55:45,237 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1675976128854-1675976143550 2023-02-09 20:55:45,237 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running DISABLED table snapshot hbase-failsafe-snaptb-1675976128854-1675976143550 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink at 1675976143570Starting to write region info and WALs for regions for offline snapshot:{ ss=hbase-failsafe-snaptb-1675976128854-1675976143550 table=testCompactionWithHFileLink type=DISABLED ttl=0 } at 1675976143977 (+407 ms)Consolidate snapshot: hbase-failsafe-snaptb-1675976128854-1675976143550 at 1675976144395 (+418 ms)Loading Region manifests for hbase-failsafe-snaptb-1675976128854-1675976143550 at 1675976144395Writing data manifest for hbase-failsafe-snaptb-1675976128854-1675976143550 at 1675976144398 (+3 ms)Verifying snapshot: hbase-failsafe-snaptb-1675976128854-1675976143550 at 1675976144805 (+407 ms)Snapshot hbase-failsafe-snaptb-1675976128854-1675976143550 of table testCompactionWithHFileLink completed at 1675976145237 (+432 ms) 2023-02-09 20:55:45,238 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-02-09 20:55:45,240 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE in 1.6700 sec 2023-02-09 20:55:45,676 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-09 20:55:45,677 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42951] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1675976128854-1675976143550 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-09 20:55:45,677 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42951] snapshot.SnapshotManager(401): Snapshot '{ ss=hbase-failsafe-snaptb-1675976128854-1675976143550 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-09 20:55:45,722 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42951] procedure2.ProcedureExecutor(1029): Stored pid=96, state=RUNNABLE:RESTORE_SNAPSHOT_PRE_OPERATION; RestoreSnapshotProcedure (table=testCompactionWithHFileLink snapshot=name: "snaptb-1675976128854" table: "testCompactionWithHFileLink" creation_time: 1675976128864 type: FLUSH version: 2 ttl: 0 ) 2023-02-09 20:55:45,723 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42951] snapshot.SnapshotManager(880): Restore snapshot=snaptb-1675976128854 as table=testCompactionWithHFileLink 2023-02-09 20:55:45,726 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42951] master.MasterRpcServices(1227): Checking to see if procedure is done pid=96 2023-02-09 20:55:45,733 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000002 2023-02-09 20:55:45,734 DEBUG [PEWorker-5] util.FSTableDescriptors(519): Deleted hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000001 2023-02-09 20:55:45,734 INFO [PEWorker-5] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000002 2023-02-09 20:55:45,735 INFO [PEWorker-5] procedure.RestoreSnapshotProcedure(374): Starting restore snapshot={ ss=snaptb-1675976128854 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-02-09 20:55:45,740 INFO [PEWorker-5] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "snaptb-1675976128854" table: "testCompactionWithHFileLink" creation_time: 1675976128864 type: FLUSH version: 2 ttl: 0 2023-02-09 20:55:45,741 DEBUG [PEWorker-5] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink 2023-02-09 20:55:45,745 DEBUG [PEWorker-5] snapshot.RestoreSnapshotHelper(797): found 3 regions for table=testCompactionWithHFileLink 2023-02-09 20:55:45,750 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023020975a49e0ffd5e40a2afb535f3c4fcf5c4 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023020975a49e0ffd5e40a2afb535f3c4fcf5c4 2023-02-09 20:55:45,752 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023020922a5fbeae7464d709bf5216bbbd553ce to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023020922a5fbeae7464d709bf5216bbbd553ce 2023-02-09 20:55:45,753 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230209ea3f2dd63eea4d359ff3486a7ca128ae to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230209ea3f2dd63eea4d359ff3486a7ca128ae 2023-02-09 20:55:45,753 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b202302090485249c391b4cb2996d41315057beec of snapshot=snaptb-1675976128854 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-09 20:55:45,759 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b2023020946d52341946546bfa2faa21026abbf30 of snapshot=snaptb-1675976128854 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-09 20:55:45,763 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b202302094cd195d47b5e4378b7b7e975c1569dbb of snapshot=snaptb-1675976128854 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-09 20:55:45,768 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b2023020981663a075738408e88cb9321c351aca7 of snapshot=snaptb-1675976128854 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-09 20:55:45,772 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c20230209314a0b9217254e10b80045e601857690 of snapshot=snaptb-1675976128854 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-09 20:55:45,776 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c202302093369568549a549bb98dc4decbc478266 of snapshot=snaptb-1675976128854 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-09 20:55:45,778 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c20230209a129990bcee74ab49e2421e438d1ff4b of snapshot=snaptb-1675976128854 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-09 20:55:45,782 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c20230209b1e9cbc26733498fb7dc0ad8994edf15 of snapshot=snaptb-1675976128854 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-09 20:55:45,785 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e2023020911445e993bcf46459549fcf84e73bd80 of snapshot=snaptb-1675976128854 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-09 20:55:45,788 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e202302093d7f1a01613642ecac1593478ee384b2 of snapshot=snaptb-1675976128854 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-09 20:55:45,791 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e20230209499d07c47b844887884c2cbec5562885 of snapshot=snaptb-1675976128854 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-09 20:55:45,795 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e20230209da15212355094b199ba61e702d11757b of snapshot=snaptb-1675976128854 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-09 20:55:45,800 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230209cdf97c35171443a888ec4056fbcaa500_del to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230209cdf97c35171443a888ec4056fbcaa500_del 2023-02-09 20:55:45,801 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023020994b453d21a214a9b9d755efefcc93152_del to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023020994b453d21a214a9b9d755efefcc93152_del 2023-02-09 20:55:45,803 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202302096811b8606a594674b41bdfc20708f28c_del to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202302096811b8606a594674b41bdfc20708f28c_del 2023-02-09 20:55:45,803 INFO [PEWorker-5] snapshot.RestoreSnapshotHelper(223): region to restore: 9dee656d29adb7e6b7d42a643b66b07b 2023-02-09 20:55:45,803 INFO [PEWorker-5] snapshot.RestoreSnapshotHelper(223): region to restore: d3a98fcfad73ec6f98096a0e81049c21 2023-02-09 20:55:45,803 INFO [PEWorker-5] snapshot.RestoreSnapshotHelper(223): region to restore: fd99e712d029b1479ee16c3a0c467ce5 2023-02-09 20:55:45,806 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/family1/e948ac72d95b4a3f908344b4be049e7c_SeqId_29_ to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/family1/e948ac72d95b4a3f908344b4be049e7c_SeqId_29_ 2023-02-09 20:55:45,807 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/family1/cc931e87e561475fac6707e9508d7933_SeqId_29_ to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/family1/cc931e87e561475fac6707e9508d7933_SeqId_29_ 2023-02-09 20:55:45,807 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/family1/fd074ec1e50f46829b7b383e85dc5614_SeqId_29_ to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/family1/fd074ec1e50f46829b7b383e85dc5614_SeqId_29_ 2023-02-09 20:55:45,808 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/family1/c5068aae90d54bb39fb50d8dc2851978 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/family1/c5068aae90d54bb39fb50d8dc2851978 2023-02-09 20:55:45,808 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 7adfdbfb53834874af61c06653ea05d9 of snapshot=snaptb-1675976128854 to region=fd99e712d029b1479ee16c3a0c467ce5 table=testCompactionWithHFileLink 2023-02-09 20:55:45,811 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/family1/eb3c647f585e48769122ed0073f93e85 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/family1/eb3c647f585e48769122ed0073f93e85 2023-02-09 20:55:45,811 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink cecce63cee614c1d85268b380746fc1f of snapshot=snaptb-1675976128854 to region=d3a98fcfad73ec6f98096a0e81049c21 table=testCompactionWithHFileLink 2023-02-09 20:55:45,811 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/family1/e6b1712da584424faeec552975e16ff3 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/family1/e6b1712da584424faeec552975e16ff3 2023-02-09 20:55:45,811 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 8dffd447500b40ddbcd436ec073020e4 of snapshot=snaptb-1675976128854 to region=9dee656d29adb7e6b7d42a643b66b07b table=testCompactionWithHFileLink 2023-02-09 20:55:45,818 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 8a4fd3c0e795466fb8bcb12d2e892fa5 of snapshot=snaptb-1675976128854 to region=fd99e712d029b1479ee16c3a0c467ce5 table=testCompactionWithHFileLink 2023-02-09 20:55:45,819 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 80d6aeca24eb4e5aaa2d1e2e3735b803 of snapshot=snaptb-1675976128854 to region=d3a98fcfad73ec6f98096a0e81049c21 table=testCompactionWithHFileLink 2023-02-09 20:55:45,820 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 19be0e30a8ed4401bdaaaf7a7dd9875a of snapshot=snaptb-1675976128854 to region=9dee656d29adb7e6b7d42a643b66b07b table=testCompactionWithHFileLink 2023-02-09 20:55:45,822 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 05d738ce288648c08cfdbfdd1fac4f25 of snapshot=snaptb-1675976128854 to region=fd99e712d029b1479ee16c3a0c467ce5 table=testCompactionWithHFileLink 2023-02-09 20:55:45,823 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink de4c1e2d17594300a65715819c3fd5fd of snapshot=snaptb-1675976128854 to region=d3a98fcfad73ec6f98096a0e81049c21 table=testCompactionWithHFileLink 2023-02-09 20:55:45,824 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink a457362d693044eab95c30a529dc1a9d of snapshot=snaptb-1675976128854 to region=9dee656d29adb7e6b7d42a643b66b07b table=testCompactionWithHFileLink 2023-02-09 20:55:45,827 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42951] master.MasterRpcServices(1227): Checking to see if procedure is done pid=96 2023-02-09 20:55:45,827 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink dfb7e51be254415f904bb5138d569daf of snapshot=snaptb-1675976128854 to region=d3a98fcfad73ec6f98096a0e81049c21 table=testCompactionWithHFileLink 2023-02-09 20:55:45,828 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 59e1b573d3c840b3905af50afe4a392c of snapshot=snaptb-1675976128854 to region=fd99e712d029b1479ee16c3a0c467ce5 table=testCompactionWithHFileLink 2023-02-09 20:55:45,828 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 30e774cd94d64d94a0e818dada82f5b4 of snapshot=snaptb-1675976128854 to region=9dee656d29adb7e6b7d42a643b66b07b table=testCompactionWithHFileLink 2023-02-09 20:55:45,837 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/family2/449b624e34d3470baf3175b86d09ded4 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/family2/449b624e34d3470baf3175b86d09ded4 2023-02-09 20:55:45,837 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink f62e3e2786aa4157a19aba13c6283944 of snapshot=snaptb-1675976128854 to region=d3a98fcfad73ec6f98096a0e81049c21 table=testCompactionWithHFileLink 2023-02-09 20:55:45,837 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/family2/a730e56db52148d9935033f21c4c0c83 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/family2/a730e56db52148d9935033f21c4c0c83 2023-02-09 20:55:45,837 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink b033bc8de43c48fe813afee249071e04 of snapshot=snaptb-1675976128854 to region=fd99e712d029b1479ee16c3a0c467ce5 table=testCompactionWithHFileLink 2023-02-09 20:55:45,837 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/family2/49539e95f0cc437db1f981429c39b06b to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/family2/49539e95f0cc437db1f981429c39b06b 2023-02-09 20:55:45,837 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 39383c1ed4b64edca22dee4cc20a06cd of snapshot=snaptb-1675976128854 to region=9dee656d29adb7e6b7d42a643b66b07b table=testCompactionWithHFileLink 2023-02-09 20:55:45,844 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 2965303a0eec417f93790a17caf709de of snapshot=snaptb-1675976128854 to region=fd99e712d029b1479ee16c3a0c467ce5 table=testCompactionWithHFileLink 2023-02-09 20:55:45,844 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 65d11bd220904c5ebb12875f70b36894 of snapshot=snaptb-1675976128854 to region=9dee656d29adb7e6b7d42a643b66b07b table=testCompactionWithHFileLink 2023-02-09 20:55:45,844 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 634ca6469094417da516e2df95ebc29a of snapshot=snaptb-1675976128854 to region=d3a98fcfad73ec6f98096a0e81049c21 table=testCompactionWithHFileLink 2023-02-09 20:55:45,847 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 5360d4e617fd4484833e455dcbfc891e of snapshot=snaptb-1675976128854 to region=fd99e712d029b1479ee16c3a0c467ce5 table=testCompactionWithHFileLink 2023-02-09 20:55:45,848 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink b03e6d792cd6417b9c3840efaceed27f of snapshot=snaptb-1675976128854 to region=9dee656d29adb7e6b7d42a643b66b07b table=testCompactionWithHFileLink 2023-02-09 20:55:45,849 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 89f4f2823dfa4779aee577ace6aee66e of snapshot=snaptb-1675976128854 to region=d3a98fcfad73ec6f98096a0e81049c21 table=testCompactionWithHFileLink 2023-02-09 20:55:45,851 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 5c5f9538d1734402a79d6449d0577cf3 of snapshot=snaptb-1675976128854 to region=9dee656d29adb7e6b7d42a643b66b07b table=testCompactionWithHFileLink 2023-02-09 20:55:45,851 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink cdbfdba21eb843e69d7a0678505b226e of snapshot=snaptb-1675976128854 to region=fd99e712d029b1479ee16c3a0c467ce5 table=testCompactionWithHFileLink 2023-02-09 20:55:45,852 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 9cb6df9bc6b944f89f1acc6aaa68461d of snapshot=snaptb-1675976128854 to region=d3a98fcfad73ec6f98096a0e81049c21 table=testCompactionWithHFileLink 2023-02-09 20:55:45,857 INFO [PEWorker-5] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "snaptb-1675976128854" table: "testCompactionWithHFileLink" creation_time: 1675976128864 type: FLUSH version: 2 ttl: 0 2023-02-09 20:55:45,858 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,2,1675976119971.9dee656d29adb7e6b7d42a643b66b07b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675976145858"}]},"ts":"9223372036854775807"} 2023-02-09 20:55:45,858 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,1,1675976119971.d3a98fcfad73ec6f98096a0e81049c21.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675976145858"}]},"ts":"9223372036854775807"} 2023-02-09 20:55:45,858 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,,1675976119971.fd99e712d029b1479ee16c3a0c467ce5.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675976145858"}]},"ts":"9223372036854775807"} 2023-02-09 20:55:45,860 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 3 regions from META 2023-02-09 20:55:45,860 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 9dee656d29adb7e6b7d42a643b66b07b, NAME => 'testCompactionWithHFileLink,2,1675976119971.9dee656d29adb7e6b7d42a643b66b07b.', STARTKEY => '2', ENDKEY => ''}, {ENCODED => d3a98fcfad73ec6f98096a0e81049c21, NAME => 'testCompactionWithHFileLink,1,1675976119971.d3a98fcfad73ec6f98096a0e81049c21.', STARTKEY => '1', ENDKEY => '2'}, {ENCODED => fd99e712d029b1479ee16c3a0c467ce5, NAME => 'testCompactionWithHFileLink,,1675976119971.fd99e712d029b1479ee16c3a0c467ce5.', STARTKEY => '', ENDKEY => '1'}] 2023-02-09 20:55:45,860 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1675976119971.9dee656d29adb7e6b7d42a643b66b07b.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1675976145859"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675976145859"}]},"ts":"1675976145859"} 2023-02-09 20:55:45,860 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1675976119971.d3a98fcfad73ec6f98096a0e81049c21.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1675976145859"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675976145859"}]},"ts":"1675976145859"} 2023-02-09 20:55:45,860 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1675976119971.fd99e712d029b1479ee16c3a0c467ce5.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1675976145859"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675976145859"}]},"ts":"1675976145859"} 2023-02-09 20:55:45,862 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-02-09 20:55:45,862 INFO [PEWorker-5] hbase.MetaTableAccessor(1810): Overwritten 3 regions to Meta 2023-02-09 20:55:45,862 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1811): Overwritten regions: [{ENCODED => 9dee656d29adb7e6b7d42a643b66b07b, NAME => 'testCompactionWithHFileLink,2,1675976119971.9dee656d29adb7e6b7d42a643b66b07b.', STARTKEY => '2', ENDKEY => ''}, {ENCODED => d3a98fcfad73ec6f98096a0e81049c21, NAME => 'testCompactionWithHFileLink,1,1675976119971.d3a98fcfad73ec6f98096a0e81049c21.', STARTKEY => '1', ENDKEY => '2'}, {ENCODED => fd99e712d029b1479ee16c3a0c467ce5, NAME => 'testCompactionWithHFileLink,,1675976119971.fd99e712d029b1479ee16c3a0c467ce5.', STARTKEY => '', ENDKEY => '1'}] 2023-02-09 20:55:45,863 INFO [PEWorker-5] procedure.RestoreSnapshotProcedure(447): Restore snapshot={ ss=snaptb-1675976128854 table=testCompactionWithHFileLink type=FLUSH ttl=0 } on table=testCompactionWithHFileLink completed! 2023-02-09 20:55:45,865 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=96, state=SUCCESS; RestoreSnapshotProcedure (table=testCompactionWithHFileLink snapshot=name: "snaptb-1675976128854" table: "testCompactionWithHFileLink" creation_time: 1675976128864 type: FLUSH version: 2 ttl: 0 ) in 150 msec 2023-02-09 20:55:46,028 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42951] master.MasterRpcServices(1227): Checking to see if procedure is done pid=96 2023-02-09 20:55:46,028 INFO [Listener at localhost/46855] client.HBaseAdmin$TableFuture(3541): Operation: MODIFY, Table Name: default:testCompactionWithHFileLink, procId: 96 completed 2023-02-09 20:55:46,028 INFO [Listener at localhost/46855] client.HBaseAdmin(2618): Deleting restore-failsafe snapshot: hbase-failsafe-snaptb-1675976128854-1675976143550 2023-02-09 20:55:46,032 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42951] master.MasterRpcServices(748): Client=jenkins//172.31.2.10 delete name: "hbase-failsafe-snaptb-1675976128854-1675976143550" 2023-02-09 20:55:46,034 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42951] snapshot.SnapshotManager(333): Deleting snapshot: hbase-failsafe-snaptb-1675976128854-1675976143550 2023-02-09 20:55:46,037 INFO [Listener at localhost/46855] client.HBaseAdmin$14(830): Started enable of testCompactionWithHFileLink 2023-02-09 20:55:46,041 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42951] master.HMaster$10(2372): Client=jenkins//172.31.2.10 enable testCompactionWithHFileLink 2023-02-09 20:55:46,046 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42951] procedure2.ProcedureExecutor(1029): Stored pid=97, state=RUNNABLE:ENABLE_TABLE_PREPARE; EnableTableProcedure table=testCompactionWithHFileLink 2023-02-09 20:55:46,049 INFO [PEWorker-4] procedure.EnableTableProcedure(296): Attempting to enable the table testCompactionWithHFileLink 2023-02-09 20:55:46,049 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42951] master.MasterRpcServices(1227): Checking to see if procedure is done pid=97 2023-02-09 20:55:46,049 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675976146049"}]},"ts":"1675976146049"} 2023-02-09 20:55:46,050 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLING in hbase:meta 2023-02-09 20:55:46,052 DEBUG [PEWorker-4] procedure.EnableTableProcedure(107): No change in number of region replicas (configuredReplicaCount=1); assigning. 2023-02-09 20:55:46,052 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=fd99e712d029b1479ee16c3a0c467ce5, ASSIGN}, {pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=d3a98fcfad73ec6f98096a0e81049c21, ASSIGN}, {pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=9dee656d29adb7e6b7d42a643b66b07b, ASSIGN}] 2023-02-09 20:55:46,053 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=d3a98fcfad73ec6f98096a0e81049c21, ASSIGN 2023-02-09 20:55:46,053 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=9dee656d29adb7e6b7d42a643b66b07b, ASSIGN 2023-02-09 20:55:46,054 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=fd99e712d029b1479ee16c3a0c467ce5, ASSIGN 2023-02-09 20:55:46,054 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=d3a98fcfad73ec6f98096a0e81049c21, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-02-09 20:55:46,054 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=9dee656d29adb7e6b7d42a643b66b07b, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-02-09 20:55:46,054 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=fd99e712d029b1479ee16c3a0c467ce5, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-02-09 20:55:46,150 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42951] master.MasterRpcServices(1227): Checking to see if procedure is done pid=97 2023-02-09 20:55:46,206 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=9dee656d29adb7e6b7d42a643b66b07b, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:46,206 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=99 updating hbase:meta row=d3a98fcfad73ec6f98096a0e81049c21, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:46,206 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=98 updating hbase:meta row=fd99e712d029b1479ee16c3a0c467ce5, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:46,206 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1675976119971.9dee656d29adb7e6b7d42a643b66b07b.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1675976146206"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675976146206"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675976146206"}]},"ts":"1675976146206"} 2023-02-09 20:55:46,206 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1675976119971.d3a98fcfad73ec6f98096a0e81049c21.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1675976146206"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675976146206"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675976146206"}]},"ts":"1675976146206"} 2023-02-09 20:55:46,206 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1675976119971.fd99e712d029b1479ee16c3a0c467ce5.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1675976146206"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675976146206"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675976146206"}]},"ts":"1675976146206"} 2023-02-09 20:55:46,207 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=101, ppid=100, state=RUNNABLE; OpenRegionProcedure 9dee656d29adb7e6b7d42a643b66b07b, server=jenkins-hbase9.apache.org,40919,1675976022294}] 2023-02-09 20:55:46,208 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=102, ppid=99, state=RUNNABLE; OpenRegionProcedure d3a98fcfad73ec6f98096a0e81049c21, server=jenkins-hbase9.apache.org,40919,1675976022294}] 2023-02-09 20:55:46,209 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=103, ppid=98, state=RUNNABLE; OpenRegionProcedure fd99e712d029b1479ee16c3a0c467ce5, server=jenkins-hbase9.apache.org,40919,1675976022294}] 2023-02-09 20:55:46,351 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42951] master.MasterRpcServices(1227): Checking to see if procedure is done pid=97 2023-02-09 20:55:46,361 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,,1675976119971.fd99e712d029b1479ee16c3a0c467ce5. 2023-02-09 20:55:46,361 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => fd99e712d029b1479ee16c3a0c467ce5, NAME => 'testCompactionWithHFileLink,,1675976119971.fd99e712d029b1479ee16c3a0c467ce5.', STARTKEY => '', ENDKEY => '1'} 2023-02-09 20:55:46,362 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink fd99e712d029b1479ee16c3a0c467ce5 2023-02-09 20:55:46,362 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated testCompactionWithHFileLink,,1675976119971.fd99e712d029b1479ee16c3a0c467ce5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 20:55:46,362 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for fd99e712d029b1479ee16c3a0c467ce5 2023-02-09 20:55:46,362 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for fd99e712d029b1479ee16c3a0c467ce5 2023-02-09 20:55:46,363 INFO [StoreOpener-fd99e712d029b1479ee16c3a0c467ce5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region fd99e712d029b1479ee16c3a0c467ce5 2023-02-09 20:55:46,364 DEBUG [StoreOpener-fd99e712d029b1479ee16c3a0c467ce5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/family1 2023-02-09 20:55:46,364 DEBUG [StoreOpener-fd99e712d029b1479ee16c3a0c467ce5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/family1 2023-02-09 20:55:46,364 INFO [StoreOpener-fd99e712d029b1479ee16c3a0c467ce5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fd99e712d029b1479ee16c3a0c467ce5 columnFamilyName family1 2023-02-09 20:55:46,378 DEBUG [StoreOpener-fd99e712d029b1479ee16c3a0c467ce5-1] regionserver.HStore(539): loaded hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/family1/testCompactionWithHFileLink=fd99e712d029b1479ee16c3a0c467ce5-05d738ce288648c08cfdbfdd1fac4f25 2023-02-09 20:55:46,383 DEBUG [StoreOpener-fd99e712d029b1479ee16c3a0c467ce5-1] regionserver.HStore(539): loaded hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/family1/testCompactionWithHFileLink=fd99e712d029b1479ee16c3a0c467ce5-59e1b573d3c840b3905af50afe4a392c 2023-02-09 20:55:46,388 DEBUG [StoreOpener-fd99e712d029b1479ee16c3a0c467ce5-1] regionserver.HStore(539): loaded hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/family1/testCompactionWithHFileLink=fd99e712d029b1479ee16c3a0c467ce5-7adfdbfb53834874af61c06653ea05d9 2023-02-09 20:55:46,392 DEBUG [StoreOpener-fd99e712d029b1479ee16c3a0c467ce5-1] regionserver.HStore(539): loaded hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/family1/testCompactionWithHFileLink=fd99e712d029b1479ee16c3a0c467ce5-8a4fd3c0e795466fb8bcb12d2e892fa5 2023-02-09 20:55:46,392 INFO [StoreOpener-fd99e712d029b1479ee16c3a0c467ce5-1] regionserver.HStore(310): Store=fd99e712d029b1479ee16c3a0c467ce5/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 20:55:46,392 INFO [StoreOpener-fd99e712d029b1479ee16c3a0c467ce5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region fd99e712d029b1479ee16c3a0c467ce5 2023-02-09 20:55:46,393 DEBUG [StoreOpener-fd99e712d029b1479ee16c3a0c467ce5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/family2 2023-02-09 20:55:46,393 DEBUG [StoreOpener-fd99e712d029b1479ee16c3a0c467ce5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/family2 2023-02-09 20:55:46,394 INFO [StoreOpener-fd99e712d029b1479ee16c3a0c467ce5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fd99e712d029b1479ee16c3a0c467ce5 columnFamilyName family2 2023-02-09 20:55:46,400 DEBUG [StoreOpener-fd99e712d029b1479ee16c3a0c467ce5-1] regionserver.HStore(539): loaded hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/family2/testCompactionWithHFileLink=fd99e712d029b1479ee16c3a0c467ce5-2965303a0eec417f93790a17caf709de 2023-02-09 20:55:46,407 DEBUG [StoreOpener-fd99e712d029b1479ee16c3a0c467ce5-1] regionserver.HStore(539): loaded hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/family2/testCompactionWithHFileLink=fd99e712d029b1479ee16c3a0c467ce5-5360d4e617fd4484833e455dcbfc891e 2023-02-09 20:55:46,413 DEBUG [StoreOpener-fd99e712d029b1479ee16c3a0c467ce5-1] regionserver.HStore(539): loaded hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/family2/testCompactionWithHFileLink=fd99e712d029b1479ee16c3a0c467ce5-b033bc8de43c48fe813afee249071e04 2023-02-09 20:55:46,418 DEBUG [StoreOpener-fd99e712d029b1479ee16c3a0c467ce5-1] regionserver.HStore(539): loaded hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/family2/testCompactionWithHFileLink=fd99e712d029b1479ee16c3a0c467ce5-cdbfdba21eb843e69d7a0678505b226e 2023-02-09 20:55:46,419 INFO [StoreOpener-fd99e712d029b1479ee16c3a0c467ce5-1] regionserver.HStore(310): Store=fd99e712d029b1479ee16c3a0c467ce5/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 20:55:46,419 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5 2023-02-09 20:55:46,420 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5 2023-02-09 20:55:46,422 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 20:55:46,423 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for fd99e712d029b1479ee16c3a0c467ce5 2023-02-09 20:55:46,424 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened fd99e712d029b1479ee16c3a0c467ce5; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74453489, jitterRate=0.10944344103336334}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 20:55:46,424 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for fd99e712d029b1479ee16c3a0c467ce5: Running coprocessor pre-open hook at 1675976146362Writing region info on filesystem at 1675976146362Initializing all the Stores at 1675976146363 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675976146363Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675976146363Cleaning up temporary data from old regions at 1675976146421 (+58 ms)Cleaning up detritus from prior splits at 1675976146421Running coprocessor post-open hooks at 1675976146424 (+3 ms)Region opened successfully at 1675976146424 2023-02-09 20:55:46,424 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,,1675976119971.fd99e712d029b1479ee16c3a0c467ce5., pid=103, masterSystemTime=1675976146359 2023-02-09 20:55:46,424 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-09 20:55:46,425 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-09 20:55:46,425 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-02-09 20:55:46,425 DEBUG [RS:0;jenkins-hbase9:40919-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-02-09 20:55:46,427 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,,1675976119971.fd99e712d029b1479ee16c3a0c467ce5. 2023-02-09 20:55:46,427 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,,1675976119971.fd99e712d029b1479ee16c3a0c467ce5. 2023-02-09 20:55:46,427 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,2,1675976119971.9dee656d29adb7e6b7d42a643b66b07b. 2023-02-09 20:55:46,427 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 9dee656d29adb7e6b7d42a643b66b07b, NAME => 'testCompactionWithHFileLink,2,1675976119971.9dee656d29adb7e6b7d42a643b66b07b.', STARTKEY => '2', ENDKEY => ''} 2023-02-09 20:55:46,427 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=98 updating hbase:meta row=fd99e712d029b1479ee16c3a0c467ce5, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:46,427 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 9dee656d29adb7e6b7d42a643b66b07b 2023-02-09 20:55:46,427 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,,1675976119971.fd99e712d029b1479ee16c3a0c467ce5.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1675976146427"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675976146427"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675976146427"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675976146427"}]},"ts":"1675976146427"} 2023-02-09 20:55:46,427 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated testCompactionWithHFileLink,2,1675976119971.9dee656d29adb7e6b7d42a643b66b07b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 20:55:46,427 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for 9dee656d29adb7e6b7d42a643b66b07b 2023-02-09 20:55:46,428 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for 9dee656d29adb7e6b7d42a643b66b07b 2023-02-09 20:55:46,428 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 22152 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-02-09 20:55:46,428 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] regionserver.HStore(1912): fd99e712d029b1479ee16c3a0c467ce5/family1 is initiating minor compaction (all files) 2023-02-09 20:55:46,428 DEBUG [RS:0;jenkins-hbase9:40919-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-02-09 20:55:46,428 INFO [RS:0;jenkins-hbase9:40919-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of fd99e712d029b1479ee16c3a0c467ce5/family1 in testCompactionWithHFileLink,,1675976119971.fd99e712d029b1479ee16c3a0c467ce5. 2023-02-09 20:55:46,428 DEBUG [RS:0;jenkins-hbase9:40919-longCompactions-0] regionserver.HStore(1912): fd99e712d029b1479ee16c3a0c467ce5/family2 is initiating minor compaction (all files) 2023-02-09 20:55:46,428 INFO [RS:0;jenkins-hbase9:40919-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/family1/testCompactionWithHFileLink=fd99e712d029b1479ee16c3a0c467ce5-7adfdbfb53834874af61c06653ea05d9, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/family1/testCompactionWithHFileLink=fd99e712d029b1479ee16c3a0c467ce5-8a4fd3c0e795466fb8bcb12d2e892fa5, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/family1/testCompactionWithHFileLink=fd99e712d029b1479ee16c3a0c467ce5-05d738ce288648c08cfdbfdd1fac4f25, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/family1/testCompactionWithHFileLink=fd99e712d029b1479ee16c3a0c467ce5-59e1b573d3c840b3905af50afe4a392c] into tmpdir=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/.tmp, totalSize=21.6 K 2023-02-09 20:55:46,428 INFO [RS:0;jenkins-hbase9:40919-longCompactions-0] regionserver.HRegion(2258): Starting compaction of fd99e712d029b1479ee16c3a0c467ce5/family2 in testCompactionWithHFileLink,,1675976119971.fd99e712d029b1479ee16c3a0c467ce5. 2023-02-09 20:55:46,428 INFO [RS:0;jenkins-hbase9:40919-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/family2/testCompactionWithHFileLink=fd99e712d029b1479ee16c3a0c467ce5-b033bc8de43c48fe813afee249071e04, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/family2/testCompactionWithHFileLink=fd99e712d029b1479ee16c3a0c467ce5-2965303a0eec417f93790a17caf709de, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/family2/testCompactionWithHFileLink=fd99e712d029b1479ee16c3a0c467ce5-5360d4e617fd4484833e455dcbfc891e, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/family2/testCompactionWithHFileLink=fd99e712d029b1479ee16c3a0c467ce5-cdbfdba21eb843e69d7a0678505b226e] into tmpdir=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/.tmp, totalSize=20.4 K 2023-02-09 20:55:46,429 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=fd99e712d029b1479ee16c3a0c467ce5-7adfdbfb53834874af61c06653ea05d9, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1675976122085 2023-02-09 20:55:46,429 INFO [StoreOpener-9dee656d29adb7e6b7d42a643b66b07b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 9dee656d29adb7e6b7d42a643b66b07b 2023-02-09 20:55:46,430 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=103, resume processing ppid=98 2023-02-09 20:55:46,430 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=103, ppid=98, state=SUCCESS; OpenRegionProcedure fd99e712d029b1479ee16c3a0c467ce5, server=jenkins-hbase9.apache.org,40919,1675976022294 in 220 msec 2023-02-09 20:55:46,431 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=98, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=fd99e712d029b1479ee16c3a0c467ce5, ASSIGN in 378 msec 2023-02-09 20:55:46,431 DEBUG [RS:0;jenkins-hbase9:40919-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=fd99e712d029b1479ee16c3a0c467ce5-b033bc8de43c48fe813afee249071e04, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1675976122085 2023-02-09 20:55:46,432 DEBUG [StoreOpener-9dee656d29adb7e6b7d42a643b66b07b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/family1 2023-02-09 20:55:46,432 DEBUG [StoreOpener-9dee656d29adb7e6b7d42a643b66b07b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/family1 2023-02-09 20:55:46,432 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=fd99e712d029b1479ee16c3a0c467ce5-8a4fd3c0e795466fb8bcb12d2e892fa5, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1675976123881 2023-02-09 20:55:46,432 DEBUG [RS:0;jenkins-hbase9:40919-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=fd99e712d029b1479ee16c3a0c467ce5-2965303a0eec417f93790a17caf709de, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1675976123881 2023-02-09 20:55:46,432 INFO [StoreOpener-9dee656d29adb7e6b7d42a643b66b07b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9dee656d29adb7e6b7d42a643b66b07b columnFamilyName family1 2023-02-09 20:55:46,433 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=fd99e712d029b1479ee16c3a0c467ce5-05d738ce288648c08cfdbfdd1fac4f25, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1675976125672 2023-02-09 20:55:46,433 DEBUG [RS:0;jenkins-hbase9:40919-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=fd99e712d029b1479ee16c3a0c467ce5-5360d4e617fd4484833e455dcbfc891e, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1675976125672 2023-02-09 20:55:46,434 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=fd99e712d029b1479ee16c3a0c467ce5-59e1b573d3c840b3905af50afe4a392c, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1675976127054 2023-02-09 20:55:46,435 DEBUG [RS:0;jenkins-hbase9:40919-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=fd99e712d029b1479ee16c3a0c467ce5-cdbfdba21eb843e69d7a0678505b226e, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1675976127054 2023-02-09 20:55:46,447 DEBUG [StoreOpener-9dee656d29adb7e6b7d42a643b66b07b-1] regionserver.HStore(539): loaded hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/family1/testCompactionWithHFileLink=9dee656d29adb7e6b7d42a643b66b07b-19be0e30a8ed4401bdaaaf7a7dd9875a 2023-02-09 20:55:46,456 DEBUG [StoreOpener-9dee656d29adb7e6b7d42a643b66b07b-1] regionserver.HStore(539): loaded hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/family1/testCompactionWithHFileLink=9dee656d29adb7e6b7d42a643b66b07b-30e774cd94d64d94a0e818dada82f5b4 2023-02-09 20:55:46,462 DEBUG [StoreOpener-9dee656d29adb7e6b7d42a643b66b07b-1] regionserver.HStore(539): loaded hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/family1/testCompactionWithHFileLink=9dee656d29adb7e6b7d42a643b66b07b-8dffd447500b40ddbcd436ec073020e4 2023-02-09 20:55:46,465 INFO [RS:0;jenkins-hbase9:40919-shortCompactions-0] throttle.PressureAwareThroughputController(145): fd99e712d029b1479ee16c3a0c467ce5#family1#compaction#113 average throughput is 0.78 MB/second, slept 0 time(s) and total slept time is 0 ms. 1 active operations remaining, total limit is 50.00 MB/second 2023-02-09 20:55:46,468 INFO [RS:0;jenkins-hbase9:40919-longCompactions-0] throttle.PressureAwareThroughputController(145): fd99e712d029b1479ee16c3a0c467ce5#family2#compaction#114 average throughput is 0.29 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-09 20:55:46,469 DEBUG [StoreOpener-9dee656d29adb7e6b7d42a643b66b07b-1] regionserver.HStore(539): loaded hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/family1/testCompactionWithHFileLink=9dee656d29adb7e6b7d42a643b66b07b-a457362d693044eab95c30a529dc1a9d 2023-02-09 20:55:46,469 INFO [StoreOpener-9dee656d29adb7e6b7d42a643b66b07b-1] regionserver.HStore(310): Store=9dee656d29adb7e6b7d42a643b66b07b/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 20:55:46,469 INFO [StoreOpener-9dee656d29adb7e6b7d42a643b66b07b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 9dee656d29adb7e6b7d42a643b66b07b 2023-02-09 20:55:46,470 DEBUG [StoreOpener-9dee656d29adb7e6b7d42a643b66b07b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/family2 2023-02-09 20:55:46,470 DEBUG [StoreOpener-9dee656d29adb7e6b7d42a643b66b07b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/family2 2023-02-09 20:55:46,470 INFO [StoreOpener-9dee656d29adb7e6b7d42a643b66b07b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9dee656d29adb7e6b7d42a643b66b07b columnFamilyName family2 2023-02-09 20:55:46,481 DEBUG [StoreOpener-9dee656d29adb7e6b7d42a643b66b07b-1] regionserver.HStore(539): loaded hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/family2/testCompactionWithHFileLink=9dee656d29adb7e6b7d42a643b66b07b-39383c1ed4b64edca22dee4cc20a06cd 2023-02-09 20:55:46,485 DEBUG [StoreOpener-9dee656d29adb7e6b7d42a643b66b07b-1] regionserver.HStore(539): loaded hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/family2/testCompactionWithHFileLink=9dee656d29adb7e6b7d42a643b66b07b-5c5f9538d1734402a79d6449d0577cf3 2023-02-09 20:55:46,489 DEBUG [StoreOpener-9dee656d29adb7e6b7d42a643b66b07b-1] regionserver.HStore(539): loaded hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/family2/testCompactionWithHFileLink=9dee656d29adb7e6b7d42a643b66b07b-65d11bd220904c5ebb12875f70b36894 2023-02-09 20:55:46,494 DEBUG [StoreOpener-9dee656d29adb7e6b7d42a643b66b07b-1] regionserver.HStore(539): loaded hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/family2/testCompactionWithHFileLink=9dee656d29adb7e6b7d42a643b66b07b-b03e6d792cd6417b9c3840efaceed27f 2023-02-09 20:55:46,495 INFO [StoreOpener-9dee656d29adb7e6b7d42a643b66b07b-1] regionserver.HStore(310): Store=9dee656d29adb7e6b7d42a643b66b07b/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 20:55:46,495 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b 2023-02-09 20:55:46,496 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b 2023-02-09 20:55:46,497 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 20:55:46,498 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for 9dee656d29adb7e6b7d42a643b66b07b 2023-02-09 20:55:46,499 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened 9dee656d29adb7e6b7d42a643b66b07b; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62522999, jitterRate=-0.06833471357822418}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 20:55:46,499 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for 9dee656d29adb7e6b7d42a643b66b07b: Running coprocessor pre-open hook at 1675976146428Writing region info on filesystem at 1675976146428Initializing all the Stores at 1675976146429 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675976146429Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675976146429Cleaning up temporary data from old regions at 1675976146497 (+68 ms)Cleaning up detritus from prior splits at 1675976146497Running coprocessor post-open hooks at 1675976146499 (+2 ms)Region opened successfully at 1675976146499 2023-02-09 20:55:46,500 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,2,1675976119971.9dee656d29adb7e6b7d42a643b66b07b., pid=101, masterSystemTime=1675976146359 2023-02-09 20:55:46,500 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-02-09 20:55:46,500 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=2), splitQueue=0 2023-02-09 20:55:46,501 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,2,1675976119971.9dee656d29adb7e6b7d42a643b66b07b. 2023-02-09 20:55:46,501 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,2,1675976119971.9dee656d29adb7e6b7d42a643b66b07b. 2023-02-09 20:55:46,501 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,1,1675976119971.d3a98fcfad73ec6f98096a0e81049c21. 2023-02-09 20:55:46,501 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => d3a98fcfad73ec6f98096a0e81049c21, NAME => 'testCompactionWithHFileLink,1,1675976119971.d3a98fcfad73ec6f98096a0e81049c21.', STARTKEY => '1', ENDKEY => '2'} 2023-02-09 20:55:46,501 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=9dee656d29adb7e6b7d42a643b66b07b, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:46,501 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink d3a98fcfad73ec6f98096a0e81049c21 2023-02-09 20:55:46,501 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,2,1675976119971.9dee656d29adb7e6b7d42a643b66b07b.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1675976146501"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675976146501"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675976146501"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675976146501"}]},"ts":"1675976146501"} 2023-02-09 20:55:46,501 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated testCompactionWithHFileLink,1,1675976119971.d3a98fcfad73ec6f98096a0e81049c21.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 20:55:46,502 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for d3a98fcfad73ec6f98096a0e81049c21 2023-02-09 20:55:46,502 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for d3a98fcfad73ec6f98096a0e81049c21 2023-02-09 20:55:46,502 INFO [StoreOpener-d3a98fcfad73ec6f98096a0e81049c21-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region d3a98fcfad73ec6f98096a0e81049c21 2023-02-09 20:55:46,503 DEBUG [StoreOpener-d3a98fcfad73ec6f98096a0e81049c21-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/family1 2023-02-09 20:55:46,503 DEBUG [StoreOpener-d3a98fcfad73ec6f98096a0e81049c21-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/family1 2023-02-09 20:55:46,504 INFO [StoreOpener-d3a98fcfad73ec6f98096a0e81049c21-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d3a98fcfad73ec6f98096a0e81049c21 columnFamilyName family1 2023-02-09 20:55:46,504 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=101, resume processing ppid=100 2023-02-09 20:55:46,504 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=101, ppid=100, state=SUCCESS; OpenRegionProcedure 9dee656d29adb7e6b7d42a643b66b07b, server=jenkins-hbase9.apache.org,40919,1675976022294 in 296 msec 2023-02-09 20:55:46,505 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=100, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=9dee656d29adb7e6b7d42a643b66b07b, ASSIGN in 452 msec 2023-02-09 20:55:46,509 DEBUG [StoreOpener-d3a98fcfad73ec6f98096a0e81049c21-1] regionserver.HStore(539): loaded hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/family1/testCompactionWithHFileLink=d3a98fcfad73ec6f98096a0e81049c21-80d6aeca24eb4e5aaa2d1e2e3735b803 2023-02-09 20:55:46,514 DEBUG [StoreOpener-d3a98fcfad73ec6f98096a0e81049c21-1] regionserver.HStore(539): loaded hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/family1/testCompactionWithHFileLink=d3a98fcfad73ec6f98096a0e81049c21-cecce63cee614c1d85268b380746fc1f 2023-02-09 20:55:46,518 DEBUG [StoreOpener-d3a98fcfad73ec6f98096a0e81049c21-1] regionserver.HStore(539): loaded hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/family1/testCompactionWithHFileLink=d3a98fcfad73ec6f98096a0e81049c21-de4c1e2d17594300a65715819c3fd5fd 2023-02-09 20:55:46,522 DEBUG [StoreOpener-d3a98fcfad73ec6f98096a0e81049c21-1] regionserver.HStore(539): loaded hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/family1/testCompactionWithHFileLink=d3a98fcfad73ec6f98096a0e81049c21-dfb7e51be254415f904bb5138d569daf 2023-02-09 20:55:46,523 INFO [StoreOpener-d3a98fcfad73ec6f98096a0e81049c21-1] regionserver.HStore(310): Store=d3a98fcfad73ec6f98096a0e81049c21/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 20:55:46,523 INFO [StoreOpener-d3a98fcfad73ec6f98096a0e81049c21-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region d3a98fcfad73ec6f98096a0e81049c21 2023-02-09 20:55:46,524 DEBUG [StoreOpener-d3a98fcfad73ec6f98096a0e81049c21-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/family2 2023-02-09 20:55:46,524 DEBUG [StoreOpener-d3a98fcfad73ec6f98096a0e81049c21-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/family2 2023-02-09 20:55:46,524 INFO [StoreOpener-d3a98fcfad73ec6f98096a0e81049c21-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d3a98fcfad73ec6f98096a0e81049c21 columnFamilyName family2 2023-02-09 20:55:46,530 DEBUG [StoreOpener-d3a98fcfad73ec6f98096a0e81049c21-1] regionserver.HStore(539): loaded hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/family2/testCompactionWithHFileLink=d3a98fcfad73ec6f98096a0e81049c21-634ca6469094417da516e2df95ebc29a 2023-02-09 20:55:46,535 DEBUG [StoreOpener-d3a98fcfad73ec6f98096a0e81049c21-1] regionserver.HStore(539): loaded hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/family2/testCompactionWithHFileLink=d3a98fcfad73ec6f98096a0e81049c21-89f4f2823dfa4779aee577ace6aee66e 2023-02-09 20:55:46,540 DEBUG [StoreOpener-d3a98fcfad73ec6f98096a0e81049c21-1] regionserver.HStore(539): loaded hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/family2/testCompactionWithHFileLink=d3a98fcfad73ec6f98096a0e81049c21-9cb6df9bc6b944f89f1acc6aaa68461d 2023-02-09 20:55:46,545 DEBUG [StoreOpener-d3a98fcfad73ec6f98096a0e81049c21-1] regionserver.HStore(539): loaded hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/family2/testCompactionWithHFileLink=d3a98fcfad73ec6f98096a0e81049c21-f62e3e2786aa4157a19aba13c6283944 2023-02-09 20:55:46,545 INFO [StoreOpener-d3a98fcfad73ec6f98096a0e81049c21-1] regionserver.HStore(310): Store=d3a98fcfad73ec6f98096a0e81049c21/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 20:55:46,546 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21 2023-02-09 20:55:46,547 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21 2023-02-09 20:55:46,548 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 20:55:46,549 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for d3a98fcfad73ec6f98096a0e81049c21 2023-02-09 20:55:46,550 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened d3a98fcfad73ec6f98096a0e81049c21; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73584440, jitterRate=0.09649360179901123}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 20:55:46,550 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for d3a98fcfad73ec6f98096a0e81049c21: Running coprocessor pre-open hook at 1675976146502Writing region info on filesystem at 1675976146502Initializing all the Stores at 1675976146502Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675976146502Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675976146502Cleaning up temporary data from old regions at 1675976146547 (+45 ms)Cleaning up detritus from prior splits at 1675976146548 (+1 ms)Running coprocessor post-open hooks at 1675976146550 (+2 ms)Region opened successfully at 1675976146550 2023-02-09 20:55:46,550 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,1,1675976119971.d3a98fcfad73ec6f98096a0e81049c21., pid=102, masterSystemTime=1675976146359 2023-02-09 20:55:46,550 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=3), splitQueue=0 2023-02-09 20:55:46,550 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=4), splitQueue=0 2023-02-09 20:55:46,552 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,1,1675976119971.d3a98fcfad73ec6f98096a0e81049c21. 2023-02-09 20:55:46,552 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,1,1675976119971.d3a98fcfad73ec6f98096a0e81049c21. 2023-02-09 20:55:46,552 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=99 updating hbase:meta row=d3a98fcfad73ec6f98096a0e81049c21, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:46,552 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,1,1675976119971.d3a98fcfad73ec6f98096a0e81049c21.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1675976146552"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675976146552"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675976146552"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675976146552"}]},"ts":"1675976146552"} 2023-02-09 20:55:46,555 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=102, resume processing ppid=99 2023-02-09 20:55:46,555 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=102, ppid=99, state=SUCCESS; OpenRegionProcedure d3a98fcfad73ec6f98096a0e81049c21, server=jenkins-hbase9.apache.org,40919,1675976022294 in 346 msec 2023-02-09 20:55:46,556 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=99, resume processing ppid=97 2023-02-09 20:55:46,556 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=99, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=d3a98fcfad73ec6f98096a0e81049c21, ASSIGN in 503 msec 2023-02-09 20:55:46,557 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675976146557"}]},"ts":"1675976146557"} 2023-02-09 20:55:46,558 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLED in hbase:meta 2023-02-09 20:55:46,560 INFO [PEWorker-1] procedure.EnableTableProcedure(310): Table 'testCompactionWithHFileLink' was successfully enabled. 2023-02-09 20:55:46,561 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=97, state=SUCCESS; EnableTableProcedure table=testCompactionWithHFileLink in 518 msec 2023-02-09 20:55:46,652 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42951] master.MasterRpcServices(1227): Checking to see if procedure is done pid=97 2023-02-09 20:55:46,652 INFO [Listener at localhost/46855] client.HBaseAdmin$TableFuture(3541): Operation: ENABLE, Table Name: default:testCompactionWithHFileLink, procId: 97 completed 2023-02-09 20:55:46,664 DEBUG [Listener at localhost/46855] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-09 20:55:46,670 DEBUG [Listener at localhost/46855] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-09 20:55:46,677 DEBUG [Listener at localhost/46855] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-09 20:55:46,678 DEBUG [Listener at localhost/46855] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-09 20:55:46,685 INFO [Listener at localhost/46855] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-02-09 20:55:46,699 INFO [Listener at localhost/46855] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 12 selected files, and 0 irrelevant files table 'testCompactionWithHFileLink' and column 'family1' 2023-02-09 20:55:46,699 INFO [Listener at localhost/46855] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testCompactionWithHFileLink' column='family1' 2023-02-09 20:55:46,699 DEBUG [Listener at localhost/46855] zookeeper.ReadOnlyZKClient(139): Connect 0x6c4447f6 to 127.0.0.1:62089 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 20:55:46,703 DEBUG [Listener at localhost/46855] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6f0e6704, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 20:55:46,704 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20230209 for table='testCompactionWithHFileLink' and column='family1' 2023-02-09 20:55:46,704 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20230209 for table='testCompactionWithHFileLink' and column='family1' 2023-02-09 20:55:46,704 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20230209 for table='testCompactionWithHFileLink' and column='family1' 2023-02-09 20:55:47,284 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/.tmp/family1/1f39268c45344009b4904f8907666a31 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/family1/1f39268c45344009b4904f8907666a31 2023-02-09 20:55:47,288 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testCompactionWithHFileLink' 2023-02-09 20:55:47,288 INFO [RS:0;jenkins-hbase9:40919-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in fd99e712d029b1479ee16c3a0c467ce5/family1 of fd99e712d029b1479ee16c3a0c467ce5 into 1f39268c45344009b4904f8907666a31(size=7.6 K), total size for store is 7.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-09 20:55:47,288 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for fd99e712d029b1479ee16c3a0c467ce5: 2023-02-09 20:55:47,288 INFO [RS:0;jenkins-hbase9:40919-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,,1675976119971.fd99e712d029b1479ee16c3a0c467ce5., storeName=fd99e712d029b1479ee16c3a0c467ce5/family1, priority=12, startTime=1675976146424; duration=0sec 2023-02-09 20:55:47,289 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=4), splitQueue=0 2023-02-09 20:55:47,289 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-02-09 20:55:47,291 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 22152 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-02-09 20:55:47,291 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] regionserver.HStore(1912): 9dee656d29adb7e6b7d42a643b66b07b/family1 is initiating minor compaction (all files) 2023-02-09 20:55:47,291 INFO [RS:0;jenkins-hbase9:40919-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 9dee656d29adb7e6b7d42a643b66b07b/family1 in testCompactionWithHFileLink,2,1675976119971.9dee656d29adb7e6b7d42a643b66b07b. 2023-02-09 20:55:47,291 INFO [RS:0;jenkins-hbase9:40919-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/family1/testCompactionWithHFileLink=9dee656d29adb7e6b7d42a643b66b07b-8dffd447500b40ddbcd436ec073020e4, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/family1/testCompactionWithHFileLink=9dee656d29adb7e6b7d42a643b66b07b-19be0e30a8ed4401bdaaaf7a7dd9875a, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/family1/testCompactionWithHFileLink=9dee656d29adb7e6b7d42a643b66b07b-a457362d693044eab95c30a529dc1a9d, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/family1/testCompactionWithHFileLink=9dee656d29adb7e6b7d42a643b66b07b-30e774cd94d64d94a0e818dada82f5b4] into tmpdir=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/.tmp, totalSize=21.6 K 2023-02-09 20:55:47,292 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=9dee656d29adb7e6b7d42a643b66b07b-8dffd447500b40ddbcd436ec073020e4, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1675976122087 2023-02-09 20:55:47,292 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=9dee656d29adb7e6b7d42a643b66b07b-19be0e30a8ed4401bdaaaf7a7dd9875a, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1675976123882 2023-02-09 20:55:47,293 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=9dee656d29adb7e6b7d42a643b66b07b-a457362d693044eab95c30a529dc1a9d, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1675976125672 2023-02-09 20:55:47,293 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=9dee656d29adb7e6b7d42a643b66b07b-30e774cd94d64d94a0e818dada82f5b4, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1675976127054 2023-02-09 20:55:47,304 INFO [RS:0;jenkins-hbase9:40919-shortCompactions-0] throttle.PressureAwareThroughputController(145): 9dee656d29adb7e6b7d42a643b66b07b#family1#compaction#115 average throughput is 1.17 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-09 20:55:47,378 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/family1/testCompactionWithHFileLink=fd99e712d029b1479ee16c3a0c467ce5-7adfdbfb53834874af61c06653ea05d9, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/family1/testCompactionWithHFileLink=fd99e712d029b1479ee16c3a0c467ce5-8a4fd3c0e795466fb8bcb12d2e892fa5, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/family1/testCompactionWithHFileLink=fd99e712d029b1479ee16c3a0c467ce5-05d738ce288648c08cfdbfdd1fac4f25, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/family1/testCompactionWithHFileLink=fd99e712d029b1479ee16c3a0c467ce5-59e1b573d3c840b3905af50afe4a392c] to archive 2023-02-09 20:55:47,379 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 20:55:47,380 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/family1/testCompactionWithHFileLink=fd99e712d029b1479ee16c3a0c467ce5-7adfdbfb53834874af61c06653ea05d9 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/family1/testCompactionWithHFileLink=fd99e712d029b1479ee16c3a0c467ce5-7adfdbfb53834874af61c06653ea05d9 2023-02-09 20:55:47,381 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/family1/testCompactionWithHFileLink=fd99e712d029b1479ee16c3a0c467ce5-8a4fd3c0e795466fb8bcb12d2e892fa5 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/family1/testCompactionWithHFileLink=fd99e712d029b1479ee16c3a0c467ce5-8a4fd3c0e795466fb8bcb12d2e892fa5 2023-02-09 20:55:47,382 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/family1/testCompactionWithHFileLink=fd99e712d029b1479ee16c3a0c467ce5-05d738ce288648c08cfdbfdd1fac4f25 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/family1/testCompactionWithHFileLink=fd99e712d029b1479ee16c3a0c467ce5-05d738ce288648c08cfdbfdd1fac4f25 2023-02-09 20:55:47,383 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/family1/testCompactionWithHFileLink=fd99e712d029b1479ee16c3a0c467ce5-59e1b573d3c840b3905af50afe4a392c to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/family1/testCompactionWithHFileLink=fd99e712d029b1479ee16c3a0c467ce5-59e1b573d3c840b3905af50afe4a392c 2023-02-09 20:55:47,576 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230209a3945a8ab27d4d1480c69deff1ff2ad1 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230209a3945a8ab27d4d1480c69deff1ff2ad1 2023-02-09 20:55:47,576 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230209db00321b3ab14cc889dd65321e24fec2 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230209db00321b3ab14cc889dd65321e24fec2 2023-02-09 20:55:47,577 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230209 table='testCompactionWithHFileLink' column='family1' 2023-02-09 20:55:47,577 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230209 table='testCompactionWithHFileLink' column='family1' 2023-02-09 20:55:47,580 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202302092f42161f2c0d45b4921470d3fc078371 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202302092f42161f2c0d45b4921470d3fc078371 2023-02-09 20:55:47,581 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230209 table='testCompactionWithHFileLink' column='family1' 2023-02-09 20:55:47,590 DEBUG [MobFileCompactionChore-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 20:55:47,594 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:49988, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 20:55:47,601 DEBUG [MobFileCompactionChore-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-09 20:55:47,609 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:38970, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-09 20:55:47,621 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230209/family1/7172ef2e365a4fefb308c8e0730cf55e first=Optional[1\x00\x00\x00\x00] last=Optional[1\x00\x00\x00\x07] 2023-02-09 20:55:47,621 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230209/family1/077da92ec46040b48253eced3378e77f first=Optional[2\x00\x00\x00\x00] last=Optional[2\x00\x00\x00\x07] 2023-02-09 20:55:47,621 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230209/family1/4cd05576927342dcb6f700bd6feddc61 first=Optional[0\x00\x00\x00\x00] last=Optional[0\x00\x00\x00\x07] 2023-02-09 20:55:47,622 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testCompactionWithHFileLink,1,1675976119971.d3a98fcfad73ec6f98096a0e81049c21., hostname=jenkins-hbase9.apache.org,40919,1675976022294, seqNum=32 for row 1 with hfile group [{family1,hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230209/family1/7172ef2e365a4fefb308c8e0730cf55e}] 2023-02-09 20:55:47,622 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testCompactionWithHFileLink,2,1675976119971.9dee656d29adb7e6b7d42a643b66b07b., hostname=jenkins-hbase9.apache.org,40919,1675976022294, seqNum=32 for row 2 with hfile group [{family1,hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230209/family1/077da92ec46040b48253eced3378e77f}] 2023-02-09 20:55:47,622 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testCompactionWithHFileLink,,1675976119971.fd99e712d029b1479ee16c3a0c467ce5., hostname=jenkins-hbase9.apache.org,40919,1675976022294, seqNum=32 for row with hfile group [{family1,hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230209/family1/4cd05576927342dcb6f700bd6feddc61}] 2023-02-09 20:55:47,627 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40919] regionserver.HStore(763): Validating hfile at hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230209/family1/4cd05576927342dcb6f700bd6feddc61 for inclusion in fd99e712d029b1479ee16c3a0c467ce5/family1 2023-02-09 20:55:47,627 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40919] regionserver.HStore(763): Validating hfile at hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230209/family1/077da92ec46040b48253eced3378e77f for inclusion in 9dee656d29adb7e6b7d42a643b66b07b/family1 2023-02-09 20:55:47,627 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HStore(763): Validating hfile at hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230209/family1/7172ef2e365a4fefb308c8e0730cf55e for inclusion in d3a98fcfad73ec6f98096a0e81049c21/family1 2023-02-09 20:55:47,630 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40919] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x00 last=0\x00\x00\x00\x07 2023-02-09 20:55:47,630 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40919] regionserver.HStore(777): Region bounds: first= last=1 2023-02-09 20:55:47,630 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x00 last=1\x00\x00\x00\x07 2023-02-09 20:55:47,630 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HStore(777): Region bounds: first=1 last=2 2023-02-09 20:55:47,630 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40919] regionserver.HRegion(2445): Flush status journal for fd99e712d029b1479ee16c3a0c467ce5: 2023-02-09 20:55:47,631 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HRegion(2445): Flush status journal for d3a98fcfad73ec6f98096a0e81049c21: 2023-02-09 20:55:47,631 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40919] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x00 last=2\x00\x00\x00\x07 2023-02-09 20:55:47,631 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40919] regionserver.HStore(777): Region bounds: first=2 last= 2023-02-09 20:55:47,631 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40919] regionserver.HRegion(2445): Flush status journal for 9dee656d29adb7e6b7d42a643b66b07b: 2023-02-09 20:55:47,632 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230209/family1/7172ef2e365a4fefb308c8e0730cf55e to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/staging/jenkins__testCompactionWithHFileLink__327db0oknsj2ja5cvme4erbtslvbg90uktikc2e79ul52l647tc0s4faejs30bhr/family1/7172ef2e365a4fefb308c8e0730cf55e 2023-02-09 20:55:47,632 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40919] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230209/family1/077da92ec46040b48253eced3378e77f to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/staging/jenkins__testCompactionWithHFileLink__rie2uouq8f06t2ova316vee4pelg5cmsv226qbhuueumhi7tcrbsb04qees66lro/family1/077da92ec46040b48253eced3378e77f 2023-02-09 20:55:47,632 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40919] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230209/family1/4cd05576927342dcb6f700bd6feddc61 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/staging/jenkins__testCompactionWithHFileLink__lhl8hsr017d5piiqrqcpvsut53rmsvnfql0ufchbp4fuv033b713paqo8f1rpj07/family1/4cd05576927342dcb6f700bd6feddc61 2023-02-09 20:55:47,634 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/staging/jenkins__testCompactionWithHFileLink__327db0oknsj2ja5cvme4erbtslvbg90uktikc2e79ul52l647tc0s4faejs30bhr/family1/7172ef2e365a4fefb308c8e0730cf55e as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/family1/28f9a72c22f94f069262e43d1bdcc38f_SeqId_34_ 2023-02-09 20:55:47,634 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40919] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/staging/jenkins__testCompactionWithHFileLink__rie2uouq8f06t2ova316vee4pelg5cmsv226qbhuueumhi7tcrbsb04qees66lro/family1/077da92ec46040b48253eced3378e77f as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/family1/54246692f1ba4daab01008bf10b7faa8_SeqId_34_ 2023-02-09 20:55:47,635 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40919] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/staging/jenkins__testCompactionWithHFileLink__lhl8hsr017d5piiqrqcpvsut53rmsvnfql0ufchbp4fuv033b713paqo8f1rpj07/family1/4cd05576927342dcb6f700bd6feddc61 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/family1/74d3e78276ff450ab4a886ea5ad07151_SeqId_35_ 2023-02-09 20:55:47,635 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HStore(849): Loaded HFile hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/staging/jenkins__testCompactionWithHFileLink__327db0oknsj2ja5cvme4erbtslvbg90uktikc2e79ul52l647tc0s4faejs30bhr/family1/7172ef2e365a4fefb308c8e0730cf55e into d3a98fcfad73ec6f98096a0e81049c21/family1 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/family1/28f9a72c22f94f069262e43d1bdcc38f_SeqId_34_ - updating store file list. 2023-02-09 20:55:47,635 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40919] regionserver.HStore(849): Loaded HFile hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/staging/jenkins__testCompactionWithHFileLink__rie2uouq8f06t2ova316vee4pelg5cmsv226qbhuueumhi7tcrbsb04qees66lro/family1/077da92ec46040b48253eced3378e77f into 9dee656d29adb7e6b7d42a643b66b07b/family1 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/family1/54246692f1ba4daab01008bf10b7faa8_SeqId_34_ - updating store file list. 2023-02-09 20:55:47,636 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40919] regionserver.HStore(849): Loaded HFile hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/staging/jenkins__testCompactionWithHFileLink__lhl8hsr017d5piiqrqcpvsut53rmsvnfql0ufchbp4fuv033b713paqo8f1rpj07/family1/4cd05576927342dcb6f700bd6feddc61 into fd99e712d029b1479ee16c3a0c467ce5/family1 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/family1/74d3e78276ff450ab4a886ea5ad07151_SeqId_35_ - updating store file list. 2023-02-09 20:55:47,639 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40919] regionserver.HStore(882): Loaded HFile hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/family1/54246692f1ba4daab01008bf10b7faa8_SeqId_34_ into 9dee656d29adb7e6b7d42a643b66b07b/family1 2023-02-09 20:55:47,639 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40919] regionserver.HStore(855): Successfully loaded hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/staging/jenkins__testCompactionWithHFileLink__rie2uouq8f06t2ova316vee4pelg5cmsv226qbhuueumhi7tcrbsb04qees66lro/family1/077da92ec46040b48253eced3378e77f into 9dee656d29adb7e6b7d42a643b66b07b/family1 (new location: hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/family1/54246692f1ba4daab01008bf10b7faa8_SeqId_34_) 2023-02-09 20:55:47,640 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40919] regionserver.HStore(882): Loaded HFile hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/family1/74d3e78276ff450ab4a886ea5ad07151_SeqId_35_ into fd99e712d029b1479ee16c3a0c467ce5/family1 2023-02-09 20:55:47,640 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40919] regionserver.HStore(855): Successfully loaded hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/staging/jenkins__testCompactionWithHFileLink__lhl8hsr017d5piiqrqcpvsut53rmsvnfql0ufchbp4fuv033b713paqo8f1rpj07/family1/4cd05576927342dcb6f700bd6feddc61 into fd99e712d029b1479ee16c3a0c467ce5/family1 (new location: hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/family1/74d3e78276ff450ab4a886ea5ad07151_SeqId_35_) 2023-02-09 20:55:47,640 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HStore(882): Loaded HFile hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/family1/28f9a72c22f94f069262e43d1bdcc38f_SeqId_34_ into d3a98fcfad73ec6f98096a0e81049c21/family1 2023-02-09 20:55:47,640 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40919] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/staging/jenkins__testCompactionWithHFileLink__rie2uouq8f06t2ova316vee4pelg5cmsv226qbhuueumhi7tcrbsb04qees66lro/family1/077da92ec46040b48253eced3378e77f 2023-02-09 20:55:47,640 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HStore(855): Successfully loaded hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/staging/jenkins__testCompactionWithHFileLink__327db0oknsj2ja5cvme4erbtslvbg90uktikc2e79ul52l647tc0s4faejs30bhr/family1/7172ef2e365a4fefb308c8e0730cf55e into d3a98fcfad73ec6f98096a0e81049c21/family1 (new location: hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/family1/28f9a72c22f94f069262e43d1bdcc38f_SeqId_34_) 2023-02-09 20:55:47,640 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40919] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/staging/jenkins__testCompactionWithHFileLink__lhl8hsr017d5piiqrqcpvsut53rmsvnfql0ufchbp4fuv033b713paqo8f1rpj07/family1/4cd05576927342dcb6f700bd6feddc61 2023-02-09 20:55:47,641 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/staging/jenkins__testCompactionWithHFileLink__327db0oknsj2ja5cvme4erbtslvbg90uktikc2e79ul52l647tc0s4faejs30bhr/family1/7172ef2e365a4fefb308c8e0730cf55e 2023-02-09 20:55:47,641 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-09 20:55:47,642 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230209 table='testCompactionWithHFileLink' column='family1' 2023-02-09 20:55:47,642 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230209 table='testCompactionWithHFileLink' column='family1' 2023-02-09 20:55:47,643 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 20:55:47,643 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 20:55:47,644 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 5 files of size 29606 starting at candidate #0 after considering 6 permutations with 6 in ratio 2023-02-09 20:55:47,644 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HStore(1912): d3a98fcfad73ec6f98096a0e81049c21/family1 is initiating minor compaction (all files) 2023-02-09 20:55:47,645 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@6368ac37; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=4), splitQueue=0 2023-02-09 20:55:47,645 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20230209314a0b9217254e10b80045e601857690 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20230209314a0b9217254e10b80045e601857690 2023-02-09 20:55:47,645 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e2023020911445e993bcf46459549fcf84e73bd80 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e2023020911445e993bcf46459549fcf84e73bd80 2023-02-09 20:55:47,646 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c202302093369568549a549bb98dc4decbc478266 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c202302093369568549a549bb98dc4decbc478266 2023-02-09 20:55:47,646 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e202302093d7f1a01613642ecac1593478ee384b2 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e202302093d7f1a01613642ecac1593478ee384b2 2023-02-09 20:55:47,646 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230209 table='testCompactionWithHFileLink' column='family1' 2023-02-09 20:55:47,647 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20230209a129990bcee74ab49e2421e438d1ff4b to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20230209a129990bcee74ab49e2421e438d1ff4b 2023-02-09 20:55:47,647 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20230209499d07c47b844887884c2cbec5562885 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20230209499d07c47b844887884c2cbec5562885 2023-02-09 20:55:47,648 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 20:55:47,649 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20230209b1e9cbc26733498fb7dc0ad8994edf15 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20230209b1e9cbc26733498fb7dc0ad8994edf15 2023-02-09 20:55:47,649 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-02-09 20:55:47,649 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20230209da15212355094b199ba61e702d11757b to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20230209da15212355094b199ba61e702d11757b 2023-02-09 20:55:47,649 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230209' 2023-02-09 20:55:47,649 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b202302090485249c391b4cb2996d41315057beec to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b202302090485249c391b4cb2996d41315057beec 2023-02-09 20:55:47,649 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-02-09 20:55:47,649 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230209' 2023-02-09 20:55:47,650 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20230209 for table='testCompactionWithHFileLink' and column='family1' 2023-02-09 20:55:47,650 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20230209 for table='testCompactionWithHFileLink' and column='family1' 2023-02-09 20:55:47,651 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b2023020946d52341946546bfa2faa21026abbf30 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b2023020946d52341946546bfa2faa21026abbf30 2023-02-09 20:55:47,652 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b202302094cd195d47b5e4378b7b7e975c1569dbb to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b202302094cd195d47b5e4378b7b7e975c1569dbb 2023-02-09 20:55:47,652 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b2023020981663a075738408e88cb9321c351aca7 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b2023020981663a075738408e88cb9321c351aca7 2023-02-09 20:55:47,653 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-02-09 20:55:47,653 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230209' 2023-02-09 20:55:47,653 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20230209 for table='testCompactionWithHFileLink' and column='family1' 2023-02-09 20:55:47,653 INFO [Listener at localhost/46855] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testCompactionWithHFileLink' column='family1' 2023-02-09 20:55:47,657 DEBUG [Listener at localhost/46855] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-09 20:55:47,660 DEBUG [Listener at localhost/46855] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-09 20:55:47,663 DEBUG [Listener at localhost/46855] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-09 20:55:47,665 DEBUG [Listener at localhost/46855] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-09 20:55:47,671 DEBUG [Listener at localhost/46855] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-09 20:55:47,672 DEBUG [Listener at localhost/46855] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-09 20:55:47,685 DEBUG [RS:0;jenkins-hbase9:40919-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/.tmp/family2/42b2025e5b8641aaad981847d439368b as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/family2/42b2025e5b8641aaad981847d439368b 2023-02-09 20:55:47,690 INFO [RS:0;jenkins-hbase9:40919-longCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in fd99e712d029b1479ee16c3a0c467ce5/family2 of fd99e712d029b1479ee16c3a0c467ce5 into 42b2025e5b8641aaad981847d439368b(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-09 20:55:47,690 DEBUG [RS:0;jenkins-hbase9:40919-longCompactions-0] regionserver.HRegion(2288): Compaction status journal for fd99e712d029b1479ee16c3a0c467ce5: 2023-02-09 20:55:47,690 INFO [RS:0;jenkins-hbase9:40919-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,,1675976119971.fd99e712d029b1479ee16c3a0c467ce5., storeName=fd99e712d029b1479ee16c3a0c467ce5/family2, priority=12, startTime=1675976146424; duration=1sec 2023-02-09 20:55:47,690 DEBUG [RS:0;jenkins-hbase9:40919-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=4), splitQueue=0 2023-02-09 20:55:47,691 INFO [RS:0;jenkins-hbase9:40919-longCompactions-0] regionserver.HRegion(2258): Starting compaction of d3a98fcfad73ec6f98096a0e81049c21/family1 in testCompactionWithHFileLink,1,1675976119971.d3a98fcfad73ec6f98096a0e81049c21. 2023-02-09 20:55:47,691 INFO [RS:0;jenkins-hbase9:40919-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/family1/testCompactionWithHFileLink=d3a98fcfad73ec6f98096a0e81049c21-cecce63cee614c1d85268b380746fc1f, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/family1/testCompactionWithHFileLink=d3a98fcfad73ec6f98096a0e81049c21-80d6aeca24eb4e5aaa2d1e2e3735b803, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/family1/testCompactionWithHFileLink=d3a98fcfad73ec6f98096a0e81049c21-de4c1e2d17594300a65715819c3fd5fd, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/family1/testCompactionWithHFileLink=d3a98fcfad73ec6f98096a0e81049c21-dfb7e51be254415f904bb5138d569daf, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/family1/28f9a72c22f94f069262e43d1bdcc38f_SeqId_34_] into tmpdir=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/.tmp, totalSize=28.9 K 2023-02-09 20:55:47,691 DEBUG [RS:0;jenkins-hbase9:40919-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=d3a98fcfad73ec6f98096a0e81049c21-cecce63cee614c1d85268b380746fc1f, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1675976122086 2023-02-09 20:55:47,692 DEBUG [RS:0;jenkins-hbase9:40919-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=d3a98fcfad73ec6f98096a0e81049c21-80d6aeca24eb4e5aaa2d1e2e3735b803, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1675976123882 2023-02-09 20:55:47,692 INFO [Listener at localhost/46855] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testCompactionWithHFileLink Thread=285 (was 236) - Thread LEAK? -, OpenFileDescriptor=760 (was 594) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=140 (was 100) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 168), AvailableMemoryMB=10519 (was 10640) 2023-02-09 20:55:47,696 DEBUG [RS:0;jenkins-hbase9:40919-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=d3a98fcfad73ec6f98096a0e81049c21-de4c1e2d17594300a65715819c3fd5fd, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1675976125672 2023-02-09 20:55:47,697 DEBUG [RS:0;jenkins-hbase9:40919-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=d3a98fcfad73ec6f98096a0e81049c21-dfb7e51be254415f904bb5138d569daf, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1675976127054 2023-02-09 20:55:47,697 DEBUG [RS:0;jenkins-hbase9:40919-longCompactions-0] compactions.Compactor(207): Compacting 28f9a72c22f94f069262e43d1bdcc38f_SeqId_34_, keycount=16, bloomtype=ROW, size=7.3 K, encoding=NONE, compression=NONE, seqNum=35, earliestPutTs=1675976122086 2023-02-09 20:55:47,704 INFO [Listener at localhost/46855] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompaction Thread=284, OpenFileDescriptor=760, MaxFileDescriptor=60000, SystemLoadAverage=140, ProcessCount=168, AvailableMemoryMB=10519 2023-02-09 20:55:47,710 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.HMaster$15(2997): Client=jenkins//172.31.2.10 creating {NAME => 'ns'} 2023-02-09 20:55:47,711 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure2.ProcedureExecutor(1029): Stored pid=104, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=ns 2023-02-09 20:55:47,716 INFO [RS:0;jenkins-hbase9:40919-longCompactions-0] throttle.PressureAwareThroughputController(145): d3a98fcfad73ec6f98096a0e81049c21#family1#compaction#116 average throughput is 0.33 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-09 20:55:47,720 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1227): Checking to see if procedure is done pid=104 2023-02-09 20:55:47,723 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-09 20:55:47,726 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=104, state=SUCCESS; CreateNamespaceProcedure, namespace=ns in 15 msec 2023-02-09 20:55:47,783 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/family2/testCompactionWithHFileLink=fd99e712d029b1479ee16c3a0c467ce5-b033bc8de43c48fe813afee249071e04, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/family2/testCompactionWithHFileLink=fd99e712d029b1479ee16c3a0c467ce5-2965303a0eec417f93790a17caf709de, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/family2/testCompactionWithHFileLink=fd99e712d029b1479ee16c3a0c467ce5-5360d4e617fd4484833e455dcbfc891e, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/family2/testCompactionWithHFileLink=fd99e712d029b1479ee16c3a0c467ce5-cdbfdba21eb843e69d7a0678505b226e] to archive 2023-02-09 20:55:47,784 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 20:55:47,785 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/family2/testCompactionWithHFileLink=fd99e712d029b1479ee16c3a0c467ce5-b033bc8de43c48fe813afee249071e04 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/family2/testCompactionWithHFileLink=fd99e712d029b1479ee16c3a0c467ce5-b033bc8de43c48fe813afee249071e04 2023-02-09 20:55:47,788 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/family2/testCompactionWithHFileLink=fd99e712d029b1479ee16c3a0c467ce5-2965303a0eec417f93790a17caf709de to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/family2/testCompactionWithHFileLink=fd99e712d029b1479ee16c3a0c467ce5-2965303a0eec417f93790a17caf709de 2023-02-09 20:55:47,789 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/family2/testCompactionWithHFileLink=fd99e712d029b1479ee16c3a0c467ce5-5360d4e617fd4484833e455dcbfc891e to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/family2/testCompactionWithHFileLink=fd99e712d029b1479ee16c3a0c467ce5-5360d4e617fd4484833e455dcbfc891e 2023-02-09 20:55:47,790 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/family2/testCompactionWithHFileLink=fd99e712d029b1479ee16c3a0c467ce5-cdbfdba21eb843e69d7a0678505b226e to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/family2/testCompactionWithHFileLink=fd99e712d029b1479ee16c3a0c467ce5-cdbfdba21eb843e69d7a0678505b226e 2023-02-09 20:55:47,820 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1227): Checking to see if procedure is done pid=104 2023-02-09 20:55:47,822 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.HMaster$4(2102): Client=jenkins//172.31.2.10 create 'ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-02-09 20:55:47,823 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure2.ProcedureExecutor(1029): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=ns:testMinorCompaction 2023-02-09 20:55:47,824 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_PRE_OPERATION 2023-02-09 20:55:47,825 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(697): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "ns" qualifier: "testMinorCompaction" procId is: 105 2023-02-09 20:55:47,825 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-09 20:55:47,825 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-02-09 20:55:47,827 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/.tmp/data/ns/testMinorCompaction/c01761bb5658622fd63528c8f312a31c 2023-02-09 20:55:47,830 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/.tmp/data/ns/testMinorCompaction/c01761bb5658622fd63528c8f312a31c empty. 2023-02-09 20:55:47,830 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/.tmp/data/ns/testMinorCompaction/1b246bc14d14521c9a184bb2e9c29b83 2023-02-09 20:55:47,831 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/.tmp/data/ns/testMinorCompaction/15bceddc51e736adeea65067f01af28b 2023-02-09 20:55:47,831 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/.tmp/data/ns/testMinorCompaction/c01761bb5658622fd63528c8f312a31c 2023-02-09 20:55:47,831 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/.tmp/data/ns/testMinorCompaction/1b246bc14d14521c9a184bb2e9c29b83 empty. 2023-02-09 20:55:47,831 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/.tmp/data/ns/testMinorCompaction/15bceddc51e736adeea65067f01af28b empty. 2023-02-09 20:55:47,831 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/.tmp/data/ns/testMinorCompaction/1b246bc14d14521c9a184bb2e9c29b83 2023-02-09 20:55:47,832 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/.tmp/data/ns/testMinorCompaction/15bceddc51e736adeea65067f01af28b 2023-02-09 20:55:47,832 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived ns:testMinorCompaction regions 2023-02-09 20:55:47,926 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-02-09 20:55:48,127 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-02-09 20:55:48,249 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/.tmp/data/ns/testMinorCompaction/.tabledesc/.tableinfo.0000000001 2023-02-09 20:55:48,251 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(7671): creating {ENCODED => c01761bb5658622fd63528c8f312a31c, NAME => 'ns:testMinorCompaction,,1675976147822.c01761bb5658622fd63528c8f312a31c.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/.tmp 2023-02-09 20:55:48,252 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(7671): creating {ENCODED => 15bceddc51e736adeea65067f01af28b, NAME => 'ns:testMinorCompaction,2,1675976147822.15bceddc51e736adeea65067f01af28b.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/.tmp 2023-02-09 20:55:48,252 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(7671): creating {ENCODED => 1b246bc14d14521c9a184bb2e9c29b83, NAME => 'ns:testMinorCompaction,1,1675976147822.1b246bc14d14521c9a184bb2e9c29b83.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/.tmp 2023-02-09 20:55:48,265 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(865): Instantiated ns:testMinorCompaction,,1675976147822.c01761bb5658622fd63528c8f312a31c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 20:55:48,265 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1603): Closing c01761bb5658622fd63528c8f312a31c, disabling compactions & flushes 2023-02-09 20:55:48,265 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1625): Closing region ns:testMinorCompaction,,1675976147822.c01761bb5658622fd63528c8f312a31c. 2023-02-09 20:55:48,265 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on ns:testMinorCompaction,,1675976147822.c01761bb5658622fd63528c8f312a31c. 2023-02-09 20:55:48,265 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1713): Acquired close lock on ns:testMinorCompaction,,1675976147822.c01761bb5658622fd63528c8f312a31c. after waiting 0 ms 2023-02-09 20:55:48,265 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1723): Updates disabled for region ns:testMinorCompaction,,1675976147822.c01761bb5658622fd63528c8f312a31c. 2023-02-09 20:55:48,266 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1837): Closed ns:testMinorCompaction,,1675976147822.c01761bb5658622fd63528c8f312a31c. 2023-02-09 20:55:48,266 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1557): Region close journal for c01761bb5658622fd63528c8f312a31c: Waiting for close lock at 1675976148265Disabling compacts and flushes for region at 1675976148265Disabling writes for close at 1675976148265Writing region close event to WAL at 1675976148265Closed at 1675976148265 2023-02-09 20:55:48,272 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(865): Instantiated ns:testMinorCompaction,1,1675976147822.1b246bc14d14521c9a184bb2e9c29b83.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 20:55:48,272 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1603): Closing 1b246bc14d14521c9a184bb2e9c29b83, disabling compactions & flushes 2023-02-09 20:55:48,272 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1625): Closing region ns:testMinorCompaction,1,1675976147822.1b246bc14d14521c9a184bb2e9c29b83. 2023-02-09 20:55:48,272 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on ns:testMinorCompaction,1,1675976147822.1b246bc14d14521c9a184bb2e9c29b83. 2023-02-09 20:55:48,272 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1713): Acquired close lock on ns:testMinorCompaction,1,1675976147822.1b246bc14d14521c9a184bb2e9c29b83. after waiting 0 ms 2023-02-09 20:55:48,273 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1723): Updates disabled for region ns:testMinorCompaction,1,1675976147822.1b246bc14d14521c9a184bb2e9c29b83. 2023-02-09 20:55:48,273 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1837): Closed ns:testMinorCompaction,1,1675976147822.1b246bc14d14521c9a184bb2e9c29b83. 2023-02-09 20:55:48,273 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1557): Region close journal for 1b246bc14d14521c9a184bb2e9c29b83: Waiting for close lock at 1675976148272Disabling compacts and flushes for region at 1675976148272Disabling writes for close at 1675976148273 (+1 ms)Writing region close event to WAL at 1675976148273Closed at 1675976148273 2023-02-09 20:55:48,428 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-02-09 20:55:48,527 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/.tmp/family1/aa7d62d253bf493181ca14e562ba1092 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/family1/aa7d62d253bf493181ca14e562ba1092 2023-02-09 20:55:48,533 INFO [RS:0;jenkins-hbase9:40919-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in 9dee656d29adb7e6b7d42a643b66b07b/family1 of 9dee656d29adb7e6b7d42a643b66b07b into aa7d62d253bf493181ca14e562ba1092(size=7.6 K), total size for store is 14.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-09 20:55:48,533 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 9dee656d29adb7e6b7d42a643b66b07b: 2023-02-09 20:55:48,533 INFO [RS:0;jenkins-hbase9:40919-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,2,1675976119971.9dee656d29adb7e6b7d42a643b66b07b., storeName=9dee656d29adb7e6b7d42a643b66b07b/family1, priority=12, startTime=1675976146500; duration=1sec 2023-02-09 20:55:48,533 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=3), splitQueue=0 2023-02-09 20:55:48,533 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-02-09 20:55:48,536 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-02-09 20:55:48,536 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] regionserver.HStore(1912): 9dee656d29adb7e6b7d42a643b66b07b/family2 is initiating minor compaction (all files) 2023-02-09 20:55:48,536 INFO [RS:0;jenkins-hbase9:40919-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 9dee656d29adb7e6b7d42a643b66b07b/family2 in testCompactionWithHFileLink,2,1675976119971.9dee656d29adb7e6b7d42a643b66b07b. 2023-02-09 20:55:48,536 INFO [RS:0;jenkins-hbase9:40919-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/family2/testCompactionWithHFileLink=9dee656d29adb7e6b7d42a643b66b07b-39383c1ed4b64edca22dee4cc20a06cd, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/family2/testCompactionWithHFileLink=9dee656d29adb7e6b7d42a643b66b07b-65d11bd220904c5ebb12875f70b36894, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/family2/testCompactionWithHFileLink=9dee656d29adb7e6b7d42a643b66b07b-b03e6d792cd6417b9c3840efaceed27f, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/family2/testCompactionWithHFileLink=9dee656d29adb7e6b7d42a643b66b07b-5c5f9538d1734402a79d6449d0577cf3] into tmpdir=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/.tmp, totalSize=20.4 K 2023-02-09 20:55:48,536 DEBUG [RS:0;jenkins-hbase9:40919-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/.tmp/family1/e0f8db891f0a46b5a06562ec525a1286 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/family1/e0f8db891f0a46b5a06562ec525a1286 2023-02-09 20:55:48,537 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=9dee656d29adb7e6b7d42a643b66b07b-39383c1ed4b64edca22dee4cc20a06cd, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1675976122087 2023-02-09 20:55:48,537 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=9dee656d29adb7e6b7d42a643b66b07b-65d11bd220904c5ebb12875f70b36894, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1675976123882 2023-02-09 20:55:48,538 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=9dee656d29adb7e6b7d42a643b66b07b-b03e6d792cd6417b9c3840efaceed27f, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1675976125672 2023-02-09 20:55:48,539 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=9dee656d29adb7e6b7d42a643b66b07b-5c5f9538d1734402a79d6449d0577cf3, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1675976127054 2023-02-09 20:55:48,541 INFO [RS:0;jenkins-hbase9:40919-longCompactions-0] regionserver.HStore(1652): Completed compaction of 5 (all) file(s) in d3a98fcfad73ec6f98096a0e81049c21/family1 of d3a98fcfad73ec6f98096a0e81049c21 into e0f8db891f0a46b5a06562ec525a1286(size=7.6 K), total size for store is 7.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-09 20:55:48,541 DEBUG [RS:0;jenkins-hbase9:40919-longCompactions-0] regionserver.HRegion(2288): Compaction status journal for d3a98fcfad73ec6f98096a0e81049c21: 2023-02-09 20:55:48,541 INFO [RS:0;jenkins-hbase9:40919-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testCompactionWithHFileLink,1,1675976119971.d3a98fcfad73ec6f98096a0e81049c21., storeName=family1, fileCount=5, fileSize=28.9 K (5.4 K, 5.4 K, 5.4 K, 5.4 K, 7.3 K), priority=2, time=1675976147644; duration=0sec 2023-02-09 20:55:48,541 DEBUG [RS:0;jenkins-hbase9:40919-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=2), splitQueue=0 2023-02-09 20:55:48,541 DEBUG [RS:0;jenkins-hbase9:40919-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-02-09 20:55:48,544 DEBUG [RS:0;jenkins-hbase9:40919-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-02-09 20:55:48,544 DEBUG [RS:0;jenkins-hbase9:40919-longCompactions-0] regionserver.HStore(1912): d3a98fcfad73ec6f98096a0e81049c21/family2 is initiating minor compaction (all files) 2023-02-09 20:55:48,544 INFO [RS:0;jenkins-hbase9:40919-longCompactions-0] regionserver.HRegion(2258): Starting compaction of d3a98fcfad73ec6f98096a0e81049c21/family2 in testCompactionWithHFileLink,1,1675976119971.d3a98fcfad73ec6f98096a0e81049c21. 2023-02-09 20:55:48,544 INFO [RS:0;jenkins-hbase9:40919-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/family2/testCompactionWithHFileLink=d3a98fcfad73ec6f98096a0e81049c21-f62e3e2786aa4157a19aba13c6283944, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/family2/testCompactionWithHFileLink=d3a98fcfad73ec6f98096a0e81049c21-634ca6469094417da516e2df95ebc29a, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/family2/testCompactionWithHFileLink=d3a98fcfad73ec6f98096a0e81049c21-89f4f2823dfa4779aee577ace6aee66e, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/family2/testCompactionWithHFileLink=d3a98fcfad73ec6f98096a0e81049c21-9cb6df9bc6b944f89f1acc6aaa68461d] into tmpdir=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/.tmp, totalSize=20.4 K 2023-02-09 20:55:48,544 DEBUG [RS:0;jenkins-hbase9:40919-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=d3a98fcfad73ec6f98096a0e81049c21-f62e3e2786aa4157a19aba13c6283944, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1675976122086 2023-02-09 20:55:48,545 DEBUG [RS:0;jenkins-hbase9:40919-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=d3a98fcfad73ec6f98096a0e81049c21-634ca6469094417da516e2df95ebc29a, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1675976123882 2023-02-09 20:55:48,546 DEBUG [RS:0;jenkins-hbase9:40919-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=d3a98fcfad73ec6f98096a0e81049c21-89f4f2823dfa4779aee577ace6aee66e, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1675976125672 2023-02-09 20:55:48,546 DEBUG [RS:0;jenkins-hbase9:40919-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=d3a98fcfad73ec6f98096a0e81049c21-9cb6df9bc6b944f89f1acc6aaa68461d, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1675976127054 2023-02-09 20:55:48,555 INFO [RS:0;jenkins-hbase9:40919-shortCompactions-0] throttle.PressureAwareThroughputController(145): 9dee656d29adb7e6b7d42a643b66b07b#family2#compaction#117 average throughput is 0.23 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-09 20:55:48,571 INFO [RS:0;jenkins-hbase9:40919-longCompactions-0] throttle.PressureAwareThroughputController(145): d3a98fcfad73ec6f98096a0e81049c21#family2#compaction#118 average throughput is 0.13 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-09 20:55:48,582 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/family1/testCompactionWithHFileLink=d3a98fcfad73ec6f98096a0e81049c21-cecce63cee614c1d85268b380746fc1f, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/family1/testCompactionWithHFileLink=d3a98fcfad73ec6f98096a0e81049c21-80d6aeca24eb4e5aaa2d1e2e3735b803, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/family1/testCompactionWithHFileLink=d3a98fcfad73ec6f98096a0e81049c21-de4c1e2d17594300a65715819c3fd5fd, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/family1/testCompactionWithHFileLink=d3a98fcfad73ec6f98096a0e81049c21-dfb7e51be254415f904bb5138d569daf, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/family1/28f9a72c22f94f069262e43d1bdcc38f_SeqId_34_] to archive 2023-02-09 20:55:48,583 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 20:55:48,584 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/family1/testCompactionWithHFileLink=d3a98fcfad73ec6f98096a0e81049c21-cecce63cee614c1d85268b380746fc1f to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/family1/testCompactionWithHFileLink=d3a98fcfad73ec6f98096a0e81049c21-cecce63cee614c1d85268b380746fc1f 2023-02-09 20:55:48,585 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/family1/testCompactionWithHFileLink=d3a98fcfad73ec6f98096a0e81049c21-80d6aeca24eb4e5aaa2d1e2e3735b803 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/family1/testCompactionWithHFileLink=d3a98fcfad73ec6f98096a0e81049c21-80d6aeca24eb4e5aaa2d1e2e3735b803 2023-02-09 20:55:48,586 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/family1/testCompactionWithHFileLink=d3a98fcfad73ec6f98096a0e81049c21-de4c1e2d17594300a65715819c3fd5fd to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/family1/testCompactionWithHFileLink=d3a98fcfad73ec6f98096a0e81049c21-de4c1e2d17594300a65715819c3fd5fd 2023-02-09 20:55:48,587 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/family1/testCompactionWithHFileLink=d3a98fcfad73ec6f98096a0e81049c21-dfb7e51be254415f904bb5138d569daf to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/family1/testCompactionWithHFileLink=d3a98fcfad73ec6f98096a0e81049c21-dfb7e51be254415f904bb5138d569daf 2023-02-09 20:55:48,588 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/family1/28f9a72c22f94f069262e43d1bdcc38f_SeqId_34_ to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/family1/28f9a72c22f94f069262e43d1bdcc38f_SeqId_34_ 2023-02-09 20:55:48,594 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/family1/testCompactionWithHFileLink=9dee656d29adb7e6b7d42a643b66b07b-8dffd447500b40ddbcd436ec073020e4, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/family1/testCompactionWithHFileLink=9dee656d29adb7e6b7d42a643b66b07b-19be0e30a8ed4401bdaaaf7a7dd9875a, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/family1/testCompactionWithHFileLink=9dee656d29adb7e6b7d42a643b66b07b-a457362d693044eab95c30a529dc1a9d, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/family1/testCompactionWithHFileLink=9dee656d29adb7e6b7d42a643b66b07b-30e774cd94d64d94a0e818dada82f5b4] to archive 2023-02-09 20:55:48,594 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 20:55:48,596 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/family1/testCompactionWithHFileLink=9dee656d29adb7e6b7d42a643b66b07b-8dffd447500b40ddbcd436ec073020e4 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/family1/testCompactionWithHFileLink=9dee656d29adb7e6b7d42a643b66b07b-8dffd447500b40ddbcd436ec073020e4 2023-02-09 20:55:48,597 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/family1/testCompactionWithHFileLink=9dee656d29adb7e6b7d42a643b66b07b-19be0e30a8ed4401bdaaaf7a7dd9875a to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/family1/testCompactionWithHFileLink=9dee656d29adb7e6b7d42a643b66b07b-19be0e30a8ed4401bdaaaf7a7dd9875a 2023-02-09 20:55:48,598 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/family1/testCompactionWithHFileLink=9dee656d29adb7e6b7d42a643b66b07b-a457362d693044eab95c30a529dc1a9d to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/family1/testCompactionWithHFileLink=9dee656d29adb7e6b7d42a643b66b07b-a457362d693044eab95c30a529dc1a9d 2023-02-09 20:55:48,598 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/family1/testCompactionWithHFileLink=9dee656d29adb7e6b7d42a643b66b07b-30e774cd94d64d94a0e818dada82f5b4 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/family1/testCompactionWithHFileLink=9dee656d29adb7e6b7d42a643b66b07b-30e774cd94d64d94a0e818dada82f5b4 2023-02-09 20:55:48,666 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(865): Instantiated ns:testMinorCompaction,2,1675976147822.15bceddc51e736adeea65067f01af28b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 20:55:48,666 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1603): Closing 15bceddc51e736adeea65067f01af28b, disabling compactions & flushes 2023-02-09 20:55:48,666 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1625): Closing region ns:testMinorCompaction,2,1675976147822.15bceddc51e736adeea65067f01af28b. 2023-02-09 20:55:48,666 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on ns:testMinorCompaction,2,1675976147822.15bceddc51e736adeea65067f01af28b. 2023-02-09 20:55:48,666 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1713): Acquired close lock on ns:testMinorCompaction,2,1675976147822.15bceddc51e736adeea65067f01af28b. after waiting 0 ms 2023-02-09 20:55:48,666 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1723): Updates disabled for region ns:testMinorCompaction,2,1675976147822.15bceddc51e736adeea65067f01af28b. 2023-02-09 20:55:48,666 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1837): Closed ns:testMinorCompaction,2,1675976147822.15bceddc51e736adeea65067f01af28b. 2023-02-09 20:55:48,666 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1557): Region close journal for 15bceddc51e736adeea65067f01af28b: Waiting for close lock at 1675976148666Disabling compacts and flushes for region at 1675976148666Disabling writes for close at 1675976148666Writing region close event to WAL at 1675976148666Closed at 1675976148666 2023-02-09 20:55:48,668 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_ADD_TO_META 2023-02-09 20:55:48,669 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,,1675976147822.c01761bb5658622fd63528c8f312a31c.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1675976148669"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675976148669"}]},"ts":"1675976148669"} 2023-02-09 20:55:48,669 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,1,1675976147822.1b246bc14d14521c9a184bb2e9c29b83.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1675976148669"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675976148669"}]},"ts":"1675976148669"} 2023-02-09 20:55:48,669 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,2,1675976147822.15bceddc51e736adeea65067f01af28b.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1675976148669"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675976148669"}]},"ts":"1675976148669"} 2023-02-09 20:55:48,671 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-02-09 20:55:48,671 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-09 20:55:48,671 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"ns:testMinorCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675976148671"}]},"ts":"1675976148671"} 2023-02-09 20:55:48,672 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=ns:testMinorCompaction, state=ENABLING in hbase:meta 2023-02-09 20:55:48,675 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=c01761bb5658622fd63528c8f312a31c, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=1b246bc14d14521c9a184bb2e9c29b83, ASSIGN}, {pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=15bceddc51e736adeea65067f01af28b, ASSIGN}] 2023-02-09 20:55:48,676 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=c01761bb5658622fd63528c8f312a31c, ASSIGN 2023-02-09 20:55:48,676 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=1b246bc14d14521c9a184bb2e9c29b83, ASSIGN 2023-02-09 20:55:48,677 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=15bceddc51e736adeea65067f01af28b, ASSIGN 2023-02-09 20:55:48,677 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=c01761bb5658622fd63528c8f312a31c, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,40919,1675976022294; forceNewPlan=false, retain=false 2023-02-09 20:55:48,677 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=1b246bc14d14521c9a184bb2e9c29b83, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,40919,1675976022294; forceNewPlan=false, retain=false 2023-02-09 20:55:48,677 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=15bceddc51e736adeea65067f01af28b, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,40919,1675976022294; forceNewPlan=false, retain=false 2023-02-09 20:55:48,829 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=108 updating hbase:meta row=15bceddc51e736adeea65067f01af28b, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:48,829 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=c01761bb5658622fd63528c8f312a31c, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:48,829 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=1b246bc14d14521c9a184bb2e9c29b83, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:48,830 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,,1675976147822.c01761bb5658622fd63528c8f312a31c.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1675976148829"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675976148829"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675976148829"}]},"ts":"1675976148829"} 2023-02-09 20:55:48,830 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,1,1675976147822.1b246bc14d14521c9a184bb2e9c29b83.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1675976148829"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675976148829"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675976148829"}]},"ts":"1675976148829"} 2023-02-09 20:55:48,830 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,2,1675976147822.15bceddc51e736adeea65067f01af28b.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1675976148829"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675976148829"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675976148829"}]},"ts":"1675976148829"} 2023-02-09 20:55:48,831 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=109, ppid=106, state=RUNNABLE; OpenRegionProcedure c01761bb5658622fd63528c8f312a31c, server=jenkins-hbase9.apache.org,40919,1675976022294}] 2023-02-09 20:55:48,831 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=110, ppid=107, state=RUNNABLE; OpenRegionProcedure 1b246bc14d14521c9a184bb2e9c29b83, server=jenkins-hbase9.apache.org,40919,1675976022294}] 2023-02-09 20:55:48,832 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=111, ppid=108, state=RUNNABLE; OpenRegionProcedure 15bceddc51e736adeea65067f01af28b, server=jenkins-hbase9.apache.org,40919,1675976022294}] 2023-02-09 20:55:48,929 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-02-09 20:55:48,934 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-09 20:55:48,985 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open ns:testMinorCompaction,1,1675976147822.1b246bc14d14521c9a184bb2e9c29b83. 2023-02-09 20:55:48,985 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1b246bc14d14521c9a184bb2e9c29b83, NAME => 'ns:testMinorCompaction,1,1675976147822.1b246bc14d14521c9a184bb2e9c29b83.', STARTKEY => '1', ENDKEY => '2'} 2023-02-09 20:55:48,985 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction 1b246bc14d14521c9a184bb2e9c29b83 2023-02-09 20:55:48,985 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated ns:testMinorCompaction,1,1675976147822.1b246bc14d14521c9a184bb2e9c29b83.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 20:55:48,985 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for 1b246bc14d14521c9a184bb2e9c29b83 2023-02-09 20:55:48,985 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for 1b246bc14d14521c9a184bb2e9c29b83 2023-02-09 20:55:48,986 INFO [StoreOpener-1b246bc14d14521c9a184bb2e9c29b83-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 1b246bc14d14521c9a184bb2e9c29b83 2023-02-09 20:55:48,988 DEBUG [StoreOpener-1b246bc14d14521c9a184bb2e9c29b83-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/1b246bc14d14521c9a184bb2e9c29b83/family1 2023-02-09 20:55:48,988 DEBUG [StoreOpener-1b246bc14d14521c9a184bb2e9c29b83-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/1b246bc14d14521c9a184bb2e9c29b83/family1 2023-02-09 20:55:48,988 INFO [StoreOpener-1b246bc14d14521c9a184bb2e9c29b83-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1b246bc14d14521c9a184bb2e9c29b83 columnFamilyName family1 2023-02-09 20:55:48,989 INFO [StoreOpener-1b246bc14d14521c9a184bb2e9c29b83-1] regionserver.HStore(310): Store=1b246bc14d14521c9a184bb2e9c29b83/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 20:55:48,989 INFO [StoreOpener-1b246bc14d14521c9a184bb2e9c29b83-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 1b246bc14d14521c9a184bb2e9c29b83 2023-02-09 20:55:48,990 DEBUG [StoreOpener-1b246bc14d14521c9a184bb2e9c29b83-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/1b246bc14d14521c9a184bb2e9c29b83/family2 2023-02-09 20:55:48,990 DEBUG [StoreOpener-1b246bc14d14521c9a184bb2e9c29b83-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/1b246bc14d14521c9a184bb2e9c29b83/family2 2023-02-09 20:55:48,990 INFO [StoreOpener-1b246bc14d14521c9a184bb2e9c29b83-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1b246bc14d14521c9a184bb2e9c29b83 columnFamilyName family2 2023-02-09 20:55:48,991 INFO [StoreOpener-1b246bc14d14521c9a184bb2e9c29b83-1] regionserver.HStore(310): Store=1b246bc14d14521c9a184bb2e9c29b83/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 20:55:48,992 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/1b246bc14d14521c9a184bb2e9c29b83 2023-02-09 20:55:48,992 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/1b246bc14d14521c9a184bb2e9c29b83 2023-02-09 20:55:48,993 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 20:55:48,994 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for 1b246bc14d14521c9a184bb2e9c29b83 2023-02-09 20:55:48,996 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/1b246bc14d14521c9a184bb2e9c29b83/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 20:55:48,996 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened 1b246bc14d14521c9a184bb2e9c29b83; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72264931, jitterRate=0.0768313854932785}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 20:55:48,996 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for 1b246bc14d14521c9a184bb2e9c29b83: Running coprocessor pre-open hook at 1675976148986Writing region info on filesystem at 1675976148986Initializing all the Stores at 1675976148986Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675976148986Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675976148986Cleaning up temporary data from old regions at 1675976148993 (+7 ms)Cleaning up detritus from prior splits at 1675976148993Running coprocessor post-open hooks at 1675976148996 (+3 ms)Region opened successfully at 1675976148996 2023-02-09 20:55:48,997 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for ns:testMinorCompaction,1,1675976147822.1b246bc14d14521c9a184bb2e9c29b83., pid=110, masterSystemTime=1675976148982 2023-02-09 20:55:48,998 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for ns:testMinorCompaction,1,1675976147822.1b246bc14d14521c9a184bb2e9c29b83. 2023-02-09 20:55:48,998 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened ns:testMinorCompaction,1,1675976147822.1b246bc14d14521c9a184bb2e9c29b83. 2023-02-09 20:55:48,998 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open ns:testMinorCompaction,2,1675976147822.15bceddc51e736adeea65067f01af28b. 2023-02-09 20:55:48,999 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 15bceddc51e736adeea65067f01af28b, NAME => 'ns:testMinorCompaction,2,1675976147822.15bceddc51e736adeea65067f01af28b.', STARTKEY => '2', ENDKEY => ''} 2023-02-09 20:55:48,999 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=1b246bc14d14521c9a184bb2e9c29b83, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:48,999 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,1,1675976147822.1b246bc14d14521c9a184bb2e9c29b83.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1675976148999"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675976148999"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675976148999"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675976148999"}]},"ts":"1675976148999"} 2023-02-09 20:55:48,999 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction 15bceddc51e736adeea65067f01af28b 2023-02-09 20:55:48,999 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated ns:testMinorCompaction,2,1675976147822.15bceddc51e736adeea65067f01af28b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 20:55:48,999 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for 15bceddc51e736adeea65067f01af28b 2023-02-09 20:55:48,999 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for 15bceddc51e736adeea65067f01af28b 2023-02-09 20:55:49,000 INFO [StoreOpener-15bceddc51e736adeea65067f01af28b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 15bceddc51e736adeea65067f01af28b 2023-02-09 20:55:49,001 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=110, resume processing ppid=107 2023-02-09 20:55:49,001 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=110, ppid=107, state=SUCCESS; OpenRegionProcedure 1b246bc14d14521c9a184bb2e9c29b83, server=jenkins-hbase9.apache.org,40919,1675976022294 in 169 msec 2023-02-09 20:55:49,002 DEBUG [StoreOpener-15bceddc51e736adeea65067f01af28b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/15bceddc51e736adeea65067f01af28b/family1 2023-02-09 20:55:49,002 DEBUG [StoreOpener-15bceddc51e736adeea65067f01af28b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/15bceddc51e736adeea65067f01af28b/family1 2023-02-09 20:55:49,002 INFO [StoreOpener-15bceddc51e736adeea65067f01af28b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 15bceddc51e736adeea65067f01af28b columnFamilyName family1 2023-02-09 20:55:49,002 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=1b246bc14d14521c9a184bb2e9c29b83, ASSIGN in 326 msec 2023-02-09 20:55:49,003 INFO [StoreOpener-15bceddc51e736adeea65067f01af28b-1] regionserver.HStore(310): Store=15bceddc51e736adeea65067f01af28b/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 20:55:49,003 INFO [StoreOpener-15bceddc51e736adeea65067f01af28b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 15bceddc51e736adeea65067f01af28b 2023-02-09 20:55:49,004 DEBUG [StoreOpener-15bceddc51e736adeea65067f01af28b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/15bceddc51e736adeea65067f01af28b/family2 2023-02-09 20:55:49,004 DEBUG [StoreOpener-15bceddc51e736adeea65067f01af28b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/15bceddc51e736adeea65067f01af28b/family2 2023-02-09 20:55:49,005 INFO [StoreOpener-15bceddc51e736adeea65067f01af28b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 15bceddc51e736adeea65067f01af28b columnFamilyName family2 2023-02-09 20:55:49,005 INFO [StoreOpener-15bceddc51e736adeea65067f01af28b-1] regionserver.HStore(310): Store=15bceddc51e736adeea65067f01af28b/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 20:55:49,006 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/15bceddc51e736adeea65067f01af28b 2023-02-09 20:55:49,007 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/15bceddc51e736adeea65067f01af28b 2023-02-09 20:55:49,008 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 20:55:49,009 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for 15bceddc51e736adeea65067f01af28b 2023-02-09 20:55:49,011 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/15bceddc51e736adeea65067f01af28b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 20:55:49,011 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened 15bceddc51e736adeea65067f01af28b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68819881, jitterRate=0.025496140122413635}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 20:55:49,011 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for 15bceddc51e736adeea65067f01af28b: Running coprocessor pre-open hook at 1675976148999Writing region info on filesystem at 1675976148999Initializing all the Stores at 1675976149000 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675976149000Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675976149000Cleaning up temporary data from old regions at 1675976149007 (+7 ms)Cleaning up detritus from prior splits at 1675976149007Running coprocessor post-open hooks at 1675976149011 (+4 ms)Region opened successfully at 1675976149011 2023-02-09 20:55:49,012 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for ns:testMinorCompaction,2,1675976147822.15bceddc51e736adeea65067f01af28b., pid=111, masterSystemTime=1675976148982 2023-02-09 20:55:49,013 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for ns:testMinorCompaction,2,1675976147822.15bceddc51e736adeea65067f01af28b. 2023-02-09 20:55:49,013 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened ns:testMinorCompaction,2,1675976147822.15bceddc51e736adeea65067f01af28b. 2023-02-09 20:55:49,013 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open ns:testMinorCompaction,,1675976147822.c01761bb5658622fd63528c8f312a31c. 2023-02-09 20:55:49,014 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => c01761bb5658622fd63528c8f312a31c, NAME => 'ns:testMinorCompaction,,1675976147822.c01761bb5658622fd63528c8f312a31c.', STARTKEY => '', ENDKEY => '1'} 2023-02-09 20:55:49,014 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=108 updating hbase:meta row=15bceddc51e736adeea65067f01af28b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:49,014 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction c01761bb5658622fd63528c8f312a31c 2023-02-09 20:55:49,014 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,2,1675976147822.15bceddc51e736adeea65067f01af28b.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1675976149014"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675976149014"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675976149014"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675976149014"}]},"ts":"1675976149014"} 2023-02-09 20:55:49,014 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated ns:testMinorCompaction,,1675976147822.c01761bb5658622fd63528c8f312a31c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 20:55:49,014 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for c01761bb5658622fd63528c8f312a31c 2023-02-09 20:55:49,014 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for c01761bb5658622fd63528c8f312a31c 2023-02-09 20:55:49,015 INFO [StoreOpener-c01761bb5658622fd63528c8f312a31c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region c01761bb5658622fd63528c8f312a31c 2023-02-09 20:55:49,016 DEBUG [StoreOpener-c01761bb5658622fd63528c8f312a31c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/c01761bb5658622fd63528c8f312a31c/family1 2023-02-09 20:55:49,016 DEBUG [StoreOpener-c01761bb5658622fd63528c8f312a31c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/c01761bb5658622fd63528c8f312a31c/family1 2023-02-09 20:55:49,016 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=111, resume processing ppid=108 2023-02-09 20:55:49,016 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=111, ppid=108, state=SUCCESS; OpenRegionProcedure 15bceddc51e736adeea65067f01af28b, server=jenkins-hbase9.apache.org,40919,1675976022294 in 183 msec 2023-02-09 20:55:49,017 INFO [StoreOpener-c01761bb5658622fd63528c8f312a31c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c01761bb5658622fd63528c8f312a31c columnFamilyName family1 2023-02-09 20:55:49,017 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=108, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=15bceddc51e736adeea65067f01af28b, ASSIGN in 341 msec 2023-02-09 20:55:49,017 INFO [StoreOpener-c01761bb5658622fd63528c8f312a31c-1] regionserver.HStore(310): Store=c01761bb5658622fd63528c8f312a31c/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 20:55:49,018 INFO [StoreOpener-c01761bb5658622fd63528c8f312a31c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region c01761bb5658622fd63528c8f312a31c 2023-02-09 20:55:49,019 DEBUG [StoreOpener-c01761bb5658622fd63528c8f312a31c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/c01761bb5658622fd63528c8f312a31c/family2 2023-02-09 20:55:49,019 DEBUG [StoreOpener-c01761bb5658622fd63528c8f312a31c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/c01761bb5658622fd63528c8f312a31c/family2 2023-02-09 20:55:49,019 INFO [StoreOpener-c01761bb5658622fd63528c8f312a31c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c01761bb5658622fd63528c8f312a31c columnFamilyName family2 2023-02-09 20:55:49,020 INFO [StoreOpener-c01761bb5658622fd63528c8f312a31c-1] regionserver.HStore(310): Store=c01761bb5658622fd63528c8f312a31c/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 20:55:49,020 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/c01761bb5658622fd63528c8f312a31c 2023-02-09 20:55:49,021 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/c01761bb5658622fd63528c8f312a31c 2023-02-09 20:55:49,022 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 20:55:49,023 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for c01761bb5658622fd63528c8f312a31c 2023-02-09 20:55:49,024 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/c01761bb5658622fd63528c8f312a31c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 20:55:49,025 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened c01761bb5658622fd63528c8f312a31c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65009384, jitterRate=-0.03128468990325928}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 20:55:49,025 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for c01761bb5658622fd63528c8f312a31c: Running coprocessor pre-open hook at 1675976149014Writing region info on filesystem at 1675976149014Initializing all the Stores at 1675976149015 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675976149015Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675976149015Cleaning up temporary data from old regions at 1675976149021 (+6 ms)Cleaning up detritus from prior splits at 1675976149021Running coprocessor post-open hooks at 1675976149025 (+4 ms)Region opened successfully at 1675976149025 2023-02-09 20:55:49,025 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for ns:testMinorCompaction,,1675976147822.c01761bb5658622fd63528c8f312a31c., pid=109, masterSystemTime=1675976148982 2023-02-09 20:55:49,026 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for ns:testMinorCompaction,,1675976147822.c01761bb5658622fd63528c8f312a31c. 2023-02-09 20:55:49,026 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened ns:testMinorCompaction,,1675976147822.c01761bb5658622fd63528c8f312a31c. 2023-02-09 20:55:49,027 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=c01761bb5658622fd63528c8f312a31c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:49,027 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,,1675976147822.c01761bb5658622fd63528c8f312a31c.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1675976149027"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675976149027"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675976149027"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675976149027"}]},"ts":"1675976149027"} 2023-02-09 20:55:49,029 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=109, resume processing ppid=106 2023-02-09 20:55:49,029 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=109, ppid=106, state=SUCCESS; OpenRegionProcedure c01761bb5658622fd63528c8f312a31c, server=jenkins-hbase9.apache.org,40919,1675976022294 in 197 msec 2023-02-09 20:55:49,030 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=106, resume processing ppid=105 2023-02-09 20:55:49,030 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=c01761bb5658622fd63528c8f312a31c, ASSIGN in 354 msec 2023-02-09 20:55:49,030 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-09 20:55:49,030 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"ns:testMinorCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675976149030"}]},"ts":"1675976149030"} 2023-02-09 20:55:49,031 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=ns:testMinorCompaction, state=ENABLED in hbase:meta 2023-02-09 20:55:49,034 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_POST_OPERATION 2023-02-09 20:55:49,035 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=105, state=SUCCESS; CreateTableProcedure table=ns:testMinorCompaction in 1.2120 sec 2023-02-09 20:55:49,431 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'ns:testMinorCompaction' 2023-02-09 20:55:49,777 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/.tmp/family2/e2240176471c4f7bbc2fe972aad18d4d as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/family2/e2240176471c4f7bbc2fe972aad18d4d 2023-02-09 20:55:49,781 INFO [RS:0;jenkins-hbase9:40919-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in 9dee656d29adb7e6b7d42a643b66b07b/family2 of 9dee656d29adb7e6b7d42a643b66b07b into e2240176471c4f7bbc2fe972aad18d4d(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-09 20:55:49,781 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 9dee656d29adb7e6b7d42a643b66b07b: 2023-02-09 20:55:49,781 INFO [RS:0;jenkins-hbase9:40919-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,2,1675976119971.9dee656d29adb7e6b7d42a643b66b07b., storeName=9dee656d29adb7e6b7d42a643b66b07b/family2, priority=12, startTime=1675976146500; duration=1sec 2023-02-09 20:55:49,781 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-02-09 20:55:49,781 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 1 store files, 0 compacting, 1 eligible, 16 blocking 2023-02-09 20:55:49,782 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 0 files of size 0 starting at candidate #-1 after considering 0 permutations with 0 in ratio 2023-02-09 20:55:49,782 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] compactions.SortedCompactionPolicy(232): Not compacting files because we only have 0 files ready for compaction. Need 3 to initiate. 2023-02-09 20:55:49,782 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] regionserver.CompactSplit(415): Not compacting testCompactionWithHFileLink,1,1675976119971.d3a98fcfad73ec6f98096a0e81049c21. because compaction request was cancelled 2023-02-09 20:55:49,785 DEBUG [RS:0;jenkins-hbase9:40919-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/.tmp/family2/71cb0c14cc864ef39f236312aa5e1e67 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/family2/71cb0c14cc864ef39f236312aa5e1e67 2023-02-09 20:55:49,789 INFO [RS:0;jenkins-hbase9:40919-longCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in d3a98fcfad73ec6f98096a0e81049c21/family2 of d3a98fcfad73ec6f98096a0e81049c21 into 71cb0c14cc864ef39f236312aa5e1e67(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-09 20:55:49,789 DEBUG [RS:0;jenkins-hbase9:40919-longCompactions-0] regionserver.HRegion(2288): Compaction status journal for d3a98fcfad73ec6f98096a0e81049c21: 2023-02-09 20:55:49,789 INFO [RS:0;jenkins-hbase9:40919-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,1,1675976119971.d3a98fcfad73ec6f98096a0e81049c21., storeName=d3a98fcfad73ec6f98096a0e81049c21/family2, priority=12, startTime=1675976146550; duration=1sec 2023-02-09 20:55:49,789 DEBUG [RS:0;jenkins-hbase9:40919-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-09 20:55:49,877 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/family2/testCompactionWithHFileLink=d3a98fcfad73ec6f98096a0e81049c21-f62e3e2786aa4157a19aba13c6283944, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/family2/testCompactionWithHFileLink=d3a98fcfad73ec6f98096a0e81049c21-634ca6469094417da516e2df95ebc29a, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/family2/testCompactionWithHFileLink=d3a98fcfad73ec6f98096a0e81049c21-89f4f2823dfa4779aee577ace6aee66e, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/family2/testCompactionWithHFileLink=d3a98fcfad73ec6f98096a0e81049c21-9cb6df9bc6b944f89f1acc6aaa68461d] to archive 2023-02-09 20:55:49,877 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 20:55:49,879 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/family2/testCompactionWithHFileLink=d3a98fcfad73ec6f98096a0e81049c21-f62e3e2786aa4157a19aba13c6283944 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/family2/testCompactionWithHFileLink=d3a98fcfad73ec6f98096a0e81049c21-f62e3e2786aa4157a19aba13c6283944 2023-02-09 20:55:49,880 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/family2/testCompactionWithHFileLink=d3a98fcfad73ec6f98096a0e81049c21-634ca6469094417da516e2df95ebc29a to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/family2/testCompactionWithHFileLink=d3a98fcfad73ec6f98096a0e81049c21-634ca6469094417da516e2df95ebc29a 2023-02-09 20:55:49,881 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/family2/testCompactionWithHFileLink=d3a98fcfad73ec6f98096a0e81049c21-89f4f2823dfa4779aee577ace6aee66e to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/family2/testCompactionWithHFileLink=d3a98fcfad73ec6f98096a0e81049c21-89f4f2823dfa4779aee577ace6aee66e 2023-02-09 20:55:49,882 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/family2/testCompactionWithHFileLink=d3a98fcfad73ec6f98096a0e81049c21-9cb6df9bc6b944f89f1acc6aaa68461d to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/family2/testCompactionWithHFileLink=d3a98fcfad73ec6f98096a0e81049c21-9cb6df9bc6b944f89f1acc6aaa68461d 2023-02-09 20:55:49,883 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/family2/testCompactionWithHFileLink=9dee656d29adb7e6b7d42a643b66b07b-39383c1ed4b64edca22dee4cc20a06cd, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/family2/testCompactionWithHFileLink=9dee656d29adb7e6b7d42a643b66b07b-65d11bd220904c5ebb12875f70b36894, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/family2/testCompactionWithHFileLink=9dee656d29adb7e6b7d42a643b66b07b-b03e6d792cd6417b9c3840efaceed27f, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/family2/testCompactionWithHFileLink=9dee656d29adb7e6b7d42a643b66b07b-5c5f9538d1734402a79d6449d0577cf3] to archive 2023-02-09 20:55:49,883 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 20:55:49,884 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/family2/testCompactionWithHFileLink=9dee656d29adb7e6b7d42a643b66b07b-39383c1ed4b64edca22dee4cc20a06cd to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/family2/testCompactionWithHFileLink=9dee656d29adb7e6b7d42a643b66b07b-39383c1ed4b64edca22dee4cc20a06cd 2023-02-09 20:55:49,885 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/family2/testCompactionWithHFileLink=9dee656d29adb7e6b7d42a643b66b07b-65d11bd220904c5ebb12875f70b36894 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/family2/testCompactionWithHFileLink=9dee656d29adb7e6b7d42a643b66b07b-65d11bd220904c5ebb12875f70b36894 2023-02-09 20:55:49,886 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/family2/testCompactionWithHFileLink=9dee656d29adb7e6b7d42a643b66b07b-b03e6d792cd6417b9c3840efaceed27f to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/family2/testCompactionWithHFileLink=9dee656d29adb7e6b7d42a643b66b07b-b03e6d792cd6417b9c3840efaceed27f 2023-02-09 20:55:49,887 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/family2/testCompactionWithHFileLink=9dee656d29adb7e6b7d42a643b66b07b-5c5f9538d1734402a79d6449d0577cf3 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/family2/testCompactionWithHFileLink=9dee656d29adb7e6b7d42a643b66b07b-5c5f9538d1734402a79d6449d0577cf3 2023-02-09 20:55:49,930 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-02-09 20:55:49,930 INFO [Listener at localhost/46855] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: ns:testMinorCompaction, procId: 105 completed 2023-02-09 20:55:49,935 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,,1675976147822.c01761bb5658622fd63528c8f312a31c. with WAL disabled. Data may be lost in the event of a crash. 2023-02-09 20:55:49,936 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,1,1675976147822.1b246bc14d14521c9a184bb2e9c29b83. with WAL disabled. Data may be lost in the event of a crash. 2023-02-09 20:55:49,936 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,2,1675976147822.15bceddc51e736adeea65067f01af28b. with WAL disabled. Data may be lost in the event of a crash. 2023-02-09 20:55:49,937 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(933): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-02-09 20:55:49,939 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-02-09 20:55:49,939 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-02-09 20:55:49,939 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:55:49,939 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-02-09 20:55:49,939 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-02-09 20:55:49,939 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-09 20:55:49,939 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-09 20:55:49,940 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:49,940 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:55:49,940 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:55:49,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:55:49,940 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:49,941 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 20:55:49,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-09 20:55:49,941 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-09 20:55:49,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 20:55:49,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-09 20:55:49,941 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-02-09 20:55:49,941 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-02-09 20:55:49,941 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-02-09 20:55:49,941 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:55:49,941 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-02-09 20:55:49,942 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1675976147822.c01761bb5658622fd63528c8f312a31c. 2023-02-09 20:55:49,942 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1675976147822.c01761bb5658622fd63528c8f312a31c. started... 2023-02-09 20:55:49,943 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing c01761bb5658622fd63528c8f312a31c 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-02-09 20:55:49,943 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-09 20:55:49,943 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 20:55:49,944 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1675976147822.1b246bc14d14521c9a184bb2e9c29b83. 2023-02-09 20:55:49,944 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1675976147822.1b246bc14d14521c9a184bb2e9c29b83. started... 2023-02-09 20:55:49,944 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 1b246bc14d14521c9a184bb2e9c29b83 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-02-09 20:55:49,944 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1675976147822.15bceddc51e736adeea65067f01af28b. 2023-02-09 20:55:49,944 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1675976147822.15bceddc51e736adeea65067f01af28b. started... 2023-02-09 20:55:49,944 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 15bceddc51e736adeea65067f01af28b 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-02-09 20:55:50,355 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202302093aab13a2a4ed4699bb8f149fb535cc6a to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e202302093aab13a2a4ed4699bb8f149fb535cc6a 2023-02-09 20:55:50,355 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023020980dc1d69530447c9a89e60b9b79007b3 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c2023020980dc1d69530447c9a89e60b9b79007b3 2023-02-09 20:55:50,355 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230209830a069bb8a743d9aa2bca0e41074f34 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20230209830a069bb8a743d9aa2bca0e41074f34 2023-02-09 20:55:50,360 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/15bceddc51e736adeea65067f01af28b/.tmp/family1/18055a08d6b541a7865b836ce136f473 2023-02-09 20:55:50,760 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/1b246bc14d14521c9a184bb2e9c29b83/.tmp/family1/eeb5a6e8a5ca4ef8a32a1589e8f58eb6 2023-02-09 20:55:50,760 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/c01761bb5658622fd63528c8f312a31c/.tmp/family1/a5a6266c974d4f7888398c0ca24bb806 2023-02-09 20:55:50,772 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302097eec2d8a578b4cf69fc2f71c54569058 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c202302097eec2d8a578b4cf69fc2f71c54569058 2023-02-09 20:55:50,782 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023020928bec45f120841c4b57972172761b00e to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e2023020928bec45f120841c4b57972172761b00e 2023-02-09 20:55:51,176 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230209b99f9d120e49470095bed4ca36f650ad to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b20230209b99f9d120e49470095bed4ca36f650ad 2023-02-09 20:55:51,182 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/15bceddc51e736adeea65067f01af28b/.tmp/family2/df96b7bd9ec54102b89b9dba06d9e181 2023-02-09 20:55:51,186 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/c01761bb5658622fd63528c8f312a31c/.tmp/family2/2f582487611b43ca8111c736d68ed187 2023-02-09 20:55:51,186 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/15bceddc51e736adeea65067f01af28b/.tmp/family1/18055a08d6b541a7865b836ce136f473 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/15bceddc51e736adeea65067f01af28b/family1/18055a08d6b541a7865b836ce136f473 2023-02-09 20:55:51,190 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/15bceddc51e736adeea65067f01af28b/family1/18055a08d6b541a7865b836ce136f473, entries=4, sequenceid=5, filesize=5.4 K 2023-02-09 20:55:51,191 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/c01761bb5658622fd63528c8f312a31c/.tmp/family1/a5a6266c974d4f7888398c0ca24bb806 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/c01761bb5658622fd63528c8f312a31c/family1/a5a6266c974d4f7888398c0ca24bb806 2023-02-09 20:55:51,191 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/15bceddc51e736adeea65067f01af28b/.tmp/family2/df96b7bd9ec54102b89b9dba06d9e181 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/15bceddc51e736adeea65067f01af28b/family2/df96b7bd9ec54102b89b9dba06d9e181 2023-02-09 20:55:51,194 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/c01761bb5658622fd63528c8f312a31c/family1/a5a6266c974d4f7888398c0ca24bb806, entries=4, sequenceid=5, filesize=5.4 K 2023-02-09 20:55:51,194 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/15bceddc51e736adeea65067f01af28b/family2/df96b7bd9ec54102b89b9dba06d9e181, entries=2, sequenceid=5, filesize=5.1 K 2023-02-09 20:55:51,195 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/c01761bb5658622fd63528c8f312a31c/.tmp/family2/2f582487611b43ca8111c736d68ed187 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/c01761bb5658622fd63528c8f312a31c/family2/2f582487611b43ca8111c736d68ed187 2023-02-09 20:55:51,196 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 15bceddc51e736adeea65067f01af28b in 1252ms, sequenceid=5, compaction requested=false 2023-02-09 20:55:51,197 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 15bceddc51e736adeea65067f01af28b: 2023-02-09 20:55:51,197 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1675976147822.15bceddc51e736adeea65067f01af28b. 2023-02-09 20:55:51,197 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-09 20:55:51,199 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/c01761bb5658622fd63528c8f312a31c/family2/2f582487611b43ca8111c736d68ed187, entries=2, sequenceid=5, filesize=5.1 K 2023-02-09 20:55:51,200 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for c01761bb5658622fd63528c8f312a31c in 1257ms, sequenceid=5, compaction requested=false 2023-02-09 20:55:51,200 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for c01761bb5658622fd63528c8f312a31c: 2023-02-09 20:55:51,200 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1675976147822.c01761bb5658622fd63528c8f312a31c. 2023-02-09 20:55:51,200 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-09 20:55:51,582 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/1b246bc14d14521c9a184bb2e9c29b83/.tmp/family2/40ee1301865f4ac6918954370f79ba2e 2023-02-09 20:55:51,586 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/1b246bc14d14521c9a184bb2e9c29b83/.tmp/family1/eeb5a6e8a5ca4ef8a32a1589e8f58eb6 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/1b246bc14d14521c9a184bb2e9c29b83/family1/eeb5a6e8a5ca4ef8a32a1589e8f58eb6 2023-02-09 20:55:51,589 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/1b246bc14d14521c9a184bb2e9c29b83/family1/eeb5a6e8a5ca4ef8a32a1589e8f58eb6, entries=4, sequenceid=5, filesize=5.4 K 2023-02-09 20:55:51,590 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/1b246bc14d14521c9a184bb2e9c29b83/.tmp/family2/40ee1301865f4ac6918954370f79ba2e as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/1b246bc14d14521c9a184bb2e9c29b83/family2/40ee1301865f4ac6918954370f79ba2e 2023-02-09 20:55:51,593 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/1b246bc14d14521c9a184bb2e9c29b83/family2/40ee1301865f4ac6918954370f79ba2e, entries=2, sequenceid=5, filesize=5.1 K 2023-02-09 20:55:51,594 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 1b246bc14d14521c9a184bb2e9c29b83 in 1650ms, sequenceid=5, compaction requested=false 2023-02-09 20:55:51,594 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 1b246bc14d14521c9a184bb2e9c29b83: 2023-02-09 20:55:51,594 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1675976147822.1b246bc14d14521c9a184bb2e9c29b83. 2023-02-09 20:55:51,594 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-09 20:55:51,594 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-09 20:55:51,594 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:51,594 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-02-09 20:55:51,594 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-02-09 20:55:51,597 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:51,597 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-09 20:55:51,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:51,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:55:51,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:55:51,597 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-09 20:55:51,597 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 20:55:51,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:55:51,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:55:51,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-09 20:55:51,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:51,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:55:51,598 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-02-09 20:55:51,598 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@56f7967f[Count = 0] remaining members to acquire global barrier 2023-02-09 20:55:51,598 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-02-09 20:55:51,599 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-09 20:55:51,599 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-09 20:55:51,600 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-09 20:55:51,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-09 20:55:51,600 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-02-09 20:55:51,600 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-02-09 20:55:51,600 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase9.apache.org,40919,1675976022294' in zk 2023-02-09 20:55:51,600 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:51,600 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 20:55:51,601 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-02-09 20:55:51,601 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:55:51,601 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:51,601 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-02-09 20:55:51,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:51,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:55:51,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:55:51,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:55:51,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:55:51,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-09 20:55:51,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:51,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:55:51,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-09 20:55:51,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:51,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase9.apache.org,40919,1675976022294': 2023-02-09 20:55:51,603 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-02-09 20:55:51,603 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-02-09 20:55:51,603 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 20:55:51,603 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 20:55:51,603 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-02-09 20:55:51,603 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 20:55:51,604 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-09 20:55:51,604 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-09 20:55:51,604 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:55:51,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-09 20:55:51,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:55:51,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:55:51,604 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-09 20:55:51,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-09 20:55:51,605 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:51,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:55:51,605 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:55:51,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:55:51,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-09 20:55:51,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-09 20:55:51,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:55:51,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-09 20:55:51,606 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:51,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:51,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:55:51,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-09 20:55:51,609 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:51,609 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:55:51,609 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-09 20:55:51,609 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:55:51,609 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-09 20:55:51,609 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-02-09 20:55:51,609 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 20:55:51,609 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:55:51,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:55:51,609 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:55:51,609 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-02-09 20:55:51,609 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:51,609 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-02-09 20:55:51,609 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:55:51,609 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 20:55:51,609 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-09 20:55:51,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:55:51,609 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-09 20:55:51,610 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-09 20:55:51,710 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 20:55:51,710 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 20:55:51,711 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,,1675976147822.c01761bb5658622fd63528c8f312a31c. with WAL disabled. Data may be lost in the event of a crash. 2023-02-09 20:55:51,711 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,1,1675976147822.1b246bc14d14521c9a184bb2e9c29b83. with WAL disabled. Data may be lost in the event of a crash. 2023-02-09 20:55:51,712 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,2,1675976147822.15bceddc51e736adeea65067f01af28b. with WAL disabled. Data may be lost in the event of a crash. 2023-02-09 20:55:51,713 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(933): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-02-09 20:55:51,715 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-02-09 20:55:51,715 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-02-09 20:55:51,715 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-02-09 20:55:51,715 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:55:51,715 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-02-09 20:55:51,715 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-02-09 20:55:51,716 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-09 20:55:51,716 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-09 20:55:51,717 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:51,717 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:55:51,717 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:55:51,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:55:51,717 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:51,717 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 20:55:51,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-09 20:55:51,717 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-09 20:55:51,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 20:55:51,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-09 20:55:51,718 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-02-09 20:55:51,718 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-02-09 20:55:51,718 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-02-09 20:55:51,718 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-02-09 20:55:51,718 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:55:51,718 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-02-09 20:55:51,718 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1675976147822.c01761bb5658622fd63528c8f312a31c. 2023-02-09 20:55:51,718 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-09 20:55:51,718 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 20:55:51,718 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1675976147822.1b246bc14d14521c9a184bb2e9c29b83. 2023-02-09 20:55:51,718 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1675976147822.15bceddc51e736adeea65067f01af28b. 2023-02-09 20:55:51,718 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1675976147822.c01761bb5658622fd63528c8f312a31c. started... 2023-02-09 20:55:51,719 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1675976147822.1b246bc14d14521c9a184bb2e9c29b83. started... 2023-02-09 20:55:51,719 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1675976147822.15bceddc51e736adeea65067f01af28b. started... 2023-02-09 20:55:51,719 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing c01761bb5658622fd63528c8f312a31c 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-02-09 20:55:51,719 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 1b246bc14d14521c9a184bb2e9c29b83 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-02-09 20:55:51,719 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 15bceddc51e736adeea65067f01af28b 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-02-09 20:55:52,136 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230209c34a4d1c77e94932a777d4714de81f5f to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20230209c34a4d1c77e94932a777d4714de81f5f 2023-02-09 20:55:52,136 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202302090a7aaff2f19f44c085254f4def7850d4 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b202302090a7aaff2f19f44c085254f4def7850d4 2023-02-09 20:55:52,136 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202302099a5e16c665884bf6bdad13801e66e8bf to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e202302099a5e16c665884bf6bdad13801e66e8bf 2023-02-09 20:55:52,145 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/c01761bb5658622fd63528c8f312a31c/.tmp/family1/3da9e9e405104c9b8087b72dc1528276 2023-02-09 20:55:52,168 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202302098a093bd404524ec1938b8911fee5c4ac to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e202302098a093bd404524ec1938b8911fee5c4ac 2023-02-09 20:55:52,545 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/1b246bc14d14521c9a184bb2e9c29b83/.tmp/family1/38c1c579a3e14fe39569c51fbf73fe31 2023-02-09 20:55:52,546 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/15bceddc51e736adeea65067f01af28b/.tmp/family1/5ad78838aa5d4b59bdffc109173b4f64 2023-02-09 20:55:52,573 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/c01761bb5658622fd63528c8f312a31c/.tmp/family2/22c17a4accce4deb9262464456de3536 2023-02-09 20:55:52,577 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/c01761bb5658622fd63528c8f312a31c/.tmp/family1/3da9e9e405104c9b8087b72dc1528276 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/c01761bb5658622fd63528c8f312a31c/family1/3da9e9e405104c9b8087b72dc1528276 2023-02-09 20:55:52,580 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/c01761bb5658622fd63528c8f312a31c/family1/3da9e9e405104c9b8087b72dc1528276, entries=4, sequenceid=9, filesize=5.4 K 2023-02-09 20:55:52,580 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/c01761bb5658622fd63528c8f312a31c/.tmp/family2/22c17a4accce4deb9262464456de3536 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/c01761bb5658622fd63528c8f312a31c/family2/22c17a4accce4deb9262464456de3536 2023-02-09 20:55:52,583 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/c01761bb5658622fd63528c8f312a31c/family2/22c17a4accce4deb9262464456de3536, entries=2, sequenceid=9, filesize=5.1 K 2023-02-09 20:55:52,584 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for c01761bb5658622fd63528c8f312a31c in 865ms, sequenceid=9, compaction requested=false 2023-02-09 20:55:52,584 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for c01761bb5658622fd63528c8f312a31c: 2023-02-09 20:55:52,584 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1675976147822.c01761bb5658622fd63528c8f312a31c. 2023-02-09 20:55:52,584 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-09 20:55:52,958 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202302095afe516539b64067a00239a9f6f3def4 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b202302095afe516539b64067a00239a9f6f3def4 2023-02-09 20:55:52,958 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302097cf46b70e2d24a0f974bf003fee980d3 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c202302097cf46b70e2d24a0f974bf003fee980d3 2023-02-09 20:55:53,363 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/15bceddc51e736adeea65067f01af28b/.tmp/family2/619510d65dd64b9093520305c9bbf769 2023-02-09 20:55:53,364 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/1b246bc14d14521c9a184bb2e9c29b83/.tmp/family2/3937b5e207d34e058dbc13ed882f036b 2023-02-09 20:55:53,367 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/15bceddc51e736adeea65067f01af28b/.tmp/family1/5ad78838aa5d4b59bdffc109173b4f64 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/15bceddc51e736adeea65067f01af28b/family1/5ad78838aa5d4b59bdffc109173b4f64 2023-02-09 20:55:53,368 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/1b246bc14d14521c9a184bb2e9c29b83/.tmp/family1/38c1c579a3e14fe39569c51fbf73fe31 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/1b246bc14d14521c9a184bb2e9c29b83/family1/38c1c579a3e14fe39569c51fbf73fe31 2023-02-09 20:55:53,371 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/15bceddc51e736adeea65067f01af28b/family1/5ad78838aa5d4b59bdffc109173b4f64, entries=4, sequenceid=9, filesize=5.4 K 2023-02-09 20:55:53,372 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/15bceddc51e736adeea65067f01af28b/.tmp/family2/619510d65dd64b9093520305c9bbf769 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/15bceddc51e736adeea65067f01af28b/family2/619510d65dd64b9093520305c9bbf769 2023-02-09 20:55:53,372 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/1b246bc14d14521c9a184bb2e9c29b83/family1/38c1c579a3e14fe39569c51fbf73fe31, entries=4, sequenceid=9, filesize=5.4 K 2023-02-09 20:55:53,373 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/1b246bc14d14521c9a184bb2e9c29b83/.tmp/family2/3937b5e207d34e058dbc13ed882f036b as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/1b246bc14d14521c9a184bb2e9c29b83/family2/3937b5e207d34e058dbc13ed882f036b 2023-02-09 20:55:53,376 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/15bceddc51e736adeea65067f01af28b/family2/619510d65dd64b9093520305c9bbf769, entries=2, sequenceid=9, filesize=5.1 K 2023-02-09 20:55:53,377 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/1b246bc14d14521c9a184bb2e9c29b83/family2/3937b5e207d34e058dbc13ed882f036b, entries=2, sequenceid=9, filesize=5.1 K 2023-02-09 20:55:53,377 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 15bceddc51e736adeea65067f01af28b in 1658ms, sequenceid=9, compaction requested=false 2023-02-09 20:55:53,377 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 15bceddc51e736adeea65067f01af28b: 2023-02-09 20:55:53,377 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1675976147822.15bceddc51e736adeea65067f01af28b. 2023-02-09 20:55:53,377 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-09 20:55:53,377 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 1b246bc14d14521c9a184bb2e9c29b83 in 1658ms, sequenceid=9, compaction requested=false 2023-02-09 20:55:53,377 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 1b246bc14d14521c9a184bb2e9c29b83: 2023-02-09 20:55:53,377 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1675976147822.1b246bc14d14521c9a184bb2e9c29b83. 2023-02-09 20:55:53,377 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-09 20:55:53,377 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-09 20:55:53,377 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:53,378 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-02-09 20:55:53,378 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-02-09 20:55:53,379 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:53,379 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-09 20:55:53,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:53,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:55:53,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:55:53,379 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-09 20:55:53,379 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 20:55:53,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:55:53,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:55:53,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-09 20:55:53,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:53,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:55:53,382 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-02-09 20:55:53,382 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4903e6f1[Count = 0] remaining members to acquire global barrier 2023-02-09 20:55:53,382 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-02-09 20:55:53,382 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-09 20:55:53,383 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-09 20:55:53,383 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-09 20:55:53,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-09 20:55:53,383 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-02-09 20:55:53,383 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-02-09 20:55:53,383 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase9.apache.org,40919,1675976022294' in zk 2023-02-09 20:55:53,383 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:53,383 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 20:55:53,388 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-02-09 20:55:53,388 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:55:53,388 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:53,388 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-02-09 20:55:53,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:53,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:55:53,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:55:53,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:55:53,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:55:53,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-09 20:55:53,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:53,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:55:53,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-09 20:55:53,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:53,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase9.apache.org,40919,1675976022294': 2023-02-09 20:55:53,391 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-02-09 20:55:53,391 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-02-09 20:55:53,391 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 20:55:53,391 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 20:55:53,391 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-02-09 20:55:53,391 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 20:55:53,392 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-09 20:55:53,392 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-09 20:55:53,392 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-09 20:55:53,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-09 20:55:53,392 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:55:53,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-09 20:55:53,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:55:53,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:55:53,393 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:55:53,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:55:53,393 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:53,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:55:53,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-09 20:55:53,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-09 20:55:53,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:55:53,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-09 20:55:53,394 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:53,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:53,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:55:53,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-09 20:55:53,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:53,396 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:53,396 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-09 20:55:53,396 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-09 20:55:53,396 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:55:53,396 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:55:53,396 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:53,396 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:55:53,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:55:53,396 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-02-09 20:55:53,396 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 20:55:53,396 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:55:53,396 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-09 20:55:53,397 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-09 20:55:53,397 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-09 20:55:53,397 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-02-09 20:55:53,397 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-02-09 20:55:53,397 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 20:55:53,397 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:55:53,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:55:53,497 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 20:55:53,498 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 20:55:53,499 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,,1675976147822.c01761bb5658622fd63528c8f312a31c. with WAL disabled. Data may be lost in the event of a crash. 2023-02-09 20:55:53,499 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,1,1675976147822.1b246bc14d14521c9a184bb2e9c29b83. with WAL disabled. Data may be lost in the event of a crash. 2023-02-09 20:55:53,499 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,2,1675976147822.15bceddc51e736adeea65067f01af28b. with WAL disabled. Data may be lost in the event of a crash. 2023-02-09 20:55:53,501 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(933): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-02-09 20:55:53,502 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-02-09 20:55:53,502 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-02-09 20:55:53,503 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-02-09 20:55:53,503 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:55:53,503 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-02-09 20:55:53,503 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-02-09 20:55:53,503 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-09 20:55:53,503 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-09 20:55:53,504 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:53,504 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:55:53,504 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:55:53,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:55:53,504 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:53,504 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 20:55:53,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-09 20:55:53,505 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-09 20:55:53,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 20:55:53,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-09 20:55:53,505 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-02-09 20:55:53,505 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-02-09 20:55:53,505 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-02-09 20:55:53,505 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-02-09 20:55:53,506 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:55:53,506 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-02-09 20:55:53,506 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1675976147822.c01761bb5658622fd63528c8f312a31c. 2023-02-09 20:55:53,506 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1675976147822.c01761bb5658622fd63528c8f312a31c. started... 2023-02-09 20:55:53,506 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-09 20:55:53,506 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1675976147822.15bceddc51e736adeea65067f01af28b. 2023-02-09 20:55:53,506 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1675976147822.1b246bc14d14521c9a184bb2e9c29b83. 2023-02-09 20:55:53,506 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1675976147822.1b246bc14d14521c9a184bb2e9c29b83. started... 2023-02-09 20:55:53,506 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing c01761bb5658622fd63528c8f312a31c 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-02-09 20:55:53,506 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1675976147822.15bceddc51e736adeea65067f01af28b. started... 2023-02-09 20:55:53,506 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 1b246bc14d14521c9a184bb2e9c29b83 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-02-09 20:55:53,506 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 15bceddc51e736adeea65067f01af28b 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-02-09 20:55:53,506 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 20:55:53,920 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302091750c6f40cdd441b89a5aac05eddad56 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c202302091750c6f40cdd441b89a5aac05eddad56 2023-02-09 20:55:53,920 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230209a115661333694ec69c1c01fbf058a041 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20230209a115661333694ec69c1c01fbf058a041 2023-02-09 20:55:53,921 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202302092470a849385c4ae38ffe31478332c0be to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b202302092470a849385c4ae38ffe31478332c0be 2023-02-09 20:55:54,328 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/c01761bb5658622fd63528c8f312a31c/.tmp/family1/b3572693de06499fa58e0b9e8de0b9fe 2023-02-09 20:55:54,328 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/1b246bc14d14521c9a184bb2e9c29b83/.tmp/family1/3e976422bf3140d4929e986c4ebb900c 2023-02-09 20:55:54,330 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/15bceddc51e736adeea65067f01af28b/.tmp/family1/b9c378733771466bb82333d527004b71 2023-02-09 20:55:54,343 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023020916fa80f991d0459b95d39fa98cd4c0b3 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e2023020916fa80f991d0459b95d39fa98cd4c0b3 2023-02-09 20:55:54,487 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-09 20:55:54,743 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230209476e12db0c96472aba1b77e6caa14679 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b20230209476e12db0c96472aba1b77e6caa14679 2023-02-09 20:55:54,744 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302097e43694eb51d4f52aa15a457e3e43379 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c202302097e43694eb51d4f52aa15a457e3e43379 2023-02-09 20:55:54,748 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/c01761bb5658622fd63528c8f312a31c/.tmp/family2/36f6c2831845412594f56bf1b73e0d07 2023-02-09 20:55:54,752 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/c01761bb5658622fd63528c8f312a31c/.tmp/family1/b3572693de06499fa58e0b9e8de0b9fe as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/c01761bb5658622fd63528c8f312a31c/family1/b3572693de06499fa58e0b9e8de0b9fe 2023-02-09 20:55:54,755 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/c01761bb5658622fd63528c8f312a31c/family1/b3572693de06499fa58e0b9e8de0b9fe, entries=4, sequenceid=13, filesize=5.4 K 2023-02-09 20:55:54,755 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/c01761bb5658622fd63528c8f312a31c/.tmp/family2/36f6c2831845412594f56bf1b73e0d07 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/c01761bb5658622fd63528c8f312a31c/family2/36f6c2831845412594f56bf1b73e0d07 2023-02-09 20:55:54,758 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/c01761bb5658622fd63528c8f312a31c/family2/36f6c2831845412594f56bf1b73e0d07, entries=2, sequenceid=13, filesize=5.1 K 2023-02-09 20:55:54,759 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for c01761bb5658622fd63528c8f312a31c in 1253ms, sequenceid=13, compaction requested=true 2023-02-09 20:55:54,759 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for c01761bb5658622fd63528c8f312a31c: 2023-02-09 20:55:54,759 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1675976147822.c01761bb5658622fd63528c8f312a31c. 2023-02-09 20:55:54,759 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-09 20:55:55,148 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/1b246bc14d14521c9a184bb2e9c29b83/.tmp/family2/409683e868734ed2a53f80e2a778f5ae 2023-02-09 20:55:55,149 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/15bceddc51e736adeea65067f01af28b/.tmp/family2/c1ff4e769ffe446e8ed796acb9a20b8d 2023-02-09 20:55:55,153 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/1b246bc14d14521c9a184bb2e9c29b83/.tmp/family1/3e976422bf3140d4929e986c4ebb900c as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/1b246bc14d14521c9a184bb2e9c29b83/family1/3e976422bf3140d4929e986c4ebb900c 2023-02-09 20:55:55,153 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/15bceddc51e736adeea65067f01af28b/.tmp/family1/b9c378733771466bb82333d527004b71 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/15bceddc51e736adeea65067f01af28b/family1/b9c378733771466bb82333d527004b71 2023-02-09 20:55:55,156 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/1b246bc14d14521c9a184bb2e9c29b83/family1/3e976422bf3140d4929e986c4ebb900c, entries=4, sequenceid=13, filesize=5.4 K 2023-02-09 20:55:55,156 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/15bceddc51e736adeea65067f01af28b/family1/b9c378733771466bb82333d527004b71, entries=4, sequenceid=13, filesize=5.4 K 2023-02-09 20:55:55,157 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/1b246bc14d14521c9a184bb2e9c29b83/.tmp/family2/409683e868734ed2a53f80e2a778f5ae as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/1b246bc14d14521c9a184bb2e9c29b83/family2/409683e868734ed2a53f80e2a778f5ae 2023-02-09 20:55:55,157 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/15bceddc51e736adeea65067f01af28b/.tmp/family2/c1ff4e769ffe446e8ed796acb9a20b8d as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/15bceddc51e736adeea65067f01af28b/family2/c1ff4e769ffe446e8ed796acb9a20b8d 2023-02-09 20:55:55,160 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/15bceddc51e736adeea65067f01af28b/family2/c1ff4e769ffe446e8ed796acb9a20b8d, entries=2, sequenceid=13, filesize=5.1 K 2023-02-09 20:55:55,160 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/1b246bc14d14521c9a184bb2e9c29b83/family2/409683e868734ed2a53f80e2a778f5ae, entries=2, sequenceid=13, filesize=5.1 K 2023-02-09 20:55:55,161 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 15bceddc51e736adeea65067f01af28b in 1655ms, sequenceid=13, compaction requested=true 2023-02-09 20:55:55,161 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 1b246bc14d14521c9a184bb2e9c29b83 in 1655ms, sequenceid=13, compaction requested=true 2023-02-09 20:55:55,161 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 15bceddc51e736adeea65067f01af28b: 2023-02-09 20:55:55,161 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 1b246bc14d14521c9a184bb2e9c29b83: 2023-02-09 20:55:55,161 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1675976147822.1b246bc14d14521c9a184bb2e9c29b83. 2023-02-09 20:55:55,161 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1675976147822.15bceddc51e736adeea65067f01af28b. 2023-02-09 20:55:55,161 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-09 20:55:55,161 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-09 20:55:55,161 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-09 20:55:55,161 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:55,161 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-02-09 20:55:55,161 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-02-09 20:55:55,163 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-09 20:55:55,163 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:55,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:55,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:55:55,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:55:55,164 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-09 20:55:55,164 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 20:55:55,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:55:55,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:55:55,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-09 20:55:55,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:55,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:55:55,165 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-02-09 20:55:55,165 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@232dc5c0[Count = 0] remaining members to acquire global barrier 2023-02-09 20:55:55,165 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-02-09 20:55:55,165 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-09 20:55:55,166 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-09 20:55:55,166 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-09 20:55:55,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-09 20:55:55,166 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-02-09 20:55:55,166 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-02-09 20:55:55,166 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:55,166 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase9.apache.org,40919,1675976022294' in zk 2023-02-09 20:55:55,166 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 20:55:55,167 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-02-09 20:55:55,167 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:55,167 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:55:55,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:55,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:55:55,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:55:55,167 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-02-09 20:55:55,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:55:55,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:55:55,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-09 20:55:55,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:55,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:55:55,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-09 20:55:55,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:55,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase9.apache.org,40919,1675976022294': 2023-02-09 20:55:55,169 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-02-09 20:55:55,169 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-02-09 20:55:55,170 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 20:55:55,170 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 20:55:55,170 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-02-09 20:55:55,170 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 20:55:55,171 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-09 20:55:55,171 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-09 20:55:55,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-09 20:55:55,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:55:55,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:55:55,171 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-09 20:55:55,171 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:55:55,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-09 20:55:55,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:55:55,171 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:55,171 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:55:55,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:55:55,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-09 20:55:55,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-09 20:55:55,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:55:55,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-09 20:55:55,173 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:55,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:55,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:55:55,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-09 20:55:55,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:55,177 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:55:55,177 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:55,177 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:55:55,177 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-02-09 20:55:55,177 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 20:55:55,177 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:55:55,177 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-09 20:55:55,177 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-02-09 20:55:55,177 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:55:55,177 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-02-09 20:55:55,177 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-09 20:55:55,177 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 20:55:55,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:55:55,177 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:55,177 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-09 20:55:55,177 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-09 20:55:55,177 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-09 20:55:55,178 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:55:55,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:55:55,277 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 20:55:55,278 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 20:55:55,279 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,,1675976147822.c01761bb5658622fd63528c8f312a31c. with WAL disabled. Data may be lost in the event of a crash. 2023-02-09 20:55:55,279 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,1,1675976147822.1b246bc14d14521c9a184bb2e9c29b83. with WAL disabled. Data may be lost in the event of a crash. 2023-02-09 20:55:55,279 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,2,1675976147822.15bceddc51e736adeea65067f01af28b. with WAL disabled. Data may be lost in the event of a crash. 2023-02-09 20:55:55,281 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(933): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-02-09 20:55:55,283 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-02-09 20:55:55,283 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-02-09 20:55:55,283 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-02-09 20:55:55,283 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:55:55,283 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-02-09 20:55:55,283 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-02-09 20:55:55,284 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-09 20:55:55,284 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-09 20:55:55,285 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:55,285 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:55:55,285 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:55:55,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:55:55,285 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:55,285 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 20:55:55,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-09 20:55:55,285 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-09 20:55:55,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 20:55:55,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-09 20:55:55,286 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-02-09 20:55:55,286 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-02-09 20:55:55,287 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-02-09 20:55:55,287 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-02-09 20:55:55,287 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:55:55,287 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-02-09 20:55:55,287 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1675976147822.c01761bb5658622fd63528c8f312a31c. 2023-02-09 20:55:55,287 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1675976147822.c01761bb5658622fd63528c8f312a31c. started... 2023-02-09 20:55:55,287 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1675976147822.15bceddc51e736adeea65067f01af28b. 2023-02-09 20:55:55,287 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1675976147822.15bceddc51e736adeea65067f01af28b. started... 2023-02-09 20:55:55,287 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing c01761bb5658622fd63528c8f312a31c 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-02-09 20:55:55,287 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 15bceddc51e736adeea65067f01af28b 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-02-09 20:55:55,288 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-09 20:55:55,288 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 20:55:55,288 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1675976147822.1b246bc14d14521c9a184bb2e9c29b83. 2023-02-09 20:55:55,288 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1675976147822.1b246bc14d14521c9a184bb2e9c29b83. started... 2023-02-09 20:55:55,288 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 1b246bc14d14521c9a184bb2e9c29b83 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-02-09 20:55:55,699 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230209446e4cf4faeb4f8281d9b570a53081ed to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20230209446e4cf4faeb4f8281d9b570a53081ed 2023-02-09 20:55:55,712 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023020902395da89ffd4d6a97941651854d109c to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e2023020902395da89ffd4d6a97941651854d109c 2023-02-09 20:55:55,713 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202302099935ebc1b3bf4fd38dd302d20a46870f to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b202302099935ebc1b3bf4fd38dd302d20a46870f 2023-02-09 20:55:55,732 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/c01761bb5658622fd63528c8f312a31c/.tmp/family1/c2263e98c796495a95764927b89e3ad6 2023-02-09 20:55:56,112 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/15bceddc51e736adeea65067f01af28b/.tmp/family1/9160d2af94ee449c83873cd655c7a838 2023-02-09 20:55:56,129 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/1b246bc14d14521c9a184bb2e9c29b83/.tmp/family1/b17876474d9f4e6dba46a5189072c65c 2023-02-09 20:55:56,145 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230209ec0b11d179934cec927b645c2fff8bd8 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e20230209ec0b11d179934cec927b645c2fff8bd8 2023-02-09 20:55:56,150 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/c01761bb5658622fd63528c8f312a31c/.tmp/family2/26fd2ea5c7f84f29a29a31acaf81d239 2023-02-09 20:55:56,154 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/c01761bb5658622fd63528c8f312a31c/.tmp/family1/c2263e98c796495a95764927b89e3ad6 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/c01761bb5658622fd63528c8f312a31c/family1/c2263e98c796495a95764927b89e3ad6 2023-02-09 20:55:56,158 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/c01761bb5658622fd63528c8f312a31c/family1/c2263e98c796495a95764927b89e3ad6, entries=4, sequenceid=17, filesize=5.4 K 2023-02-09 20:55:56,159 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/c01761bb5658622fd63528c8f312a31c/.tmp/family2/26fd2ea5c7f84f29a29a31acaf81d239 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/c01761bb5658622fd63528c8f312a31c/family2/26fd2ea5c7f84f29a29a31acaf81d239 2023-02-09 20:55:56,162 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/c01761bb5658622fd63528c8f312a31c/family2/26fd2ea5c7f84f29a29a31acaf81d239, entries=2, sequenceid=17, filesize=5.1 K 2023-02-09 20:55:56,163 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for c01761bb5658622fd63528c8f312a31c in 876ms, sequenceid=17, compaction requested=true 2023-02-09 20:55:56,163 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for c01761bb5658622fd63528c8f312a31c: 2023-02-09 20:55:56,163 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1675976147822.c01761bb5658622fd63528c8f312a31c. 2023-02-09 20:55:56,163 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-09 20:55:56,526 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230209615bbaec219c49ad8042359e2f905146 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c20230209615bbaec219c49ad8042359e2f905146 2023-02-09 20:55:56,540 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023020910e51e5e63e14b14abeb10132948e900 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b2023020910e51e5e63e14b14abeb10132948e900 2023-02-09 20:55:56,931 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/15bceddc51e736adeea65067f01af28b/.tmp/family2/9ee702dbd05244ba93647608f29f2512 2023-02-09 20:55:56,935 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/15bceddc51e736adeea65067f01af28b/.tmp/family1/9160d2af94ee449c83873cd655c7a838 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/15bceddc51e736adeea65067f01af28b/family1/9160d2af94ee449c83873cd655c7a838 2023-02-09 20:55:56,938 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/15bceddc51e736adeea65067f01af28b/family1/9160d2af94ee449c83873cd655c7a838, entries=4, sequenceid=17, filesize=5.4 K 2023-02-09 20:55:56,939 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/15bceddc51e736adeea65067f01af28b/.tmp/family2/9ee702dbd05244ba93647608f29f2512 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/15bceddc51e736adeea65067f01af28b/family2/9ee702dbd05244ba93647608f29f2512 2023-02-09 20:55:56,943 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/15bceddc51e736adeea65067f01af28b/family2/9ee702dbd05244ba93647608f29f2512, entries=2, sequenceid=17, filesize=5.1 K 2023-02-09 20:55:56,944 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 15bceddc51e736adeea65067f01af28b in 1657ms, sequenceid=17, compaction requested=true 2023-02-09 20:55:56,944 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 15bceddc51e736adeea65067f01af28b: 2023-02-09 20:55:56,944 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1675976147822.15bceddc51e736adeea65067f01af28b. 2023-02-09 20:55:56,944 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-09 20:55:56,945 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/1b246bc14d14521c9a184bb2e9c29b83/.tmp/family2/eca6323137564986aa14b5eb7d75ea89 2023-02-09 20:55:56,948 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/1b246bc14d14521c9a184bb2e9c29b83/.tmp/family1/b17876474d9f4e6dba46a5189072c65c as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/1b246bc14d14521c9a184bb2e9c29b83/family1/b17876474d9f4e6dba46a5189072c65c 2023-02-09 20:55:56,951 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/1b246bc14d14521c9a184bb2e9c29b83/family1/b17876474d9f4e6dba46a5189072c65c, entries=4, sequenceid=17, filesize=5.4 K 2023-02-09 20:55:56,952 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/1b246bc14d14521c9a184bb2e9c29b83/.tmp/family2/eca6323137564986aa14b5eb7d75ea89 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/1b246bc14d14521c9a184bb2e9c29b83/family2/eca6323137564986aa14b5eb7d75ea89 2023-02-09 20:55:56,955 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/1b246bc14d14521c9a184bb2e9c29b83/family2/eca6323137564986aa14b5eb7d75ea89, entries=2, sequenceid=17, filesize=5.1 K 2023-02-09 20:55:56,956 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 1b246bc14d14521c9a184bb2e9c29b83 in 1668ms, sequenceid=17, compaction requested=true 2023-02-09 20:55:56,956 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 1b246bc14d14521c9a184bb2e9c29b83: 2023-02-09 20:55:56,956 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1675976147822.1b246bc14d14521c9a184bb2e9c29b83. 2023-02-09 20:55:56,956 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-09 20:55:56,956 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-09 20:55:56,956 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:56,956 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-02-09 20:55:56,956 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-02-09 20:55:56,958 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:56,958 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-09 20:55:56,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:56,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:55:56,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:55:56,958 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-09 20:55:56,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:55:56,958 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 20:55:56,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:55:56,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-09 20:55:56,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:56,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:55:56,960 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-02-09 20:55:56,960 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5a7f1e47[Count = 0] remaining members to acquire global barrier 2023-02-09 20:55:56,960 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-02-09 20:55:56,960 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-09 20:55:56,961 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-09 20:55:56,961 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-09 20:55:56,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-09 20:55:56,961 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-02-09 20:55:56,961 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-02-09 20:55:56,961 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase9.apache.org,40919,1675976022294' in zk 2023-02-09 20:55:56,961 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:56,961 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 20:55:56,962 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-02-09 20:55:56,962 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:56,962 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:55:56,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:56,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:55:56,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:55:56,962 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-02-09 20:55:56,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:55:56,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:55:56,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-09 20:55:56,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:56,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:55:56,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-09 20:55:56,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:56,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase9.apache.org,40919,1675976022294': 2023-02-09 20:55:56,964 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-02-09 20:55:56,964 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-02-09 20:55:56,964 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 20:55:56,964 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 20:55:56,964 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-02-09 20:55:56,965 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 20:55:56,967 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-09 20:55:56,967 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-09 20:55:56,967 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-09 20:55:56,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-09 20:55:56,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:55:56,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:55:56,967 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:55:56,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-09 20:55:56,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:55:56,968 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:55:56,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:55:56,968 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:56,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-09 20:55:56,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-09 20:55:56,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:55:56,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-09 20:55:56,969 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:56,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:56,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:55:56,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-09 20:55:56,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:56,971 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:55:56,971 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:55:56,971 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:55:56,971 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:55:56,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:55:56,971 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-02-09 20:55:56,971 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 20:55:56,971 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:56,971 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-09 20:55:56,971 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-09 20:55:56,971 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:56,971 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-09 20:55:56,971 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-09 20:55:56,971 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:55:56,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:55:56,971 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-09 20:55:56,971 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-02-09 20:55:56,971 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 20:55:57,071 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 20:55:57,072 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 20:55:57,085 DEBUG [Listener at localhost/46855] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-09 20:55:57,094 DEBUG [Listener at localhost/46855] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-09 20:55:57,103 DEBUG [Listener at localhost/46855] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-09 20:55:57,104 DEBUG [Listener at localhost/46855] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-09 20:55:57,129 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(933): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-02-09 20:55:57,131 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-02-09 20:55:57,131 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-02-09 20:55:57,131 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-02-09 20:55:57,131 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:55:57,131 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-02-09 20:55:57,131 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-02-09 20:55:57,132 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-09 20:55:57,132 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-09 20:55:57,133 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:57,133 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:55:57,133 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:55:57,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:55:57,133 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:57,133 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 20:55:57,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-09 20:55:57,133 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-09 20:55:57,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 20:55:57,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-09 20:55:57,134 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-02-09 20:55:57,134 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-02-09 20:55:57,134 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-02-09 20:55:57,134 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-02-09 20:55:57,134 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:55:57,134 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-02-09 20:55:57,134 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1675976147822.c01761bb5658622fd63528c8f312a31c. 2023-02-09 20:55:57,134 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1675976147822.c01761bb5658622fd63528c8f312a31c. started... 2023-02-09 20:55:57,134 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-09 20:55:57,134 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1675976147822.1b246bc14d14521c9a184bb2e9c29b83. 2023-02-09 20:55:57,134 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing c01761bb5658622fd63528c8f312a31c 2/2 column families, dataSize=138 B heapSize=944 B 2023-02-09 20:55:57,134 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1675976147822.15bceddc51e736adeea65067f01af28b. 2023-02-09 20:55:57,134 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1675976147822.1b246bc14d14521c9a184bb2e9c29b83. started... 2023-02-09 20:55:57,134 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 20:55:57,135 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 1b246bc14d14521c9a184bb2e9c29b83 2/2 column families, dataSize=138 B heapSize=944 B 2023-02-09 20:55:57,134 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1675976147822.15bceddc51e736adeea65067f01af28b. started... 2023-02-09 20:55:57,135 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 15bceddc51e736adeea65067f01af28b 2/2 column families, dataSize=138 B heapSize=944 B 2023-02-09 20:55:57,165 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/1b246bc14d14521c9a184bb2e9c29b83/.tmp/family1/758d8988290a4f368a4765453f53e53d 2023-02-09 20:55:57,169 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 758d8988290a4f368a4765453f53e53d 2023-02-09 20:55:57,571 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/15bceddc51e736adeea65067f01af28b/.tmp/family1/a9dde2c6fde34e109fe5796377eeffc4 2023-02-09 20:55:57,575 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a9dde2c6fde34e109fe5796377eeffc4 2023-02-09 20:55:57,588 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/1b246bc14d14521c9a184bb2e9c29b83/.tmp/family2/06d0c0c4d7dc4bad8331dc2a236b12ba 2023-02-09 20:55:57,592 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 06d0c0c4d7dc4bad8331dc2a236b12ba 2023-02-09 20:55:57,593 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/15bceddc51e736adeea65067f01af28b/.tmp/family2/f8285f071f4a402783c62f0ab5b756f1 2023-02-09 20:55:57,593 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/1b246bc14d14521c9a184bb2e9c29b83/.tmp/family1/758d8988290a4f368a4765453f53e53d as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/1b246bc14d14521c9a184bb2e9c29b83/family1/758d8988290a4f368a4765453f53e53d 2023-02-09 20:55:57,597 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f8285f071f4a402783c62f0ab5b756f1 2023-02-09 20:55:57,597 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 758d8988290a4f368a4765453f53e53d 2023-02-09 20:55:57,598 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/1b246bc14d14521c9a184bb2e9c29b83/family1/758d8988290a4f368a4765453f53e53d, entries=3, sequenceid=23, filesize=5.0 K 2023-02-09 20:55:57,598 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/15bceddc51e736adeea65067f01af28b/.tmp/family1/a9dde2c6fde34e109fe5796377eeffc4 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/15bceddc51e736adeea65067f01af28b/family1/a9dde2c6fde34e109fe5796377eeffc4 2023-02-09 20:55:57,599 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/1b246bc14d14521c9a184bb2e9c29b83/.tmp/family2/06d0c0c4d7dc4bad8331dc2a236b12ba as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/1b246bc14d14521c9a184bb2e9c29b83/family2/06d0c0c4d7dc4bad8331dc2a236b12ba 2023-02-09 20:55:57,602 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a9dde2c6fde34e109fe5796377eeffc4 2023-02-09 20:55:57,602 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/15bceddc51e736adeea65067f01af28b/family1/a9dde2c6fde34e109fe5796377eeffc4, entries=3, sequenceid=23, filesize=5.0 K 2023-02-09 20:55:57,603 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 06d0c0c4d7dc4bad8331dc2a236b12ba 2023-02-09 20:55:57,603 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/1b246bc14d14521c9a184bb2e9c29b83/family2/06d0c0c4d7dc4bad8331dc2a236b12ba, entries=1, sequenceid=23, filesize=5.0 K 2023-02-09 20:55:57,603 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/15bceddc51e736adeea65067f01af28b/.tmp/family2/f8285f071f4a402783c62f0ab5b756f1 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/15bceddc51e736adeea65067f01af28b/family2/f8285f071f4a402783c62f0ab5b756f1 2023-02-09 20:55:57,604 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 1b246bc14d14521c9a184bb2e9c29b83 in 469ms, sequenceid=23, compaction requested=true 2023-02-09 20:55:57,604 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 1b246bc14d14521c9a184bb2e9c29b83: 2023-02-09 20:55:57,604 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1675976147822.1b246bc14d14521c9a184bb2e9c29b83. 2023-02-09 20:55:57,604 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-09 20:55:57,607 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f8285f071f4a402783c62f0ab5b756f1 2023-02-09 20:55:57,608 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/15bceddc51e736adeea65067f01af28b/family2/f8285f071f4a402783c62f0ab5b756f1, entries=1, sequenceid=23, filesize=5.0 K 2023-02-09 20:55:57,609 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 15bceddc51e736adeea65067f01af28b in 474ms, sequenceid=23, compaction requested=true 2023-02-09 20:55:57,609 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 15bceddc51e736adeea65067f01af28b: 2023-02-09 20:55:57,609 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1675976147822.15bceddc51e736adeea65067f01af28b. 2023-02-09 20:55:57,609 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-09 20:55:57,972 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/c01761bb5658622fd63528c8f312a31c/.tmp/family1/fa94fc28ecb045b2b27db463f7fec5c3 2023-02-09 20:55:57,975 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for fa94fc28ecb045b2b27db463f7fec5c3 2023-02-09 20:55:58,788 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/c01761bb5658622fd63528c8f312a31c/.tmp/family2/bcaa33b5eef246b19042cfbebb227829 2023-02-09 20:55:58,793 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for bcaa33b5eef246b19042cfbebb227829 2023-02-09 20:55:58,793 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/c01761bb5658622fd63528c8f312a31c/.tmp/family1/fa94fc28ecb045b2b27db463f7fec5c3 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/c01761bb5658622fd63528c8f312a31c/family1/fa94fc28ecb045b2b27db463f7fec5c3 2023-02-09 20:55:58,798 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for fa94fc28ecb045b2b27db463f7fec5c3 2023-02-09 20:55:58,798 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/c01761bb5658622fd63528c8f312a31c/family1/fa94fc28ecb045b2b27db463f7fec5c3, entries=3, sequenceid=23, filesize=5.0 K 2023-02-09 20:55:58,799 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/c01761bb5658622fd63528c8f312a31c/.tmp/family2/bcaa33b5eef246b19042cfbebb227829 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/c01761bb5658622fd63528c8f312a31c/family2/bcaa33b5eef246b19042cfbebb227829 2023-02-09 20:55:58,805 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for bcaa33b5eef246b19042cfbebb227829 2023-02-09 20:55:58,805 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/c01761bb5658622fd63528c8f312a31c/family2/bcaa33b5eef246b19042cfbebb227829, entries=1, sequenceid=23, filesize=5.0 K 2023-02-09 20:55:58,806 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for c01761bb5658622fd63528c8f312a31c in 1672ms, sequenceid=23, compaction requested=true 2023-02-09 20:55:58,806 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for c01761bb5658622fd63528c8f312a31c: 2023-02-09 20:55:58,806 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1675976147822.c01761bb5658622fd63528c8f312a31c. 2023-02-09 20:55:58,806 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-09 20:55:58,806 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-09 20:55:58,806 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:58,807 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-02-09 20:55:58,807 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-02-09 20:55:58,808 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-09 20:55:58,808 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:58,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:58,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:55:58,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:55:58,808 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-09 20:55:58,808 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 20:55:58,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:55:58,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:55:58,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-09 20:55:58,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:58,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:55:58,810 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-02-09 20:55:58,811 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@159b7dab[Count = 0] remaining members to acquire global barrier 2023-02-09 20:55:58,811 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-02-09 20:55:58,811 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-09 20:55:58,812 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-09 20:55:58,812 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-09 20:55:58,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-09 20:55:58,813 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-02-09 20:55:58,813 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-02-09 20:55:58,813 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase9.apache.org,40919,1675976022294' in zk 2023-02-09 20:55:58,813 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:58,813 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 20:55:58,814 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:58,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:58,814 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-02-09 20:55:58,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:55:58,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:55:58,814 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:55:58,814 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-02-09 20:55:58,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:55:58,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:55:58,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-09 20:55:58,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:58,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:55:58,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-09 20:55:58,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:58,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase9.apache.org,40919,1675976022294': 2023-02-09 20:55:58,818 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-02-09 20:55:58,818 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-02-09 20:55:58,818 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 20:55:58,818 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 20:55:58,818 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-02-09 20:55:58,818 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 20:55:58,822 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-09 20:55:58,822 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-09 20:55:58,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-09 20:55:58,822 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-09 20:55:58,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:55:58,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:55:58,822 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:55:58,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-09 20:55:58,823 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:58,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:55:58,823 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:55:58,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:55:58,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-09 20:55:58,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-09 20:55:58,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:55:58,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-09 20:55:58,824 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:58,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:58,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:55:58,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-09 20:55:58,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:58,826 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:58,826 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:55:58,826 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-09 20:55:58,826 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:55:58,826 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-02-09 20:55:58,826 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 20:55:58,826 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:55:58,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:55:58,826 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:55:58,826 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-09 20:55:58,826 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:55:58,826 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-09 20:55:58,826 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-09 20:55:58,826 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-02-09 20:55:58,826 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 20:55:58,826 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-09 20:55:58,826 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:55:58,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:55:58,926 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 20:55:58,927 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 20:55:58,927 DEBUG [Listener at localhost/46855] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-09 20:55:58,928 DEBUG [Listener at localhost/46855] regionserver.HStore(1912): c01761bb5658622fd63528c8f312a31c/family1 is initiating major compaction (all files) 2023-02-09 20:55:58,928 INFO [Listener at localhost/46855] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-09 20:55:58,928 INFO [Listener at localhost/46855] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 20:55:58,928 INFO [Listener at localhost/46855] regionserver.HRegion(2258): Starting compaction of c01761bb5658622fd63528c8f312a31c/family1 in ns:testMinorCompaction,,1675976147822.c01761bb5658622fd63528c8f312a31c. 2023-02-09 20:55:58,928 INFO [Listener at localhost/46855] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/c01761bb5658622fd63528c8f312a31c/family1/a5a6266c974d4f7888398c0ca24bb806, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/c01761bb5658622fd63528c8f312a31c/family1/3da9e9e405104c9b8087b72dc1528276, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/c01761bb5658622fd63528c8f312a31c/family1/b3572693de06499fa58e0b9e8de0b9fe, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/c01761bb5658622fd63528c8f312a31c/family1/c2263e98c796495a95764927b89e3ad6, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/c01761bb5658622fd63528c8f312a31c/family1/fa94fc28ecb045b2b27db463f7fec5c3] into tmpdir=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/c01761bb5658622fd63528c8f312a31c/.tmp, totalSize=26.6 K 2023-02-09 20:55:58,929 DEBUG [Listener at localhost/46855] compactions.Compactor(207): Compacting a5a6266c974d4f7888398c0ca24bb806, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1675976149935 2023-02-09 20:55:58,929 DEBUG [Listener at localhost/46855] compactions.Compactor(207): Compacting 3da9e9e405104c9b8087b72dc1528276, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1675976151711 2023-02-09 20:55:58,929 DEBUG [Listener at localhost/46855] compactions.Compactor(207): Compacting b3572693de06499fa58e0b9e8de0b9fe, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1675976153499 2023-02-09 20:55:58,930 DEBUG [Listener at localhost/46855] compactions.Compactor(207): Compacting c2263e98c796495a95764927b89e3ad6, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1675976155279 2023-02-09 20:55:58,930 DEBUG [Listener at localhost/46855] compactions.Compactor(207): Compacting fa94fc28ecb045b2b27db463f7fec5c3, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-09 20:55:58,939 INFO [Listener at localhost/46855] throttle.PressureAwareThroughputController(145): c01761bb5658622fd63528c8f312a31c#family1#compaction#149 average throughput is 0.83 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-09 20:55:59,347 INFO [Listener at localhost/46855] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20230209a71ea968839a4f16afde9f43d21e7259_del 2023-02-09 20:55:59,347 INFO [Listener at localhost/46855] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230209a71ea968839a4f16afde9f43d21e7259_del to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20230209a71ea968839a4f16afde9f43d21e7259_del 2023-02-09 20:56:00,161 INFO [Listener at localhost/46855] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 651816ef5e404768be564eff91707cd2 2023-02-09 20:56:00,161 DEBUG [Listener at localhost/46855] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/c01761bb5658622fd63528c8f312a31c/.tmp/family1/651816ef5e404768be564eff91707cd2 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/c01761bb5658622fd63528c8f312a31c/family1/651816ef5e404768be564eff91707cd2 2023-02-09 20:56:00,164 INFO [Listener at localhost/46855] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 651816ef5e404768be564eff91707cd2 2023-02-09 20:56:00,165 INFO [Listener at localhost/46855] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in c01761bb5658622fd63528c8f312a31c/family1 of c01761bb5658622fd63528c8f312a31c into 651816ef5e404768be564eff91707cd2(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-09 20:56:00,165 DEBUG [Listener at localhost/46855] regionserver.HRegion(2288): Compaction status journal for c01761bb5658622fd63528c8f312a31c: 2023-02-09 20:56:00,166 DEBUG [Listener at localhost/46855] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-09 20:56:00,166 DEBUG [Listener at localhost/46855] regionserver.HStore(1912): c01761bb5658622fd63528c8f312a31c/family2 is initiating major compaction (all files) 2023-02-09 20:56:00,166 INFO [Listener at localhost/46855] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-09 20:56:00,166 INFO [Listener at localhost/46855] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 20:56:00,166 INFO [Listener at localhost/46855] regionserver.HRegion(2258): Starting compaction of c01761bb5658622fd63528c8f312a31c/family2 in ns:testMinorCompaction,,1675976147822.c01761bb5658622fd63528c8f312a31c. 2023-02-09 20:56:00,167 INFO [Listener at localhost/46855] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/c01761bb5658622fd63528c8f312a31c/family2/2f582487611b43ca8111c736d68ed187, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/c01761bb5658622fd63528c8f312a31c/family2/22c17a4accce4deb9262464456de3536, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/c01761bb5658622fd63528c8f312a31c/family2/36f6c2831845412594f56bf1b73e0d07, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/c01761bb5658622fd63528c8f312a31c/family2/26fd2ea5c7f84f29a29a31acaf81d239, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/c01761bb5658622fd63528c8f312a31c/family2/bcaa33b5eef246b19042cfbebb227829] into tmpdir=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/c01761bb5658622fd63528c8f312a31c/.tmp, totalSize=25.3 K 2023-02-09 20:56:00,167 DEBUG [Listener at localhost/46855] compactions.Compactor(207): Compacting 2f582487611b43ca8111c736d68ed187, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1675976149935 2023-02-09 20:56:00,167 DEBUG [Listener at localhost/46855] compactions.Compactor(207): Compacting 22c17a4accce4deb9262464456de3536, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1675976151711 2023-02-09 20:56:00,168 DEBUG [Listener at localhost/46855] compactions.Compactor(207): Compacting 36f6c2831845412594f56bf1b73e0d07, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1675976153499 2023-02-09 20:56:00,168 DEBUG [Listener at localhost/46855] compactions.Compactor(207): Compacting 26fd2ea5c7f84f29a29a31acaf81d239, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1675976155279 2023-02-09 20:56:00,168 DEBUG [Listener at localhost/46855] compactions.Compactor(207): Compacting bcaa33b5eef246b19042cfbebb227829, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-09 20:56:00,174 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/c01761bb5658622fd63528c8f312a31c/family1/a5a6266c974d4f7888398c0ca24bb806, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/c01761bb5658622fd63528c8f312a31c/family1/3da9e9e405104c9b8087b72dc1528276, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/c01761bb5658622fd63528c8f312a31c/family1/b3572693de06499fa58e0b9e8de0b9fe, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/c01761bb5658622fd63528c8f312a31c/family1/c2263e98c796495a95764927b89e3ad6, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/c01761bb5658622fd63528c8f312a31c/family1/fa94fc28ecb045b2b27db463f7fec5c3] to archive 2023-02-09 20:56:00,174 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 20:56:00,176 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/c01761bb5658622fd63528c8f312a31c/family1/a5a6266c974d4f7888398c0ca24bb806 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/ns/testMinorCompaction/c01761bb5658622fd63528c8f312a31c/family1/a5a6266c974d4f7888398c0ca24bb806 2023-02-09 20:56:00,176 INFO [Listener at localhost/46855] throttle.PressureAwareThroughputController(145): c01761bb5658622fd63528c8f312a31c#family2#compaction#150 average throughput is 0.34 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-09 20:56:00,177 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/c01761bb5658622fd63528c8f312a31c/family1/3da9e9e405104c9b8087b72dc1528276 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/ns/testMinorCompaction/c01761bb5658622fd63528c8f312a31c/family1/3da9e9e405104c9b8087b72dc1528276 2023-02-09 20:56:00,178 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/c01761bb5658622fd63528c8f312a31c/family1/b3572693de06499fa58e0b9e8de0b9fe to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/ns/testMinorCompaction/c01761bb5658622fd63528c8f312a31c/family1/b3572693de06499fa58e0b9e8de0b9fe 2023-02-09 20:56:00,179 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/c01761bb5658622fd63528c8f312a31c/family1/c2263e98c796495a95764927b89e3ad6 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/ns/testMinorCompaction/c01761bb5658622fd63528c8f312a31c/family1/c2263e98c796495a95764927b89e3ad6 2023-02-09 20:56:00,180 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/c01761bb5658622fd63528c8f312a31c/family1/fa94fc28ecb045b2b27db463f7fec5c3 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/ns/testMinorCompaction/c01761bb5658622fd63528c8f312a31c/family1/fa94fc28ecb045b2b27db463f7fec5c3 2023-02-09 20:56:00,183 INFO [Listener at localhost/46855] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e202302092d9ec2e76d1e4b49b569378a918eedb3_del 2023-02-09 20:56:00,183 INFO [Listener at localhost/46855] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202302092d9ec2e76d1e4b49b569378a918eedb3_del to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e202302092d9ec2e76d1e4b49b569378a918eedb3_del 2023-02-09 20:56:01,006 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-09 20:56:01,006 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6c4447f6 to 127.0.0.1:62089 2023-02-09 20:56:01,006 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 20:56:01,006 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-09 20:56:01,006 INFO [Listener at localhost/46855] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1ec2ae969d704b65ac02ca0d4814e462 2023-02-09 20:56:01,006 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6bcd0d7c to 127.0.0.1:62089 2023-02-09 20:56:01,007 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 20:56:01,007 DEBUG [Listener at localhost/46855] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/c01761bb5658622fd63528c8f312a31c/.tmp/family2/1ec2ae969d704b65ac02ca0d4814e462 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/c01761bb5658622fd63528c8f312a31c/family2/1ec2ae969d704b65ac02ca0d4814e462 2023-02-09 20:56:01,011 INFO [Listener at localhost/46855] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1ec2ae969d704b65ac02ca0d4814e462 2023-02-09 20:56:01,012 INFO [Listener at localhost/46855] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in c01761bb5658622fd63528c8f312a31c/family2 of c01761bb5658622fd63528c8f312a31c into 1ec2ae969d704b65ac02ca0d4814e462(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-09 20:56:01,012 DEBUG [Listener at localhost/46855] regionserver.HRegion(2288): Compaction status journal for c01761bb5658622fd63528c8f312a31c: 2023-02-09 20:56:01,012 DEBUG [Listener at localhost/46855] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-09 20:56:01,012 DEBUG [Listener at localhost/46855] regionserver.HStore(1912): 15bceddc51e736adeea65067f01af28b/family1 is initiating major compaction (all files) 2023-02-09 20:56:01,012 INFO [Listener at localhost/46855] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-09 20:56:01,012 INFO [Listener at localhost/46855] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 20:56:01,012 INFO [Listener at localhost/46855] regionserver.HRegion(2258): Starting compaction of 15bceddc51e736adeea65067f01af28b/family1 in ns:testMinorCompaction,2,1675976147822.15bceddc51e736adeea65067f01af28b. 2023-02-09 20:56:01,012 INFO [Listener at localhost/46855] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/15bceddc51e736adeea65067f01af28b/family1/18055a08d6b541a7865b836ce136f473, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/15bceddc51e736adeea65067f01af28b/family1/5ad78838aa5d4b59bdffc109173b4f64, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/15bceddc51e736adeea65067f01af28b/family1/b9c378733771466bb82333d527004b71, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/15bceddc51e736adeea65067f01af28b/family1/9160d2af94ee449c83873cd655c7a838, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/15bceddc51e736adeea65067f01af28b/family1/a9dde2c6fde34e109fe5796377eeffc4] into tmpdir=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/15bceddc51e736adeea65067f01af28b/.tmp, totalSize=26.6 K 2023-02-09 20:56:01,013 DEBUG [Listener at localhost/46855] compactions.Compactor(207): Compacting 18055a08d6b541a7865b836ce136f473, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1675976149936 2023-02-09 20:56:01,013 DEBUG [Listener at localhost/46855] compactions.Compactor(207): Compacting 5ad78838aa5d4b59bdffc109173b4f64, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1675976151712 2023-02-09 20:56:01,013 DEBUG [Listener at localhost/46855] compactions.Compactor(207): Compacting b9c378733771466bb82333d527004b71, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1675976153499 2023-02-09 20:56:01,013 DEBUG [Listener at localhost/46855] compactions.Compactor(207): Compacting 9160d2af94ee449c83873cd655c7a838, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1675976155279 2023-02-09 20:56:01,013 DEBUG [Listener at localhost/46855] compactions.Compactor(207): Compacting a9dde2c6fde34e109fe5796377eeffc4, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-09 20:56:01,021 INFO [Listener at localhost/46855] throttle.PressureAwareThroughputController(145): 15bceddc51e736adeea65067f01af28b#family1#compaction#151 average throughput is 0.83 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-09 20:56:01,076 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/c01761bb5658622fd63528c8f312a31c/family2/2f582487611b43ca8111c736d68ed187, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/c01761bb5658622fd63528c8f312a31c/family2/22c17a4accce4deb9262464456de3536, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/c01761bb5658622fd63528c8f312a31c/family2/36f6c2831845412594f56bf1b73e0d07, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/c01761bb5658622fd63528c8f312a31c/family2/26fd2ea5c7f84f29a29a31acaf81d239, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/c01761bb5658622fd63528c8f312a31c/family2/bcaa33b5eef246b19042cfbebb227829] to archive 2023-02-09 20:56:01,077 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 20:56:01,078 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/c01761bb5658622fd63528c8f312a31c/family2/2f582487611b43ca8111c736d68ed187 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/ns/testMinorCompaction/c01761bb5658622fd63528c8f312a31c/family2/2f582487611b43ca8111c736d68ed187 2023-02-09 20:56:01,079 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/c01761bb5658622fd63528c8f312a31c/family2/22c17a4accce4deb9262464456de3536 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/ns/testMinorCompaction/c01761bb5658622fd63528c8f312a31c/family2/22c17a4accce4deb9262464456de3536 2023-02-09 20:56:01,080 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/c01761bb5658622fd63528c8f312a31c/family2/36f6c2831845412594f56bf1b73e0d07 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/ns/testMinorCompaction/c01761bb5658622fd63528c8f312a31c/family2/36f6c2831845412594f56bf1b73e0d07 2023-02-09 20:56:01,081 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/c01761bb5658622fd63528c8f312a31c/family2/26fd2ea5c7f84f29a29a31acaf81d239 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/ns/testMinorCompaction/c01761bb5658622fd63528c8f312a31c/family2/26fd2ea5c7f84f29a29a31acaf81d239 2023-02-09 20:56:01,082 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/c01761bb5658622fd63528c8f312a31c/family2/bcaa33b5eef246b19042cfbebb227829 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/ns/testMinorCompaction/c01761bb5658622fd63528c8f312a31c/family2/bcaa33b5eef246b19042cfbebb227829 2023-02-09 20:56:01,429 INFO [Listener at localhost/46855] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20230209ff9a8c310a1141ea8135c9399d482dfc_del 2023-02-09 20:56:01,429 INFO [Listener at localhost/46855] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230209ff9a8c310a1141ea8135c9399d482dfc_del to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20230209ff9a8c310a1141ea8135c9399d482dfc_del 2023-02-09 20:56:02,244 INFO [Listener at localhost/46855] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for bd97f9dcf49c46c3925523885274bec0 2023-02-09 20:56:02,244 DEBUG [Listener at localhost/46855] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/15bceddc51e736adeea65067f01af28b/.tmp/family1/bd97f9dcf49c46c3925523885274bec0 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/15bceddc51e736adeea65067f01af28b/family1/bd97f9dcf49c46c3925523885274bec0 2023-02-09 20:56:02,248 INFO [Listener at localhost/46855] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for bd97f9dcf49c46c3925523885274bec0 2023-02-09 20:56:02,249 INFO [Listener at localhost/46855] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 15bceddc51e736adeea65067f01af28b/family1 of 15bceddc51e736adeea65067f01af28b into bd97f9dcf49c46c3925523885274bec0(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-09 20:56:02,249 DEBUG [Listener at localhost/46855] regionserver.HRegion(2288): Compaction status journal for 15bceddc51e736adeea65067f01af28b: 2023-02-09 20:56:02,250 DEBUG [Listener at localhost/46855] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-09 20:56:02,250 DEBUG [Listener at localhost/46855] regionserver.HStore(1912): 15bceddc51e736adeea65067f01af28b/family2 is initiating major compaction (all files) 2023-02-09 20:56:02,250 INFO [Listener at localhost/46855] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-09 20:56:02,250 INFO [Listener at localhost/46855] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 20:56:02,250 INFO [Listener at localhost/46855] regionserver.HRegion(2258): Starting compaction of 15bceddc51e736adeea65067f01af28b/family2 in ns:testMinorCompaction,2,1675976147822.15bceddc51e736adeea65067f01af28b. 2023-02-09 20:56:02,250 INFO [Listener at localhost/46855] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/15bceddc51e736adeea65067f01af28b/family2/df96b7bd9ec54102b89b9dba06d9e181, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/15bceddc51e736adeea65067f01af28b/family2/619510d65dd64b9093520305c9bbf769, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/15bceddc51e736adeea65067f01af28b/family2/c1ff4e769ffe446e8ed796acb9a20b8d, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/15bceddc51e736adeea65067f01af28b/family2/9ee702dbd05244ba93647608f29f2512, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/15bceddc51e736adeea65067f01af28b/family2/f8285f071f4a402783c62f0ab5b756f1] into tmpdir=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/15bceddc51e736adeea65067f01af28b/.tmp, totalSize=25.3 K 2023-02-09 20:56:02,251 DEBUG [Listener at localhost/46855] compactions.Compactor(207): Compacting df96b7bd9ec54102b89b9dba06d9e181, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1675976149936 2023-02-09 20:56:02,251 DEBUG [Listener at localhost/46855] compactions.Compactor(207): Compacting 619510d65dd64b9093520305c9bbf769, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1675976151712 2023-02-09 20:56:02,251 DEBUG [Listener at localhost/46855] compactions.Compactor(207): Compacting c1ff4e769ffe446e8ed796acb9a20b8d, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1675976153499 2023-02-09 20:56:02,252 DEBUG [Listener at localhost/46855] compactions.Compactor(207): Compacting 9ee702dbd05244ba93647608f29f2512, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1675976155279 2023-02-09 20:56:02,252 DEBUG [Listener at localhost/46855] compactions.Compactor(207): Compacting f8285f071f4a402783c62f0ab5b756f1, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-09 20:56:02,262 INFO [Listener at localhost/46855] throttle.PressureAwareThroughputController(145): 15bceddc51e736adeea65067f01af28b#family2#compaction#152 average throughput is 0.34 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-09 20:56:02,274 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/15bceddc51e736adeea65067f01af28b/family1/18055a08d6b541a7865b836ce136f473, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/15bceddc51e736adeea65067f01af28b/family1/5ad78838aa5d4b59bdffc109173b4f64, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/15bceddc51e736adeea65067f01af28b/family1/b9c378733771466bb82333d527004b71, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/15bceddc51e736adeea65067f01af28b/family1/9160d2af94ee449c83873cd655c7a838, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/15bceddc51e736adeea65067f01af28b/family1/a9dde2c6fde34e109fe5796377eeffc4] to archive 2023-02-09 20:56:02,275 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 20:56:02,276 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/15bceddc51e736adeea65067f01af28b/family1/18055a08d6b541a7865b836ce136f473 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/ns/testMinorCompaction/15bceddc51e736adeea65067f01af28b/family1/18055a08d6b541a7865b836ce136f473 2023-02-09 20:56:02,278 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/15bceddc51e736adeea65067f01af28b/family1/5ad78838aa5d4b59bdffc109173b4f64 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/ns/testMinorCompaction/15bceddc51e736adeea65067f01af28b/family1/5ad78838aa5d4b59bdffc109173b4f64 2023-02-09 20:56:02,279 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/15bceddc51e736adeea65067f01af28b/family1/b9c378733771466bb82333d527004b71 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/ns/testMinorCompaction/15bceddc51e736adeea65067f01af28b/family1/b9c378733771466bb82333d527004b71 2023-02-09 20:56:02,280 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/15bceddc51e736adeea65067f01af28b/family1/9160d2af94ee449c83873cd655c7a838 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/ns/testMinorCompaction/15bceddc51e736adeea65067f01af28b/family1/9160d2af94ee449c83873cd655c7a838 2023-02-09 20:56:02,281 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/15bceddc51e736adeea65067f01af28b/family1/a9dde2c6fde34e109fe5796377eeffc4 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/ns/testMinorCompaction/15bceddc51e736adeea65067f01af28b/family1/a9dde2c6fde34e109fe5796377eeffc4 2023-02-09 20:56:02,672 INFO [Listener at localhost/46855] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20230209b5c3b74e7a484437ba18071a5c991ceb_del 2023-02-09 20:56:02,672 INFO [Listener at localhost/46855] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230209b5c3b74e7a484437ba18071a5c991ceb_del to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c20230209b5c3b74e7a484437ba18071a5c991ceb_del 2023-02-09 20:56:03,493 INFO [Listener at localhost/46855] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 891ef850c5324389853223281a14987e 2023-02-09 20:56:03,494 DEBUG [Listener at localhost/46855] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/15bceddc51e736adeea65067f01af28b/.tmp/family2/891ef850c5324389853223281a14987e as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/15bceddc51e736adeea65067f01af28b/family2/891ef850c5324389853223281a14987e 2023-02-09 20:56:03,498 INFO [Listener at localhost/46855] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 891ef850c5324389853223281a14987e 2023-02-09 20:56:03,500 INFO [Listener at localhost/46855] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 15bceddc51e736adeea65067f01af28b/family2 of 15bceddc51e736adeea65067f01af28b into 891ef850c5324389853223281a14987e(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-09 20:56:03,500 DEBUG [Listener at localhost/46855] regionserver.HRegion(2288): Compaction status journal for 15bceddc51e736adeea65067f01af28b: 2023-02-09 20:56:03,500 DEBUG [Listener at localhost/46855] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-09 20:56:03,500 DEBUG [Listener at localhost/46855] regionserver.HStore(1912): 1b246bc14d14521c9a184bb2e9c29b83/family1 is initiating major compaction (all files) 2023-02-09 20:56:03,500 INFO [Listener at localhost/46855] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-09 20:56:03,500 INFO [Listener at localhost/46855] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 20:56:03,501 INFO [Listener at localhost/46855] regionserver.HRegion(2258): Starting compaction of 1b246bc14d14521c9a184bb2e9c29b83/family1 in ns:testMinorCompaction,1,1675976147822.1b246bc14d14521c9a184bb2e9c29b83. 2023-02-09 20:56:03,501 INFO [Listener at localhost/46855] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/1b246bc14d14521c9a184bb2e9c29b83/family1/eeb5a6e8a5ca4ef8a32a1589e8f58eb6, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/1b246bc14d14521c9a184bb2e9c29b83/family1/38c1c579a3e14fe39569c51fbf73fe31, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/1b246bc14d14521c9a184bb2e9c29b83/family1/3e976422bf3140d4929e986c4ebb900c, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/1b246bc14d14521c9a184bb2e9c29b83/family1/b17876474d9f4e6dba46a5189072c65c, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/1b246bc14d14521c9a184bb2e9c29b83/family1/758d8988290a4f368a4765453f53e53d] into tmpdir=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/1b246bc14d14521c9a184bb2e9c29b83/.tmp, totalSize=26.6 K 2023-02-09 20:56:03,502 DEBUG [Listener at localhost/46855] compactions.Compactor(207): Compacting eeb5a6e8a5ca4ef8a32a1589e8f58eb6, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1675976149936 2023-02-09 20:56:03,502 DEBUG [Listener at localhost/46855] compactions.Compactor(207): Compacting 38c1c579a3e14fe39569c51fbf73fe31, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1675976151711 2023-02-09 20:56:03,502 DEBUG [Listener at localhost/46855] compactions.Compactor(207): Compacting 3e976422bf3140d4929e986c4ebb900c, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1675976153499 2023-02-09 20:56:03,503 DEBUG [Listener at localhost/46855] compactions.Compactor(207): Compacting b17876474d9f4e6dba46a5189072c65c, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1675976155279 2023-02-09 20:56:03,503 DEBUG [Listener at localhost/46855] compactions.Compactor(207): Compacting 758d8988290a4f368a4765453f53e53d, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-09 20:56:03,511 INFO [Listener at localhost/46855] throttle.PressureAwareThroughputController(145): 1b246bc14d14521c9a184bb2e9c29b83#family1#compaction#153 average throughput is 0.83 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-09 20:56:03,574 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/15bceddc51e736adeea65067f01af28b/family2/df96b7bd9ec54102b89b9dba06d9e181, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/15bceddc51e736adeea65067f01af28b/family2/619510d65dd64b9093520305c9bbf769, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/15bceddc51e736adeea65067f01af28b/family2/c1ff4e769ffe446e8ed796acb9a20b8d, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/15bceddc51e736adeea65067f01af28b/family2/9ee702dbd05244ba93647608f29f2512, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/15bceddc51e736adeea65067f01af28b/family2/f8285f071f4a402783c62f0ab5b756f1] to archive 2023-02-09 20:56:03,575 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 20:56:03,577 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/15bceddc51e736adeea65067f01af28b/family2/df96b7bd9ec54102b89b9dba06d9e181 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/ns/testMinorCompaction/15bceddc51e736adeea65067f01af28b/family2/df96b7bd9ec54102b89b9dba06d9e181 2023-02-09 20:56:03,578 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/15bceddc51e736adeea65067f01af28b/family2/619510d65dd64b9093520305c9bbf769 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/ns/testMinorCompaction/15bceddc51e736adeea65067f01af28b/family2/619510d65dd64b9093520305c9bbf769 2023-02-09 20:56:03,580 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/15bceddc51e736adeea65067f01af28b/family2/c1ff4e769ffe446e8ed796acb9a20b8d to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/ns/testMinorCompaction/15bceddc51e736adeea65067f01af28b/family2/c1ff4e769ffe446e8ed796acb9a20b8d 2023-02-09 20:56:03,581 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/15bceddc51e736adeea65067f01af28b/family2/9ee702dbd05244ba93647608f29f2512 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/ns/testMinorCompaction/15bceddc51e736adeea65067f01af28b/family2/9ee702dbd05244ba93647608f29f2512 2023-02-09 20:56:03,582 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/15bceddc51e736adeea65067f01af28b/family2/f8285f071f4a402783c62f0ab5b756f1 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/ns/testMinorCompaction/15bceddc51e736adeea65067f01af28b/family2/f8285f071f4a402783c62f0ab5b756f1 2023-02-09 20:56:03,920 INFO [Listener at localhost/46855] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20230209bd8e76a174a94d59b23c645b85f4ff9a_del 2023-02-09 20:56:03,920 INFO [Listener at localhost/46855] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230209bd8e76a174a94d59b23c645b85f4ff9a_del to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20230209bd8e76a174a94d59b23c645b85f4ff9a_del 2023-02-09 20:56:04,736 INFO [Listener at localhost/46855] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 64dc2fa7797c4c9e91a7a663c3cf9b90 2023-02-09 20:56:04,737 DEBUG [Listener at localhost/46855] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/1b246bc14d14521c9a184bb2e9c29b83/.tmp/family1/64dc2fa7797c4c9e91a7a663c3cf9b90 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/1b246bc14d14521c9a184bb2e9c29b83/family1/64dc2fa7797c4c9e91a7a663c3cf9b90 2023-02-09 20:56:04,741 INFO [Listener at localhost/46855] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 64dc2fa7797c4c9e91a7a663c3cf9b90 2023-02-09 20:56:04,742 INFO [Listener at localhost/46855] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 1b246bc14d14521c9a184bb2e9c29b83/family1 of 1b246bc14d14521c9a184bb2e9c29b83 into 64dc2fa7797c4c9e91a7a663c3cf9b90(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-09 20:56:04,742 DEBUG [Listener at localhost/46855] regionserver.HRegion(2288): Compaction status journal for 1b246bc14d14521c9a184bb2e9c29b83: 2023-02-09 20:56:04,742 DEBUG [Listener at localhost/46855] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-09 20:56:04,742 DEBUG [Listener at localhost/46855] regionserver.HStore(1912): 1b246bc14d14521c9a184bb2e9c29b83/family2 is initiating major compaction (all files) 2023-02-09 20:56:04,742 INFO [Listener at localhost/46855] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-09 20:56:04,743 INFO [Listener at localhost/46855] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 20:56:04,743 INFO [Listener at localhost/46855] regionserver.HRegion(2258): Starting compaction of 1b246bc14d14521c9a184bb2e9c29b83/family2 in ns:testMinorCompaction,1,1675976147822.1b246bc14d14521c9a184bb2e9c29b83. 2023-02-09 20:56:04,743 INFO [Listener at localhost/46855] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/1b246bc14d14521c9a184bb2e9c29b83/family2/40ee1301865f4ac6918954370f79ba2e, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/1b246bc14d14521c9a184bb2e9c29b83/family2/3937b5e207d34e058dbc13ed882f036b, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/1b246bc14d14521c9a184bb2e9c29b83/family2/409683e868734ed2a53f80e2a778f5ae, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/1b246bc14d14521c9a184bb2e9c29b83/family2/eca6323137564986aa14b5eb7d75ea89, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/1b246bc14d14521c9a184bb2e9c29b83/family2/06d0c0c4d7dc4bad8331dc2a236b12ba] into tmpdir=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/1b246bc14d14521c9a184bb2e9c29b83/.tmp, totalSize=25.3 K 2023-02-09 20:56:04,743 DEBUG [Listener at localhost/46855] compactions.Compactor(207): Compacting 40ee1301865f4ac6918954370f79ba2e, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1675976149936 2023-02-09 20:56:04,744 DEBUG [Listener at localhost/46855] compactions.Compactor(207): Compacting 3937b5e207d34e058dbc13ed882f036b, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1675976151711 2023-02-09 20:56:04,744 DEBUG [Listener at localhost/46855] compactions.Compactor(207): Compacting 409683e868734ed2a53f80e2a778f5ae, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1675976153499 2023-02-09 20:56:04,744 DEBUG [Listener at localhost/46855] compactions.Compactor(207): Compacting eca6323137564986aa14b5eb7d75ea89, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1675976155279 2023-02-09 20:56:04,745 DEBUG [Listener at localhost/46855] compactions.Compactor(207): Compacting 06d0c0c4d7dc4bad8331dc2a236b12ba, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-09 20:56:04,754 INFO [Listener at localhost/46855] throttle.PressureAwareThroughputController(145): 1b246bc14d14521c9a184bb2e9c29b83#family2#compaction#154 average throughput is 0.34 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-09 20:56:04,763 INFO [Listener at localhost/46855] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20230209d6764bc06fea478788c1f9d0e95b4741_del 2023-02-09 20:56:04,763 INFO [Listener at localhost/46855] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230209d6764bc06fea478788c1f9d0e95b4741_del to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b20230209d6764bc06fea478788c1f9d0e95b4741_del 2023-02-09 20:56:04,774 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/1b246bc14d14521c9a184bb2e9c29b83/family1/eeb5a6e8a5ca4ef8a32a1589e8f58eb6, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/1b246bc14d14521c9a184bb2e9c29b83/family1/38c1c579a3e14fe39569c51fbf73fe31, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/1b246bc14d14521c9a184bb2e9c29b83/family1/3e976422bf3140d4929e986c4ebb900c, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/1b246bc14d14521c9a184bb2e9c29b83/family1/b17876474d9f4e6dba46a5189072c65c, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/1b246bc14d14521c9a184bb2e9c29b83/family1/758d8988290a4f368a4765453f53e53d] to archive 2023-02-09 20:56:04,775 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 20:56:04,776 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/1b246bc14d14521c9a184bb2e9c29b83/family1/eeb5a6e8a5ca4ef8a32a1589e8f58eb6 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/ns/testMinorCompaction/1b246bc14d14521c9a184bb2e9c29b83/family1/eeb5a6e8a5ca4ef8a32a1589e8f58eb6 2023-02-09 20:56:04,778 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/1b246bc14d14521c9a184bb2e9c29b83/family1/38c1c579a3e14fe39569c51fbf73fe31 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/ns/testMinorCompaction/1b246bc14d14521c9a184bb2e9c29b83/family1/38c1c579a3e14fe39569c51fbf73fe31 2023-02-09 20:56:04,779 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/1b246bc14d14521c9a184bb2e9c29b83/family1/3e976422bf3140d4929e986c4ebb900c to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/ns/testMinorCompaction/1b246bc14d14521c9a184bb2e9c29b83/family1/3e976422bf3140d4929e986c4ebb900c 2023-02-09 20:56:04,780 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/1b246bc14d14521c9a184bb2e9c29b83/family1/b17876474d9f4e6dba46a5189072c65c to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/ns/testMinorCompaction/1b246bc14d14521c9a184bb2e9c29b83/family1/b17876474d9f4e6dba46a5189072c65c 2023-02-09 20:56:04,781 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/1b246bc14d14521c9a184bb2e9c29b83/family1/758d8988290a4f368a4765453f53e53d to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/ns/testMinorCompaction/1b246bc14d14521c9a184bb2e9c29b83/family1/758d8988290a4f368a4765453f53e53d 2023-02-09 20:56:04,791 INFO [Listener at localhost/46855] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8c210edf6fde4aa3a566dd8362c3b63e 2023-02-09 20:56:04,792 DEBUG [Listener at localhost/46855] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/1b246bc14d14521c9a184bb2e9c29b83/.tmp/family2/8c210edf6fde4aa3a566dd8362c3b63e as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/1b246bc14d14521c9a184bb2e9c29b83/family2/8c210edf6fde4aa3a566dd8362c3b63e 2023-02-09 20:56:04,796 INFO [Listener at localhost/46855] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8c210edf6fde4aa3a566dd8362c3b63e 2023-02-09 20:56:04,797 INFO [Listener at localhost/46855] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 1b246bc14d14521c9a184bb2e9c29b83/family2 of 1b246bc14d14521c9a184bb2e9c29b83 into 8c210edf6fde4aa3a566dd8362c3b63e(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-09 20:56:04,797 DEBUG [Listener at localhost/46855] regionserver.HRegion(2288): Compaction status journal for 1b246bc14d14521c9a184bb2e9c29b83: 2023-02-09 20:56:04,800 DEBUG [Listener at localhost/46855] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-09 20:56:04,803 DEBUG [Listener at localhost/46855] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-09 20:56:04,807 DEBUG [Listener at localhost/46855] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-09 20:56:04,808 DEBUG [Listener at localhost/46855] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-09 20:56:04,814 INFO [Listener at localhost/46855] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-02-09 20:56:04,827 INFO [Listener at localhost/46855] compactions.PartitionedMobCompactor(306): The compaction type is PART_FILES, the request has 3 del files, 3 selected files, and 0 irrelevant files table 'ns:testMinorCompaction' and column 'family1' 2023-02-09 20:56:04,830 INFO [Listener at localhost/46855] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20230209a71ea968839a4f16afde9f43d21e7259_del 2023-02-09 20:56:04,833 INFO [Listener at localhost/46855] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20230209bd8e76a174a94d59b23c645b85f4ff9a_del 2023-02-09 20:56:04,836 INFO [Listener at localhost/46855] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20230209ff9a8c310a1141ea8135c9399d482dfc_del 2023-02-09 20:56:04,836 INFO [Listener at localhost/46855] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='ns:testMinorCompaction' column='family1' 2023-02-09 20:56:04,836 DEBUG [Listener at localhost/46855] zookeeper.ReadOnlyZKClient(139): Connect 0x2e2acbf5 to 127.0.0.1:62089 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 20:56:04,840 DEBUG [Listener at localhost/46855] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7d06799d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 20:56:04,842 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20230209 for table='ns:testMinorCompaction' and column='family1' 2023-02-09 20:56:04,842 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20230209 for table='ns:testMinorCompaction' and column='family1' 2023-02-09 20:56:04,842 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20230209 for table='ns:testMinorCompaction' and column='family1' 2023-02-09 20:56:04,878 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/1b246bc14d14521c9a184bb2e9c29b83/family2/40ee1301865f4ac6918954370f79ba2e, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/1b246bc14d14521c9a184bb2e9c29b83/family2/3937b5e207d34e058dbc13ed882f036b, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/1b246bc14d14521c9a184bb2e9c29b83/family2/409683e868734ed2a53f80e2a778f5ae, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/1b246bc14d14521c9a184bb2e9c29b83/family2/eca6323137564986aa14b5eb7d75ea89, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/1b246bc14d14521c9a184bb2e9c29b83/family2/06d0c0c4d7dc4bad8331dc2a236b12ba] to archive 2023-02-09 20:56:04,879 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 20:56:04,881 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/1b246bc14d14521c9a184bb2e9c29b83/family2/40ee1301865f4ac6918954370f79ba2e to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/ns/testMinorCompaction/1b246bc14d14521c9a184bb2e9c29b83/family2/40ee1301865f4ac6918954370f79ba2e 2023-02-09 20:56:04,883 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/1b246bc14d14521c9a184bb2e9c29b83/family2/3937b5e207d34e058dbc13ed882f036b to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/ns/testMinorCompaction/1b246bc14d14521c9a184bb2e9c29b83/family2/3937b5e207d34e058dbc13ed882f036b 2023-02-09 20:56:04,884 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/1b246bc14d14521c9a184bb2e9c29b83/family2/409683e868734ed2a53f80e2a778f5ae to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/ns/testMinorCompaction/1b246bc14d14521c9a184bb2e9c29b83/family2/409683e868734ed2a53f80e2a778f5ae 2023-02-09 20:56:04,885 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/1b246bc14d14521c9a184bb2e9c29b83/family2/eca6323137564986aa14b5eb7d75ea89 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/ns/testMinorCompaction/1b246bc14d14521c9a184bb2e9c29b83/family2/eca6323137564986aa14b5eb7d75ea89 2023-02-09 20:56:04,886 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/1b246bc14d14521c9a184bb2e9c29b83/family2/06d0c0c4d7dc4bad8331dc2a236b12ba to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/ns/testMinorCompaction/1b246bc14d14521c9a184bb2e9c29b83/family2/06d0c0c4d7dc4bad8331dc2a236b12ba 2023-02-09 20:56:05,298 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230209fcd92d7386d948f892545630718ce2b7 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20230209fcd92d7386d948f892545630718ce2b7 2023-02-09 20:56:05,299 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230209 table='ns:testMinorCompaction' column='family1' 2023-02-09 20:56:05,301 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023020999c300b3120240b297d732882646b119 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c2023020999c300b3120240b297d732882646b119 2023-02-09 20:56:05,302 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230209 table='ns:testMinorCompaction' column='family1' 2023-02-09 20:56:05,304 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202302095b6d60da94474a8d9d20601ea00fd2cb to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e202302095b6d60da94474a8d9d20601ea00fd2cb 2023-02-09 20:56:05,304 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230209 table='ns:testMinorCompaction' column='family1' 2023-02-09 20:56:05,316 DEBUG [MobFileCompactionChore-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 20:56:05,320 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:57372, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 20:56:05,328 DEBUG [MobFileCompactionChore-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-09 20:56:05,332 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:42196, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-09 20:56:05,359 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20230209/family1/ef2bc0040cb1443c88e6da396b408586 first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x01] 2023-02-09 20:56:05,362 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20230209/family1/ddee96cb57c346c8815b4471a135a9e6 first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x01] 2023-02-09 20:56:05,364 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=ns:testMinorCompaction,1,1675976147822.1b246bc14d14521c9a184bb2e9c29b83., hostname=jenkins-hbase9.apache.org,40919,1675976022294, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20230209/family1/ddee96cb57c346c8815b4471a135a9e6}] 2023-02-09 20:56:05,364 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=ns:testMinorCompaction,2,1675976147822.15bceddc51e736adeea65067f01af28b., hostname=jenkins-hbase9.apache.org,40919,1675976022294, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20230209/family1/ef2bc0040cb1443c88e6da396b408586}] 2023-02-09 20:56:05,368 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20230209/family1/ecd559ce9ac943428ca90bc8cf0b31f5 first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x01] 2023-02-09 20:56:05,374 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=ns:testMinorCompaction,,1675976147822.c01761bb5658622fd63528c8f312a31c., hostname=jenkins-hbase9.apache.org,40919,1675976022294, seqNum=2 for row with hfile group [{family1,hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20230209/family1/ecd559ce9ac943428ca90bc8cf0b31f5}] 2023-02-09 20:56:05,383 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40919] regionserver.HStore(763): Validating hfile at hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20230209/family1/ddee96cb57c346c8815b4471a135a9e6 for inclusion in 1b246bc14d14521c9a184bb2e9c29b83/family1 2023-02-09 20:56:05,384 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HStore(763): Validating hfile at hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20230209/family1/ef2bc0040cb1443c88e6da396b408586 for inclusion in 15bceddc51e736adeea65067f01af28b/family1 2023-02-09 20:56:05,384 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40919] regionserver.HStore(763): Validating hfile at hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20230209/family1/ecd559ce9ac943428ca90bc8cf0b31f5 for inclusion in c01761bb5658622fd63528c8f312a31c/family1 2023-02-09 20:56:05,386 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x01 2023-02-09 20:56:05,387 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40919] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x01 2023-02-09 20:56:05,387 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40919] regionserver.HStore(777): Region bounds: first=1 last=2 2023-02-09 20:56:05,387 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HStore(777): Region bounds: first=2 last= 2023-02-09 20:56:05,387 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40919] regionserver.HRegion(2445): Flush status journal for 1b246bc14d14521c9a184bb2e9c29b83: 2023-02-09 20:56:05,387 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HRegion(2445): Flush status journal for 15bceddc51e736adeea65067f01af28b: 2023-02-09 20:56:05,389 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20230209/family1/ef2bc0040cb1443c88e6da396b408586 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/staging/jenkins__ns_testMinorCompaction__n80l0t0oko47epaid1i0cajh5fakivcvjhb5ulj1j8dakcetsnp85rc2j6pefpkl/family1/ef2bc0040cb1443c88e6da396b408586 2023-02-09 20:56:05,389 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40919] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20230209/family1/ddee96cb57c346c8815b4471a135a9e6 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/staging/jenkins__ns_testMinorCompaction__35mmj3u9d8558n3g64lo2404fnbq7va6qv0nocq0jcrnvfiegdicr3om9ujjts7p/family1/ddee96cb57c346c8815b4471a135a9e6 2023-02-09 20:56:05,391 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/staging/jenkins__ns_testMinorCompaction__n80l0t0oko47epaid1i0cajh5fakivcvjhb5ulj1j8dakcetsnp85rc2j6pefpkl/family1/ef2bc0040cb1443c88e6da396b408586 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/15bceddc51e736adeea65067f01af28b/family1/7ded6fe5b4fb4a99abaf9fa9f606d8ad_SeqId_28_ 2023-02-09 20:56:05,391 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40919] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/staging/jenkins__ns_testMinorCompaction__35mmj3u9d8558n3g64lo2404fnbq7va6qv0nocq0jcrnvfiegdicr3om9ujjts7p/family1/ddee96cb57c346c8815b4471a135a9e6 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/1b246bc14d14521c9a184bb2e9c29b83/family1/38b717a68d4b4d57bfaf2d22e91a2db1_SeqId_28_ 2023-02-09 20:56:05,391 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HStore(849): Loaded HFile hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/staging/jenkins__ns_testMinorCompaction__n80l0t0oko47epaid1i0cajh5fakivcvjhb5ulj1j8dakcetsnp85rc2j6pefpkl/family1/ef2bc0040cb1443c88e6da396b408586 into 15bceddc51e736adeea65067f01af28b/family1 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/15bceddc51e736adeea65067f01af28b/family1/7ded6fe5b4fb4a99abaf9fa9f606d8ad_SeqId_28_ - updating store file list. 2023-02-09 20:56:05,391 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40919] regionserver.HStore(849): Loaded HFile hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/staging/jenkins__ns_testMinorCompaction__35mmj3u9d8558n3g64lo2404fnbq7va6qv0nocq0jcrnvfiegdicr3om9ujjts7p/family1/ddee96cb57c346c8815b4471a135a9e6 into 1b246bc14d14521c9a184bb2e9c29b83/family1 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/1b246bc14d14521c9a184bb2e9c29b83/family1/38b717a68d4b4d57bfaf2d22e91a2db1_SeqId_28_ - updating store file list. 2023-02-09 20:56:05,392 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40919] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x01 2023-02-09 20:56:05,392 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40919] regionserver.HStore(777): Region bounds: first= last=1 2023-02-09 20:56:05,392 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40919] regionserver.HRegion(2445): Flush status journal for c01761bb5658622fd63528c8f312a31c: 2023-02-09 20:56:05,393 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40919] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20230209/family1/ecd559ce9ac943428ca90bc8cf0b31f5 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/staging/jenkins__ns_testMinorCompaction__v1mmvlc0gg54ig0v0httmf83gdookvdo6s4kgemqg6e245q6akp9svfu2evjv4c4/family1/ecd559ce9ac943428ca90bc8cf0b31f5 2023-02-09 20:56:05,395 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40919] regionserver.HStore(882): Loaded HFile hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/1b246bc14d14521c9a184bb2e9c29b83/family1/38b717a68d4b4d57bfaf2d22e91a2db1_SeqId_28_ into 1b246bc14d14521c9a184bb2e9c29b83/family1 2023-02-09 20:56:05,395 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40919] regionserver.HStore(855): Successfully loaded hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/staging/jenkins__ns_testMinorCompaction__35mmj3u9d8558n3g64lo2404fnbq7va6qv0nocq0jcrnvfiegdicr3om9ujjts7p/family1/ddee96cb57c346c8815b4471a135a9e6 into 1b246bc14d14521c9a184bb2e9c29b83/family1 (new location: hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/1b246bc14d14521c9a184bb2e9c29b83/family1/38b717a68d4b4d57bfaf2d22e91a2db1_SeqId_28_) 2023-02-09 20:56:05,395 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HStore(882): Loaded HFile hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/15bceddc51e736adeea65067f01af28b/family1/7ded6fe5b4fb4a99abaf9fa9f606d8ad_SeqId_28_ into 15bceddc51e736adeea65067f01af28b/family1 2023-02-09 20:56:05,396 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.HStore(855): Successfully loaded hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/staging/jenkins__ns_testMinorCompaction__n80l0t0oko47epaid1i0cajh5fakivcvjhb5ulj1j8dakcetsnp85rc2j6pefpkl/family1/ef2bc0040cb1443c88e6da396b408586 into 15bceddc51e736adeea65067f01af28b/family1 (new location: hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/15bceddc51e736adeea65067f01af28b/family1/7ded6fe5b4fb4a99abaf9fa9f606d8ad_SeqId_28_) 2023-02-09 20:56:05,396 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40919] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/staging/jenkins__ns_testMinorCompaction__35mmj3u9d8558n3g64lo2404fnbq7va6qv0nocq0jcrnvfiegdicr3om9ujjts7p/family1/ddee96cb57c346c8815b4471a135a9e6 2023-02-09 20:56:05,399 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40919] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/staging/jenkins__ns_testMinorCompaction__n80l0t0oko47epaid1i0cajh5fakivcvjhb5ulj1j8dakcetsnp85rc2j6pefpkl/family1/ef2bc0040cb1443c88e6da396b408586 2023-02-09 20:56:05,399 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230209 table='ns:testMinorCompaction' column='family1' 2023-02-09 20:56:05,399 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40919] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/staging/jenkins__ns_testMinorCompaction__v1mmvlc0gg54ig0v0httmf83gdookvdo6s4kgemqg6e245q6akp9svfu2evjv4c4/family1/ecd559ce9ac943428ca90bc8cf0b31f5 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/c01761bb5658622fd63528c8f312a31c/family1/a36c86ab0fe04440ae448cb672e01800_SeqId_28_ 2023-02-09 20:56:05,400 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40919] regionserver.HStore(849): Loaded HFile hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/staging/jenkins__ns_testMinorCompaction__v1mmvlc0gg54ig0v0httmf83gdookvdo6s4kgemqg6e245q6akp9svfu2evjv4c4/family1/ecd559ce9ac943428ca90bc8cf0b31f5 into c01761bb5658622fd63528c8f312a31c/family1 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/c01761bb5658622fd63528c8f312a31c/family1/a36c86ab0fe04440ae448cb672e01800_SeqId_28_ - updating store file list. 2023-02-09 20:56:05,400 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 20:56:05,400 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230209 table='ns:testMinorCompaction' column='family1' 2023-02-09 20:56:05,401 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 20:56:05,401 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20230209830a069bb8a743d9aa2bca0e41074f34 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20230209830a069bb8a743d9aa2bca0e41074f34 2023-02-09 20:56:05,401 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-02-09 20:56:05,401 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20230209' 2023-02-09 20:56:05,402 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20230209 for table='ns:testMinorCompaction' and column='family1' 2023-02-09 20:56:05,403 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c2023020980dc1d69530447c9a89e60b9b79007b3 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c2023020980dc1d69530447c9a89e60b9b79007b3 2023-02-09 20:56:05,403 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-02-09 20:56:05,403 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20230209' 2023-02-09 20:56:05,403 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20230209 for table='ns:testMinorCompaction' and column='family1' 2023-02-09 20:56:05,408 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40919] regionserver.HStore(882): Loaded HFile hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/c01761bb5658622fd63528c8f312a31c/family1/a36c86ab0fe04440ae448cb672e01800_SeqId_28_ into c01761bb5658622fd63528c8f312a31c/family1 2023-02-09 20:56:05,408 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40919] regionserver.HStore(855): Successfully loaded hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/staging/jenkins__ns_testMinorCompaction__v1mmvlc0gg54ig0v0httmf83gdookvdo6s4kgemqg6e245q6akp9svfu2evjv4c4/family1/ecd559ce9ac943428ca90bc8cf0b31f5 into c01761bb5658622fd63528c8f312a31c/family1 (new location: hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/c01761bb5658622fd63528c8f312a31c/family1/a36c86ab0fe04440ae448cb672e01800_SeqId_28_) 2023-02-09 20:56:05,408 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40919] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/staging/jenkins__ns_testMinorCompaction__v1mmvlc0gg54ig0v0httmf83gdookvdo6s4kgemqg6e245q6akp9svfu2evjv4c4/family1/ecd559ce9ac943428ca90bc8cf0b31f5 2023-02-09 20:56:05,410 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230209 table='ns:testMinorCompaction' column='family1' 2023-02-09 20:56:05,411 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 20:56:05,412 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e202302093aab13a2a4ed4699bb8f149fb535cc6a to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e202302093aab13a2a4ed4699bb8f149fb535cc6a 2023-02-09 20:56:05,412 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-02-09 20:56:05,412 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20230209' 2023-02-09 20:56:05,412 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20230209 for table='ns:testMinorCompaction' and column='family1' 2023-02-09 20:56:05,412 INFO [Listener at localhost/46855] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='ns:testMinorCompaction' column='family1' 2023-02-09 20:56:05,415 DEBUG [Listener at localhost/46855] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-09 20:56:05,416 DEBUG [Listener at localhost/46855] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-09 20:56:05,419 DEBUG [Listener at localhost/46855] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-09 20:56:05,420 DEBUG [Listener at localhost/46855] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-09 20:56:05,437 INFO [Listener at localhost/46855] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompaction Thread=248 (was 284), OpenFileDescriptor=624 (was 760), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=140 (was 140), ProcessCount=168 (was 168), AvailableMemoryMB=10822 (was 10519) - AvailableMemoryMB LEAK? - 2023-02-09 20:56:05,452 INFO [Listener at localhost/46855] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompactionWithMonthlyPolicy Thread=248, OpenFileDescriptor=624, MaxFileDescriptor=60000, SystemLoadAverage=140, ProcessCount=168, AvailableMemoryMB=10821 2023-02-09 20:56:05,454 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.HMaster$4(2102): Client=jenkins//172.31.2.10 create 'testMinorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-02-09 20:56:05,455 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure2.ProcedureExecutor(1029): Stored pid=112, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:05,456 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-02-09 20:56:05,457 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(697): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testMinorCompactionWithMonthlyPolicy" procId is: 112 2023-02-09 20:56:05,457 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-09 20:56:05,457 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1227): Checking to see if procedure is done pid=112 2023-02-09 20:56:05,458 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/4b04882a70d4b3887c9c68945ea20cdc 2023-02-09 20:56:05,459 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/4b04882a70d4b3887c9c68945ea20cdc empty. 2023-02-09 20:56:05,459 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/4b04882a70d4b3887c9c68945ea20cdc 2023-02-09 20:56:05,459 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testMinorCompactionWithMonthlyPolicy regions 2023-02-09 20:56:05,469 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/.tabledesc/.tableinfo.0000000001 2023-02-09 20:56:05,470 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(7671): creating {ENCODED => 4b04882a70d4b3887c9c68945ea20cdc, NAME => 'testMinorCompactionWithMonthlyPolicy,,1675976165454.4b04882a70d4b3887c9c68945ea20cdc.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMinorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}, regionDir=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/.tmp 2023-02-09 20:56:05,558 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1227): Checking to see if procedure is done pid=112 2023-02-09 20:56:05,759 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1227): Checking to see if procedure is done pid=112 2023-02-09 20:56:05,876 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(865): Instantiated testMinorCompactionWithMonthlyPolicy,,1675976165454.4b04882a70d4b3887c9c68945ea20cdc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 20:56:05,877 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1603): Closing 4b04882a70d4b3887c9c68945ea20cdc, disabling compactions & flushes 2023-02-09 20:56:05,877 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1625): Closing region testMinorCompactionWithMonthlyPolicy,,1675976165454.4b04882a70d4b3887c9c68945ea20cdc. 2023-02-09 20:56:05,877 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMinorCompactionWithMonthlyPolicy,,1675976165454.4b04882a70d4b3887c9c68945ea20cdc. 2023-02-09 20:56:05,877 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1713): Acquired close lock on testMinorCompactionWithMonthlyPolicy,,1675976165454.4b04882a70d4b3887c9c68945ea20cdc. after waiting 0 ms 2023-02-09 20:56:05,877 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1723): Updates disabled for region testMinorCompactionWithMonthlyPolicy,,1675976165454.4b04882a70d4b3887c9c68945ea20cdc. 2023-02-09 20:56:05,877 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1837): Closed testMinorCompactionWithMonthlyPolicy,,1675976165454.4b04882a70d4b3887c9c68945ea20cdc. 2023-02-09 20:56:05,877 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1557): Region close journal for 4b04882a70d4b3887c9c68945ea20cdc: Waiting for close lock at 1675976165877Disabling compacts and flushes for region at 1675976165877Disabling writes for close at 1675976165877Writing region close event to WAL at 1675976165877Closed at 1675976165877 2023-02-09 20:56:05,879 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-02-09 20:56:05,880 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMinorCompactionWithMonthlyPolicy,,1675976165454.4b04882a70d4b3887c9c68945ea20cdc.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1675976165880"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675976165880"}]},"ts":"1675976165880"} 2023-02-09 20:56:05,881 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-09 20:56:05,882 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-09 20:56:05,882 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675976165882"}]},"ts":"1675976165882"} 2023-02-09 20:56:05,883 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithMonthlyPolicy, state=ENABLING in hbase:meta 2023-02-09 20:56:05,886 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=4b04882a70d4b3887c9c68945ea20cdc, ASSIGN}] 2023-02-09 20:56:05,887 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=4b04882a70d4b3887c9c68945ea20cdc, ASSIGN 2023-02-09 20:56:05,887 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=4b04882a70d4b3887c9c68945ea20cdc, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,40919,1675976022294; forceNewPlan=false, retain=false 2023-02-09 20:56:06,038 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=113 updating hbase:meta row=4b04882a70d4b3887c9c68945ea20cdc, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:06,039 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMinorCompactionWithMonthlyPolicy,,1675976165454.4b04882a70d4b3887c9c68945ea20cdc.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1675976166038"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675976166038"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675976166038"}]},"ts":"1675976166038"} 2023-02-09 20:56:06,040 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=114, ppid=113, state=RUNNABLE; OpenRegionProcedure 4b04882a70d4b3887c9c68945ea20cdc, server=jenkins-hbase9.apache.org,40919,1675976022294}] 2023-02-09 20:56:06,060 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1227): Checking to see if procedure is done pid=112 2023-02-09 20:56:06,194 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open testMinorCompactionWithMonthlyPolicy,,1675976165454.4b04882a70d4b3887c9c68945ea20cdc. 2023-02-09 20:56:06,194 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 4b04882a70d4b3887c9c68945ea20cdc, NAME => 'testMinorCompactionWithMonthlyPolicy,,1675976165454.4b04882a70d4b3887c9c68945ea20cdc.', STARTKEY => '', ENDKEY => ''} 2023-02-09 20:56:06,195 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompactionWithMonthlyPolicy 4b04882a70d4b3887c9c68945ea20cdc 2023-02-09 20:56:06,195 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated testMinorCompactionWithMonthlyPolicy,,1675976165454.4b04882a70d4b3887c9c68945ea20cdc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 20:56:06,195 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for 4b04882a70d4b3887c9c68945ea20cdc 2023-02-09 20:56:06,195 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for 4b04882a70d4b3887c9c68945ea20cdc 2023-02-09 20:56:06,196 INFO [StoreOpener-4b04882a70d4b3887c9c68945ea20cdc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 4b04882a70d4b3887c9c68945ea20cdc 2023-02-09 20:56:06,197 DEBUG [StoreOpener-4b04882a70d4b3887c9c68945ea20cdc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithMonthlyPolicy/4b04882a70d4b3887c9c68945ea20cdc/family1 2023-02-09 20:56:06,197 DEBUG [StoreOpener-4b04882a70d4b3887c9c68945ea20cdc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithMonthlyPolicy/4b04882a70d4b3887c9c68945ea20cdc/family1 2023-02-09 20:56:06,198 INFO [StoreOpener-4b04882a70d4b3887c9c68945ea20cdc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4b04882a70d4b3887c9c68945ea20cdc columnFamilyName family1 2023-02-09 20:56:06,203 INFO [StoreOpener-4b04882a70d4b3887c9c68945ea20cdc-1] regionserver.HStore(310): Store=4b04882a70d4b3887c9c68945ea20cdc/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 20:56:06,204 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithMonthlyPolicy/4b04882a70d4b3887c9c68945ea20cdc 2023-02-09 20:56:06,205 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithMonthlyPolicy/4b04882a70d4b3887c9c68945ea20cdc 2023-02-09 20:56:06,206 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for 4b04882a70d4b3887c9c68945ea20cdc 2023-02-09 20:56:06,208 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithMonthlyPolicy/4b04882a70d4b3887c9c68945ea20cdc/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 20:56:06,208 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened 4b04882a70d4b3887c9c68945ea20cdc; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62230721, jitterRate=-0.07268999516963959}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-09 20:56:06,208 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for 4b04882a70d4b3887c9c68945ea20cdc: Running coprocessor pre-open hook at 1675976166195Writing region info on filesystem at 1675976166195Initializing all the Stores at 1675976166196 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} at 1675976166196Cleaning up temporary data from old regions at 1675976166205 (+9 ms)Cleaning up detritus from prior splits at 1675976166205Running coprocessor post-open hooks at 1675976166208 (+3 ms)Region opened successfully at 1675976166208 2023-02-09 20:56:06,209 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMinorCompactionWithMonthlyPolicy,,1675976165454.4b04882a70d4b3887c9c68945ea20cdc., pid=114, masterSystemTime=1675976166192 2023-02-09 20:56:06,210 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMinorCompactionWithMonthlyPolicy,,1675976165454.4b04882a70d4b3887c9c68945ea20cdc. 2023-02-09 20:56:06,210 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened testMinorCompactionWithMonthlyPolicy,,1675976165454.4b04882a70d4b3887c9c68945ea20cdc. 2023-02-09 20:56:06,211 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=113 updating hbase:meta row=4b04882a70d4b3887c9c68945ea20cdc, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:06,211 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMinorCompactionWithMonthlyPolicy,,1675976165454.4b04882a70d4b3887c9c68945ea20cdc.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1675976166211"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675976166211"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675976166211"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675976166211"}]},"ts":"1675976166211"} 2023-02-09 20:56:06,213 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=114, resume processing ppid=113 2023-02-09 20:56:06,213 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=114, ppid=113, state=SUCCESS; OpenRegionProcedure 4b04882a70d4b3887c9c68945ea20cdc, server=jenkins-hbase9.apache.org,40919,1675976022294 in 172 msec 2023-02-09 20:56:06,215 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=113, resume processing ppid=112 2023-02-09 20:56:06,215 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=113, ppid=112, state=SUCCESS; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=4b04882a70d4b3887c9c68945ea20cdc, ASSIGN in 328 msec 2023-02-09 20:56:06,215 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-09 20:56:06,215 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675976166215"}]},"ts":"1675976166215"} 2023-02-09 20:56:06,216 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithMonthlyPolicy, state=ENABLED in hbase:meta 2023-02-09 20:56:06,219 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-02-09 20:56:06,220 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=112, state=SUCCESS; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy in 765 msec 2023-02-09 20:56:06,561 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1227): Checking to see if procedure is done pid=112 2023-02-09 20:56:06,561 INFO [Listener at localhost/46855] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMinorCompactionWithMonthlyPolicy, procId: 112 completed 2023-02-09 20:56:06,578 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(933): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-02-09 20:56:06,583 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:06,583 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-02-09 20:56:06,583 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:56:06,583 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-09 20:56:06,583 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-09 20:56:06,583 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:06,583 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:06,586 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:56:06,586 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:06,586 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:56:06,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:56:06,586 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:06,587 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 20:56:06,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:06,587 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:06,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 20:56:06,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:06,587 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:06,590 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:06,590 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-09 20:56:06,590 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:56:06,590 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-09 20:56:06,591 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 20:56:06,591 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 20:56:06,591 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1675976165454.4b04882a70d4b3887c9c68945ea20cdc. 2023-02-09 20:56:06,591 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1675976165454.4b04882a70d4b3887c9c68945ea20cdc. started... 2023-02-09 20:56:06,592 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 4b04882a70d4b3887c9c68945ea20cdc 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-02-09 20:56:06,632 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015113014b91ac552d54637b25da64564ff4d81 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015113014b91ac552d54637b25da64564ff4d81 2023-02-09 20:56:07,035 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithMonthlyPolicy/4b04882a70d4b3887c9c68945ea20cdc/.tmp/family1/fde798c3f77943208337e595d87520b7 2023-02-09 20:56:07,039 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithMonthlyPolicy/4b04882a70d4b3887c9c68945ea20cdc/.tmp/family1/fde798c3f77943208337e595d87520b7 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithMonthlyPolicy/4b04882a70d4b3887c9c68945ea20cdc/family1/fde798c3f77943208337e595d87520b7 2023-02-09 20:56:07,043 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithMonthlyPolicy/4b04882a70d4b3887c9c68945ea20cdc/family1/fde798c3f77943208337e595d87520b7, entries=1000, sequenceid=5, filesize=166.0 K 2023-02-09 20:56:07,044 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 4b04882a70d4b3887c9c68945ea20cdc in 451ms, sequenceid=5, compaction requested=false 2023-02-09 20:56:07,044 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMinorCompactionWithMonthlyPolicy' 2023-02-09 20:56:07,044 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 4b04882a70d4b3887c9c68945ea20cdc: 2023-02-09 20:56:07,044 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1675976165454.4b04882a70d4b3887c9c68945ea20cdc. 2023-02-09 20:56:07,044 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 20:56:07,044 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 20:56:07,044 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:07,044 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-02-09 20:56:07,044 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-02-09 20:56:07,045 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:07,045 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:07,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:07,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:56:07,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:56:07,046 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:07,046 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 20:56:07,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:56:07,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:56:07,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:07,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:07,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:56:07,047 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-02-09 20:56:07,047 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@43f92587[Count = 0] remaining members to acquire global barrier 2023-02-09 20:56:07,047 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-09 20:56:07,047 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:07,048 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:07,048 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:07,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:07,048 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-09 20:56:07,048 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-02-09 20:56:07,049 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase9.apache.org,40919,1675976022294' in zk 2023-02-09 20:56:07,049 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:07,049 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 20:56:07,050 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-09 20:56:07,050 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:07,050 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:56:07,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:07,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:56:07,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:56:07,050 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-02-09 20:56:07,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:56:07,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:56:07,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:07,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:07,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:56:07,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:07,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:07,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase9.apache.org,40919,1675976022294': 2023-02-09 20:56:07,052 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-09 20:56:07,052 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-02-09 20:56:07,052 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 20:56:07,052 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 20:56:07,052 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:07,052 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 20:56:07,056 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:07,056 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:07,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:07,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:56:07,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:56:07,056 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:07,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:07,056 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:56:07,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:56:07,056 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:56:07,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:56:07,057 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:07,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:07,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:07,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:56:07,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:07,058 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:07,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:07,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:56:07,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:07,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:07,060 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:07,060 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:56:07,060 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:07,060 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:56:07,060 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-02-09 20:56:07,060 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 20:56:07,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:56:07,060 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-09 20:56:07,060 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:56:07,060 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:56:07,060 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:07,060 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-09 20:56:07,060 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:56:07,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:56:07,060 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 20:56:07,060 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:07,061 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:07,061 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:07,061 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:07,161 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 20:56:07,161 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 20:56:07,165 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(933): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-02-09 20:56:07,167 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-09 20:56:07,167 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:07,167 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-02-09 20:56:07,167 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:56:07,167 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-09 20:56:07,167 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-09 20:56:07,167 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:07,167 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:07,168 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:07,168 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:56:07,168 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:56:07,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:56:07,169 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:07,169 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 20:56:07,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:07,169 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:07,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 20:56:07,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:07,169 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:07,169 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-02-09 20:56:07,170 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:07,170 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-09 20:56:07,170 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:56:07,170 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-09 20:56:07,170 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 20:56:07,170 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 20:56:07,170 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1675976165454.4b04882a70d4b3887c9c68945ea20cdc. 2023-02-09 20:56:07,170 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1675976165454.4b04882a70d4b3887c9c68945ea20cdc. started... 2023-02-09 20:56:07,170 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 4b04882a70d4b3887c9c68945ea20cdc 1/1 column families, dataSize=74 B heapSize=408 B 2023-02-09 20:56:07,582 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128627b39b6da454bf9b5a15c2cc3822714 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151128627b39b6da454bf9b5a15c2cc3822714 2023-02-09 20:56:07,987 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithMonthlyPolicy/4b04882a70d4b3887c9c68945ea20cdc/.tmp/family1/f1eb40b6252e4179b31f3ebccd5b74da 2023-02-09 20:56:07,992 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithMonthlyPolicy/4b04882a70d4b3887c9c68945ea20cdc/.tmp/family1/f1eb40b6252e4179b31f3ebccd5b74da as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithMonthlyPolicy/4b04882a70d4b3887c9c68945ea20cdc/family1/f1eb40b6252e4179b31f3ebccd5b74da 2023-02-09 20:56:07,996 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithMonthlyPolicy/4b04882a70d4b3887c9c68945ea20cdc/family1/f1eb40b6252e4179b31f3ebccd5b74da, entries=1, sequenceid=9, filesize=5.0 K 2023-02-09 20:56:07,997 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 4b04882a70d4b3887c9c68945ea20cdc in 827ms, sequenceid=9, compaction requested=false 2023-02-09 20:56:07,997 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 4b04882a70d4b3887c9c68945ea20cdc: 2023-02-09 20:56:07,997 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1675976165454.4b04882a70d4b3887c9c68945ea20cdc. 2023-02-09 20:56:07,997 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 20:56:07,997 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 20:56:07,997 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:07,997 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-02-09 20:56:07,997 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-02-09 20:56:07,998 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:07,998 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:07,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:07,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:56:07,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:56:07,999 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:07,999 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 20:56:07,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:56:07,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:56:07,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:07,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:08,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:56:08,000 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-02-09 20:56:08,000 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@eb7ebfd[Count = 0] remaining members to acquire global barrier 2023-02-09 20:56:08,000 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-09 20:56:08,000 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:08,002 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:08,002 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:08,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:08,002 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-09 20:56:08,002 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:08,002 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 20:56:08,002 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-02-09 20:56:08,002 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase9.apache.org,40919,1675976022294' in zk 2023-02-09 20:56:08,003 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-09 20:56:08,003 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:08,003 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:56:08,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:08,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:56:08,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:56:08,003 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-02-09 20:56:08,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:56:08,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:56:08,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:08,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:08,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:56:08,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:08,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:08,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase9.apache.org,40919,1675976022294': 2023-02-09 20:56:08,005 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-09 20:56:08,005 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-02-09 20:56:08,005 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 20:56:08,005 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 20:56:08,005 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:08,005 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 20:56:08,007 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:08,007 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:08,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:08,007 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:56:08,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:56:08,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:56:08,007 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:08,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:08,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:56:08,007 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:56:08,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:56:08,007 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:08,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:08,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:08,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:56:08,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:08,008 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:08,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:08,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:56:08,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:08,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:08,010 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:56:08,010 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:08,010 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:56:08,010 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:56:08,010 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-02-09 20:56:08,010 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 20:56:08,010 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:08,010 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:56:08,010 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:08,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:56:08,010 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:08,010 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:08,010 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:08,010 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:08,010 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-09 20:56:08,011 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:56:08,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:56:08,011 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 20:56:08,111 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 20:56:08,112 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 20:56:08,115 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(933): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-02-09 20:56:08,117 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-09 20:56:08,117 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:08,117 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-02-09 20:56:08,117 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:56:08,117 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-09 20:56:08,117 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-09 20:56:08,117 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:08,117 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:08,128 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:08,128 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:56:08,128 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:56:08,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:56:08,128 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:08,128 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 20:56:08,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:08,128 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:08,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 20:56:08,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:08,129 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:08,129 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-02-09 20:56:08,129 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:08,129 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-09 20:56:08,129 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:56:08,129 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-09 20:56:08,129 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 20:56:08,129 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 20:56:08,129 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1675976165454.4b04882a70d4b3887c9c68945ea20cdc. 2023-02-09 20:56:08,129 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1675976165454.4b04882a70d4b3887c9c68945ea20cdc. started... 2023-02-09 20:56:08,130 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 4b04882a70d4b3887c9c68945ea20cdc 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-09 20:56:08,541 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120132cb111cd7b549fb9a0de90d316f901d to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015120132cb111cd7b549fb9a0de90d316f901d 2023-02-09 20:56:08,946 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithMonthlyPolicy/4b04882a70d4b3887c9c68945ea20cdc/.tmp/family1/9b682b0f89a14fec859bfc32d65723b5 2023-02-09 20:56:08,950 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithMonthlyPolicy/4b04882a70d4b3887c9c68945ea20cdc/.tmp/family1/9b682b0f89a14fec859bfc32d65723b5 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithMonthlyPolicy/4b04882a70d4b3887c9c68945ea20cdc/family1/9b682b0f89a14fec859bfc32d65723b5 2023-02-09 20:56:08,953 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithMonthlyPolicy/4b04882a70d4b3887c9c68945ea20cdc/family1/9b682b0f89a14fec859bfc32d65723b5, entries=1, sequenceid=13, filesize=4.9 K 2023-02-09 20:56:08,954 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 4b04882a70d4b3887c9c68945ea20cdc in 824ms, sequenceid=13, compaction requested=true 2023-02-09 20:56:08,954 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 4b04882a70d4b3887c9c68945ea20cdc: 2023-02-09 20:56:08,954 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1675976165454.4b04882a70d4b3887c9c68945ea20cdc. 2023-02-09 20:56:08,954 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 20:56:08,954 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 20:56:08,954 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:08,954 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-02-09 20:56:08,954 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-02-09 20:56:08,956 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:08,956 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:08,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:08,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:56:08,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:56:08,956 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:08,956 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 20:56:08,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:56:08,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:56:08,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:08,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:08,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:56:08,957 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-02-09 20:56:08,957 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2c18414a[Count = 0] remaining members to acquire global barrier 2023-02-09 20:56:08,957 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-09 20:56:08,957 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:08,958 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:08,958 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:08,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:08,958 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-09 20:56:08,958 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-02-09 20:56:08,958 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase9.apache.org,40919,1675976022294' in zk 2023-02-09 20:56:08,958 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:08,958 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 20:56:08,959 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-09 20:56:08,959 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:56:08,959 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:08,960 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-02-09 20:56:08,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:08,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:56:08,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:56:08,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:56:08,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:56:08,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:08,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:08,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:56:08,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:08,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:08,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase9.apache.org,40919,1675976022294': 2023-02-09 20:56:08,962 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-09 20:56:08,962 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-02-09 20:56:08,962 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 20:56:08,962 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 20:56:08,962 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:08,962 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 20:56:08,964 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:08,964 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:08,964 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:08,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:08,964 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:56:08,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:08,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:56:08,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:56:08,964 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:56:08,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:56:08,964 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:08,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:56:08,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:08,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:08,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:56:08,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:08,965 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:08,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:08,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:56:08,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:08,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:08,967 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:08,967 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:56:08,967 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:08,967 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:56:08,967 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:08,967 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-02-09 20:56:08,967 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 20:56:08,967 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:56:08,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:56:08,967 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:56:08,967 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-09 20:56:08,968 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-09 20:56:08,967 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:08,968 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 20:56:08,968 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:08,968 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:08,968 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:08,968 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:56:08,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:56:09,068 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 20:56:09,069 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 20:56:09,072 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(933): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-02-09 20:56:09,074 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-09 20:56:09,074 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:09,074 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-02-09 20:56:09,074 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:56:09,074 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-09 20:56:09,074 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-09 20:56:09,074 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:09,074 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:09,075 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:09,075 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:56:09,076 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:56:09,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:56:09,076 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:09,076 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 20:56:09,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:09,076 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:09,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 20:56:09,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:09,076 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:09,077 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-02-09 20:56:09,077 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:09,077 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-09 20:56:09,077 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:56:09,077 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-09 20:56:09,077 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 20:56:09,077 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 20:56:09,077 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1675976165454.4b04882a70d4b3887c9c68945ea20cdc. 2023-02-09 20:56:09,077 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1675976165454.4b04882a70d4b3887c9c68945ea20cdc. started... 2023-02-09 20:56:09,077 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 4b04882a70d4b3887c9c68945ea20cdc 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-09 20:56:09,487 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205e5c1b1d85b87450a9ad54ed116ceda30 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151205e5c1b1d85b87450a9ad54ed116ceda30 2023-02-09 20:56:09,892 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithMonthlyPolicy/4b04882a70d4b3887c9c68945ea20cdc/.tmp/family1/f1d7eedcf49e41c680a6b399c9f42e0a 2023-02-09 20:56:09,896 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithMonthlyPolicy/4b04882a70d4b3887c9c68945ea20cdc/.tmp/family1/f1d7eedcf49e41c680a6b399c9f42e0a as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithMonthlyPolicy/4b04882a70d4b3887c9c68945ea20cdc/family1/f1d7eedcf49e41c680a6b399c9f42e0a 2023-02-09 20:56:09,899 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithMonthlyPolicy/4b04882a70d4b3887c9c68945ea20cdc/family1/f1d7eedcf49e41c680a6b399c9f42e0a, entries=1, sequenceid=17, filesize=4.9 K 2023-02-09 20:56:09,900 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 4b04882a70d4b3887c9c68945ea20cdc in 823ms, sequenceid=17, compaction requested=true 2023-02-09 20:56:09,900 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 4b04882a70d4b3887c9c68945ea20cdc: 2023-02-09 20:56:09,901 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1675976165454.4b04882a70d4b3887c9c68945ea20cdc. 2023-02-09 20:56:09,901 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 20:56:09,901 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 20:56:09,901 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:09,901 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-02-09 20:56:09,901 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-02-09 20:56:09,902 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:09,902 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:09,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:09,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:56:09,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:56:09,902 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:09,902 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 20:56:09,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:56:09,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:56:09,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:09,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:09,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:56:09,904 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-02-09 20:56:09,904 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@62a01747[Count = 0] remaining members to acquire global barrier 2023-02-09 20:56:09,904 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-09 20:56:09,904 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:09,906 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:09,906 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:09,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:09,906 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-09 20:56:09,906 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-02-09 20:56:09,906 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase9.apache.org,40919,1675976022294' in zk 2023-02-09 20:56:09,906 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:09,906 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 20:56:09,907 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-09 20:56:09,907 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:56:09,907 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:09,907 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-02-09 20:56:09,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:09,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:56:09,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:56:09,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:56:09,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:56:09,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:09,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:09,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:56:09,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:09,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:09,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase9.apache.org,40919,1675976022294': 2023-02-09 20:56:09,909 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-09 20:56:09,909 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-02-09 20:56:09,909 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 20:56:09,909 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 20:56:09,909 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:09,909 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 20:56:09,911 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:09,911 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:09,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:09,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:56:09,911 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:09,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:09,911 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:56:09,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:56:09,911 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:09,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:56:09,911 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:56:09,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:56:09,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:09,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:09,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:56:09,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:09,912 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:09,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:09,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:56:09,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:09,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:09,914 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:09,914 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:09,914 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:09,914 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:56:09,914 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:09,914 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:56:09,914 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:09,914 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:09,914 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:09,914 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-02-09 20:56:09,914 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-09 20:56:09,914 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:56:09,914 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:56:09,914 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 20:56:09,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:56:09,915 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-09 20:56:09,915 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 20:56:09,915 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:56:09,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:56:10,015 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 20:56:10,016 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 20:56:10,021 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(933): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-02-09 20:56:10,022 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-09 20:56:10,022 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:10,022 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-02-09 20:56:10,022 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:56:10,022 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-09 20:56:10,022 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-09 20:56:10,023 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:10,023 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:10,025 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:56:10,025 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:10,025 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:56:10,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:56:10,026 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:10,026 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 20:56:10,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:10,026 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:10,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 20:56:10,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:10,027 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:10,027 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-02-09 20:56:10,027 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:10,027 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-09 20:56:10,027 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:56:10,027 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-09 20:56:10,027 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 20:56:10,027 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 20:56:10,027 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1675976165454.4b04882a70d4b3887c9c68945ea20cdc. 2023-02-09 20:56:10,027 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1675976165454.4b04882a70d4b3887c9c68945ea20cdc. started... 2023-02-09 20:56:10,027 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 4b04882a70d4b3887c9c68945ea20cdc 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-09 20:56:10,439 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228955a3f14a5684b71b8586c696afd5b67 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151228955a3f14a5684b71b8586c696afd5b67 2023-02-09 20:56:10,443 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithMonthlyPolicy/4b04882a70d4b3887c9c68945ea20cdc/.tmp/family1/755d47b20e0c480384f3f3e33448b28e 2023-02-09 20:56:10,447 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithMonthlyPolicy/4b04882a70d4b3887c9c68945ea20cdc/.tmp/family1/755d47b20e0c480384f3f3e33448b28e as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithMonthlyPolicy/4b04882a70d4b3887c9c68945ea20cdc/family1/755d47b20e0c480384f3f3e33448b28e 2023-02-09 20:56:10,450 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithMonthlyPolicy/4b04882a70d4b3887c9c68945ea20cdc/family1/755d47b20e0c480384f3f3e33448b28e, entries=1, sequenceid=21, filesize=4.9 K 2023-02-09 20:56:10,451 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 4b04882a70d4b3887c9c68945ea20cdc in 424ms, sequenceid=21, compaction requested=true 2023-02-09 20:56:10,451 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 4b04882a70d4b3887c9c68945ea20cdc: 2023-02-09 20:56:10,451 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1675976165454.4b04882a70d4b3887c9c68945ea20cdc. 2023-02-09 20:56:10,451 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 20:56:10,451 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 20:56:10,451 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:10,451 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-02-09 20:56:10,451 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-02-09 20:56:10,453 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:10,453 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:10,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:10,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:56:10,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:56:10,453 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:10,453 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 20:56:10,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:56:10,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:56:10,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:10,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:10,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:56:10,455 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-02-09 20:56:10,455 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@68ffc389[Count = 0] remaining members to acquire global barrier 2023-02-09 20:56:10,455 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-09 20:56:10,455 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:10,456 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:10,456 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:10,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:10,456 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-09 20:56:10,456 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-02-09 20:56:10,456 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:10,456 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 20:56:10,456 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase9.apache.org,40919,1675976022294' in zk 2023-02-09 20:56:10,458 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-09 20:56:10,458 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:10,458 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:56:10,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:10,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:56:10,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:56:10,458 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-02-09 20:56:10,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:56:10,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:56:10,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:10,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:10,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:56:10,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:10,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:10,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase9.apache.org,40919,1675976022294': 2023-02-09 20:56:10,460 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-09 20:56:10,460 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-02-09 20:56:10,460 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 20:56:10,460 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 20:56:10,460 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:10,460 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 20:56:10,462 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:10,462 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:10,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:10,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:56:10,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:56:10,462 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:10,462 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:56:10,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:10,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:56:10,463 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:10,463 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:56:10,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:56:10,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:10,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:10,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:56:10,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:10,464 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:10,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:10,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:56:10,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:10,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:10,468 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:56:10,468 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:56:10,468 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:10,468 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:10,468 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:10,468 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:10,469 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-02-09 20:56:10,469 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 20:56:10,468 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:56:10,469 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-09 20:56:10,469 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:10,469 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:56:10,469 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:10,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:56:10,469 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:10,469 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-09 20:56:10,469 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 20:56:10,469 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:56:10,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:56:10,569 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 20:56:10,570 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 20:56:10,573 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(933): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-02-09 20:56:10,575 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-09 20:56:10,575 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:10,575 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-02-09 20:56:10,575 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:56:10,575 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-09 20:56:10,575 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-09 20:56:10,576 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:10,576 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:10,577 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:10,577 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:56:10,577 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:56:10,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:56:10,577 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:10,577 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 20:56:10,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:10,578 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:10,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 20:56:10,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:10,578 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:10,578 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-02-09 20:56:10,578 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:10,578 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-09 20:56:10,578 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:56:10,578 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-09 20:56:10,578 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 20:56:10,578 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 20:56:10,578 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1675976165454.4b04882a70d4b3887c9c68945ea20cdc. 2023-02-09 20:56:10,579 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1675976165454.4b04882a70d4b3887c9c68945ea20cdc. started... 2023-02-09 20:56:10,579 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 4b04882a70d4b3887c9c68945ea20cdc 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-09 20:56:10,990 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231fdf17d7eb17746d5a44440187a8df216 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151231fdf17d7eb17746d5a44440187a8df216 2023-02-09 20:56:11,395 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithMonthlyPolicy/4b04882a70d4b3887c9c68945ea20cdc/.tmp/family1/64b5618e950d488b97a84c26f09ca050 2023-02-09 20:56:11,399 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithMonthlyPolicy/4b04882a70d4b3887c9c68945ea20cdc/.tmp/family1/64b5618e950d488b97a84c26f09ca050 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithMonthlyPolicy/4b04882a70d4b3887c9c68945ea20cdc/family1/64b5618e950d488b97a84c26f09ca050 2023-02-09 20:56:11,402 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithMonthlyPolicy/4b04882a70d4b3887c9c68945ea20cdc/family1/64b5618e950d488b97a84c26f09ca050, entries=1, sequenceid=25, filesize=4.9 K 2023-02-09 20:56:11,402 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 4b04882a70d4b3887c9c68945ea20cdc in 823ms, sequenceid=25, compaction requested=true 2023-02-09 20:56:11,402 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 4b04882a70d4b3887c9c68945ea20cdc: 2023-02-09 20:56:11,402 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1675976165454.4b04882a70d4b3887c9c68945ea20cdc. 2023-02-09 20:56:11,403 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 20:56:11,403 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 20:56:11,403 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:11,403 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-02-09 20:56:11,403 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-02-09 20:56:11,404 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:11,404 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:11,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:11,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:56:11,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:56:11,405 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:11,405 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 20:56:11,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:56:11,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:56:11,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:11,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:11,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:56:11,406 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-02-09 20:56:11,406 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@59a62568[Count = 0] remaining members to acquire global barrier 2023-02-09 20:56:11,406 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-09 20:56:11,406 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:11,411 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:11,411 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:11,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:11,411 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-09 20:56:11,411 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-02-09 20:56:11,411 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase9.apache.org,40919,1675976022294' in zk 2023-02-09 20:56:11,411 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:11,411 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 20:56:11,412 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:11,412 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-09 20:56:11,412 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:56:11,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:11,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:56:11,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:56:11,412 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-02-09 20:56:11,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:56:11,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:56:11,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:11,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:11,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:56:11,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:11,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:11,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase9.apache.org,40919,1675976022294': 2023-02-09 20:56:11,414 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-09 20:56:11,414 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-02-09 20:56:11,414 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 20:56:11,414 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 20:56:11,414 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:11,414 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 20:56:11,416 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:11,416 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:11,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:11,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:56:11,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:56:11,416 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:56:11,416 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:11,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:11,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:56:11,416 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:56:11,416 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:11,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:56:11,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:11,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:11,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:56:11,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:11,417 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:11,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:11,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:56:11,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:11,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:11,419 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:11,419 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:11,419 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:11,419 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:11,419 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:11,419 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:11,419 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:56:11,419 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-02-09 20:56:11,419 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 20:56:11,419 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:11,419 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:56:11,419 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:56:11,419 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:56:11,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:56:11,419 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-09 20:56:11,420 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-09 20:56:11,420 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:56:11,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:56:11,420 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 20:56:11,520 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 20:56:11,521 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 20:56:11,524 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(933): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-02-09 20:56:11,525 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-09 20:56:11,526 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:11,526 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-02-09 20:56:11,526 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:56:11,526 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-09 20:56:11,526 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-09 20:56:11,526 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:11,526 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:11,527 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:56:11,527 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:11,527 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:56:11,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:56:11,528 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:11,528 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 20:56:11,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:11,528 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:11,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 20:56:11,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:11,528 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:11,529 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-02-09 20:56:11,529 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:11,529 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-09 20:56:11,529 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:56:11,529 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-09 20:56:11,529 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 20:56:11,529 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 20:56:11,529 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1675976165454.4b04882a70d4b3887c9c68945ea20cdc. 2023-02-09 20:56:11,529 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1675976165454.4b04882a70d4b3887c9c68945ea20cdc. started... 2023-02-09 20:56:11,529 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 4b04882a70d4b3887c9c68945ea20cdc 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-09 20:56:11,732 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-09 20:56:11,940 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010123a67f507a6c4254adf8d8f22d268e6b to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2016010123a67f507a6c4254adf8d8f22d268e6b 2023-02-09 20:56:11,945 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithMonthlyPolicy/4b04882a70d4b3887c9c68945ea20cdc/.tmp/family1/3b05107cba134cd58725a797388b3d5c 2023-02-09 20:56:11,948 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithMonthlyPolicy/4b04882a70d4b3887c9c68945ea20cdc/.tmp/family1/3b05107cba134cd58725a797388b3d5c as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithMonthlyPolicy/4b04882a70d4b3887c9c68945ea20cdc/family1/3b05107cba134cd58725a797388b3d5c 2023-02-09 20:56:11,951 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithMonthlyPolicy/4b04882a70d4b3887c9c68945ea20cdc/family1/3b05107cba134cd58725a797388b3d5c, entries=1, sequenceid=29, filesize=4.9 K 2023-02-09 20:56:11,952 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 4b04882a70d4b3887c9c68945ea20cdc in 423ms, sequenceid=29, compaction requested=true 2023-02-09 20:56:11,952 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 4b04882a70d4b3887c9c68945ea20cdc: 2023-02-09 20:56:11,952 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1675976165454.4b04882a70d4b3887c9c68945ea20cdc. 2023-02-09 20:56:11,952 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 20:56:11,952 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 20:56:11,952 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:11,952 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-02-09 20:56:11,952 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-02-09 20:56:11,954 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:11,954 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:11,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:11,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:56:11,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:56:11,955 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:11,955 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 20:56:11,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:56:11,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:56:11,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:11,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:11,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:56:11,956 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-02-09 20:56:11,956 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@375a3d07[Count = 0] remaining members to acquire global barrier 2023-02-09 20:56:11,956 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-09 20:56:11,956 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:11,957 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:11,957 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:11,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:11,957 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-09 20:56:11,957 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-02-09 20:56:11,957 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase9.apache.org,40919,1675976022294' in zk 2023-02-09 20:56:11,957 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:11,957 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 20:56:11,959 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:11,959 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-09 20:56:11,959 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:56:11,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:11,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:56:11,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:56:11,959 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-02-09 20:56:11,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:56:11,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:56:11,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:11,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:11,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:56:11,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:11,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:11,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase9.apache.org,40919,1675976022294': 2023-02-09 20:56:11,960 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-09 20:56:11,960 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-02-09 20:56:11,961 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 20:56:11,961 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 20:56:11,961 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:11,961 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 20:56:11,962 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:11,962 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:11,962 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:11,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:11,962 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:56:11,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:11,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:56:11,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:56:11,962 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:56:11,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:56:11,963 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:11,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:56:11,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:11,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:11,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:56:11,963 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:11,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:11,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:11,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:56:11,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:11,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:11,967 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:56:11,967 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:56:11,967 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:56:11,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:56:11,967 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-02-09 20:56:11,967 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 20:56:11,967 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:11,967 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:56:11,967 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:11,967 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:56:11,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:56:11,967 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:11,967 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-09 20:56:11,967 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:11,967 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-09 20:56:11,967 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 20:56:11,967 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:11,967 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:11,967 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:12,067 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 20:56:12,068 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 20:56:12,072 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(933): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-02-09 20:56:12,073 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-09 20:56:12,074 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:12,074 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-02-09 20:56:12,074 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:56:12,074 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-09 20:56:12,074 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-09 20:56:12,074 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:12,074 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:12,075 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:12,075 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:56:12,076 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:56:12,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:56:12,076 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:12,076 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 20:56:12,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:12,076 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:12,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 20:56:12,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:12,077 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:12,077 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-02-09 20:56:12,077 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:12,077 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-09 20:56:12,077 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:56:12,077 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-09 20:56:12,077 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 20:56:12,077 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 20:56:12,077 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1675976165454.4b04882a70d4b3887c9c68945ea20cdc. 2023-02-09 20:56:12,077 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1675976165454.4b04882a70d4b3887c9c68945ea20cdc. started... 2023-02-09 20:56:12,077 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 4b04882a70d4b3887c9c68945ea20cdc 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-09 20:56:12,490 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103e61e91b734cc4c40bbcacf7835a146b3 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160103e61e91b734cc4c40bbcacf7835a146b3 2023-02-09 20:56:12,895 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithMonthlyPolicy/4b04882a70d4b3887c9c68945ea20cdc/.tmp/family1/5c8570b4a89d45cfa5f7feaab0efdc63 2023-02-09 20:56:12,899 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithMonthlyPolicy/4b04882a70d4b3887c9c68945ea20cdc/.tmp/family1/5c8570b4a89d45cfa5f7feaab0efdc63 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithMonthlyPolicy/4b04882a70d4b3887c9c68945ea20cdc/family1/5c8570b4a89d45cfa5f7feaab0efdc63 2023-02-09 20:56:12,902 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithMonthlyPolicy/4b04882a70d4b3887c9c68945ea20cdc/family1/5c8570b4a89d45cfa5f7feaab0efdc63, entries=1, sequenceid=33, filesize=4.9 K 2023-02-09 20:56:12,902 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 4b04882a70d4b3887c9c68945ea20cdc in 825ms, sequenceid=33, compaction requested=true 2023-02-09 20:56:12,902 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 4b04882a70d4b3887c9c68945ea20cdc: 2023-02-09 20:56:12,902 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1675976165454.4b04882a70d4b3887c9c68945ea20cdc. 2023-02-09 20:56:12,902 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 20:56:12,903 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 20:56:12,903 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:12,903 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-02-09 20:56:12,903 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-02-09 20:56:12,904 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:12,904 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:12,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:12,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:56:12,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:56:12,904 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:12,904 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 20:56:12,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:56:12,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:56:12,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:12,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:12,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:56:12,905 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-02-09 20:56:12,905 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@55a20e84[Count = 0] remaining members to acquire global barrier 2023-02-09 20:56:12,905 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-09 20:56:12,906 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:12,907 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:12,907 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:12,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:12,907 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-09 20:56:12,907 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-02-09 20:56:12,907 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase9.apache.org,40919,1675976022294' in zk 2023-02-09 20:56:12,907 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:12,907 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 20:56:12,910 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-09 20:56:12,910 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:56:12,910 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:12,910 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-02-09 20:56:12,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:12,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:56:12,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:56:12,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:56:12,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:56:12,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:12,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:12,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:56:12,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:12,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:12,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase9.apache.org,40919,1675976022294': 2023-02-09 20:56:12,912 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-09 20:56:12,912 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-02-09 20:56:12,912 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 20:56:12,912 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 20:56:12,912 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:12,912 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 20:56:12,913 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:12,913 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:12,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:12,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:56:12,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:56:12,913 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:12,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:12,913 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:56:12,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:56:12,914 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:12,914 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:56:12,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:56:12,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:12,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:12,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:56:12,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:12,915 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:12,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:12,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:56:12,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:12,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:12,922 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:12,922 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:56:12,922 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:12,922 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:56:12,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:56:12,922 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:56:12,923 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-02-09 20:56:12,923 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 20:56:12,923 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:56:12,923 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:12,923 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-09 20:56:12,923 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:56:12,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:56:12,923 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:12,923 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-09 20:56:12,923 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:12,923 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:12,923 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 20:56:12,923 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:13,023 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 20:56:13,024 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 20:56:13,028 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(933): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-02-09 20:56:13,029 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-09 20:56:13,029 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:13,029 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-02-09 20:56:13,029 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:56:13,029 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-09 20:56:13,029 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-09 20:56:13,030 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:13,030 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:13,032 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:13,032 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:56:13,032 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:56:13,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:56:13,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:13,032 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:13,032 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 20:56:13,032 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:13,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 20:56:13,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:13,033 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:13,033 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-02-09 20:56:13,033 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:13,033 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-09 20:56:13,033 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:56:13,033 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-09 20:56:13,033 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 20:56:13,033 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 20:56:13,033 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1675976165454.4b04882a70d4b3887c9c68945ea20cdc. 2023-02-09 20:56:13,033 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1675976165454.4b04882a70d4b3887c9c68945ea20cdc. started... 2023-02-09 20:56:13,033 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 4b04882a70d4b3887c9c68945ea20cdc 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-09 20:56:13,444 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907f983b6eeb83347c3a8e65e7e0e2c1d4a to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20150907f983b6eeb83347c3a8e65e7e0e2c1d4a 2023-02-09 20:56:13,849 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithMonthlyPolicy/4b04882a70d4b3887c9c68945ea20cdc/.tmp/family1/8144f3038b55415cacd6f1c4ea39d6c8 2023-02-09 20:56:13,854 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithMonthlyPolicy/4b04882a70d4b3887c9c68945ea20cdc/.tmp/family1/8144f3038b55415cacd6f1c4ea39d6c8 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithMonthlyPolicy/4b04882a70d4b3887c9c68945ea20cdc/family1/8144f3038b55415cacd6f1c4ea39d6c8 2023-02-09 20:56:13,857 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithMonthlyPolicy/4b04882a70d4b3887c9c68945ea20cdc/family1/8144f3038b55415cacd6f1c4ea39d6c8, entries=1, sequenceid=37, filesize=4.9 K 2023-02-09 20:56:13,858 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 4b04882a70d4b3887c9c68945ea20cdc in 825ms, sequenceid=37, compaction requested=true 2023-02-09 20:56:13,858 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 4b04882a70d4b3887c9c68945ea20cdc: 2023-02-09 20:56:13,858 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1675976165454.4b04882a70d4b3887c9c68945ea20cdc. 2023-02-09 20:56:13,858 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 20:56:13,858 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 20:56:13,858 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:13,858 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-02-09 20:56:13,858 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-02-09 20:56:13,860 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:13,860 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:13,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:13,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:56:13,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:56:13,860 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:13,860 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 20:56:13,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:56:13,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:56:13,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:13,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:13,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:56:13,861 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-02-09 20:56:13,861 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@43d77c32[Count = 0] remaining members to acquire global barrier 2023-02-09 20:56:13,861 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-09 20:56:13,861 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:13,862 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:13,863 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:13,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:13,863 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-09 20:56:13,863 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-02-09 20:56:13,863 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase9.apache.org,40919,1675976022294' in zk 2023-02-09 20:56:13,863 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:13,863 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 20:56:13,864 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:13,864 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-09 20:56:13,864 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:56:13,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:13,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:56:13,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:56:13,864 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-02-09 20:56:13,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:56:13,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:56:13,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:13,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:13,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:56:13,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:13,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:13,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase9.apache.org,40919,1675976022294': 2023-02-09 20:56:13,866 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-09 20:56:13,866 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-02-09 20:56:13,866 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 20:56:13,866 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 20:56:13,866 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:13,866 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 20:56:13,868 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:13,868 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:13,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:13,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:56:13,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:56:13,868 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:13,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:13,868 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:56:13,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:56:13,869 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:56:13,869 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:13,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:56:13,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:13,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:13,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:56:13,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:13,870 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:13,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:13,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:56:13,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:13,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:13,872 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:13,872 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:13,872 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:13,872 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:13,872 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:13,872 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:13,872 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:56:13,872 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-02-09 20:56:13,872 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 20:56:13,872 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-09 20:56:13,872 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:13,872 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:56:13,872 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:56:13,872 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:56:13,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:56:13,872 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-09 20:56:13,872 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 20:56:13,872 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:56:13,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:56:13,972 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 20:56:13,973 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 20:56:13,977 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(933): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-02-09 20:56:13,979 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-09 20:56:13,979 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:13,979 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-02-09 20:56:13,979 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:56:13,979 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-09 20:56:13,979 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-09 20:56:13,979 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:13,979 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:13,980 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:13,980 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:56:13,980 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:56:13,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:56:13,981 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:13,981 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 20:56:13,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:13,981 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:13,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 20:56:13,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:13,981 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:13,981 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-02-09 20:56:13,982 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:13,982 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-09 20:56:13,982 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:56:13,982 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-09 20:56:13,982 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-09 20:56:13,982 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 20:56:13,982 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1675976165454.4b04882a70d4b3887c9c68945ea20cdc. 2023-02-09 20:56:13,982 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1675976165454.4b04882a70d4b3887c9c68945ea20cdc. started... 2023-02-09 20:56:13,982 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 4b04882a70d4b3887c9c68945ea20cdc 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-09 20:56:14,392 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120c4844f34080b48e7a4d0e118c03e1ee8 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151120c4844f34080b48e7a4d0e118c03e1ee8 2023-02-09 20:56:14,797 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithMonthlyPolicy/4b04882a70d4b3887c9c68945ea20cdc/.tmp/family1/608a0349bb184c1aad2ee3c70978bd62 2023-02-09 20:56:14,801 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithMonthlyPolicy/4b04882a70d4b3887c9c68945ea20cdc/.tmp/family1/608a0349bb184c1aad2ee3c70978bd62 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithMonthlyPolicy/4b04882a70d4b3887c9c68945ea20cdc/family1/608a0349bb184c1aad2ee3c70978bd62 2023-02-09 20:56:14,803 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithMonthlyPolicy/4b04882a70d4b3887c9c68945ea20cdc/family1/608a0349bb184c1aad2ee3c70978bd62, entries=1, sequenceid=41, filesize=4.9 K 2023-02-09 20:56:14,804 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 4b04882a70d4b3887c9c68945ea20cdc in 822ms, sequenceid=41, compaction requested=true 2023-02-09 20:56:14,804 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 4b04882a70d4b3887c9c68945ea20cdc: 2023-02-09 20:56:14,804 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1675976165454.4b04882a70d4b3887c9c68945ea20cdc. 2023-02-09 20:56:14,804 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-09 20:56:14,804 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-09 20:56:14,804 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:14,804 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-02-09 20:56:14,804 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-02-09 20:56:14,806 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:14,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:14,806 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:14,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:56:14,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:56:14,806 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:14,806 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 20:56:14,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:56:14,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:56:14,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:14,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:14,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:56:14,808 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-02-09 20:56:14,808 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2bb29c45[Count = 0] remaining members to acquire global barrier 2023-02-09 20:56:14,808 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-09 20:56:14,808 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:14,809 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:14,809 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:14,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:14,809 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-09 20:56:14,809 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-02-09 20:56:14,809 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:14,810 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 20:56:14,809 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase9.apache.org,40919,1675976022294' in zk 2023-02-09 20:56:14,811 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:14,811 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-09 20:56:14,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:14,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:56:14,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:56:14,811 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:56:14,811 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-02-09 20:56:14,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:56:14,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:56:14,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:14,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:14,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:56:14,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:14,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:14,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase9.apache.org,40919,1675976022294': 2023-02-09 20:56:14,813 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-09 20:56:14,813 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-02-09 20:56:14,813 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 20:56:14,813 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 20:56:14,813 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:14,813 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 20:56:14,814 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:14,814 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:14,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:14,814 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:14,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:56:14,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:56:14,814 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:56:14,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:14,815 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:14,815 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:56:14,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:56:14,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:56:14,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:14,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:14,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:56:14,816 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:14,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:14,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:14,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:56:14,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:14,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:14,818 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:14,818 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:14,818 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:14,818 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:56:14,818 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:56:14,818 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:56:14,818 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-02-09 20:56:14,818 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 20:56:14,818 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-09 20:56:14,818 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:56:14,818 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:14,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:56:14,818 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:14,818 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:14,818 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:14,818 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-09 20:56:14,818 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 20:56:14,818 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:56:14,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:56:14,919 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 20:56:14,919 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 20:56:14,920 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=42951] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMinorCompactionWithMonthlyPolicy 2023-02-09 20:56:14,922 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1675976025848] procedure2.ProcedureExecutor(1029): Stored pid=115, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-02-09 20:56:14,923 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=115, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-02-09 20:56:14,923 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1675976025848] mob.MobUtils(833): start MOB compaction of files for table='testMinorCompactionWithMonthlyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-09 20:56:14,923 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=115, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1675976774923 2023-02-09 20:56:14,925 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1675976025848] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-02-09 20:56:14,926 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1675976025848] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMinorCompactionWithMonthlyPolicy' and column 'family1' 2023-02-09 20:56:14,926 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1675976025848] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-02-09 20:56:14,926 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1675976025848] zookeeper.ReadOnlyZKClient(139): Connect 0x70a0d3fb to 127.0.0.1:62089 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 20:56:14,932 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1675976025848] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@28f73996, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 20:56:14,933 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-02-09 20:56:15,757 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103b22374ee1289447abb555b8473a2c380 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160103b22374ee1289447abb555b8473a2c380 2023-02-09 20:56:15,758 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-02-09 20:56:15,771 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 20:56:15,773 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:44616, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 20:56:15,778 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-09 20:56:15,779 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:50442, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-09 20:56:15,787 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/be65323a592c4244b8284125e070e33e first=Optional[r5] last=Optional[r6] 2023-02-09 20:56:15,788 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1675976165454.4b04882a70d4b3887c9c68945ea20cdc., hostname=jenkins-hbase9.apache.org,40919,1675976022294, seqNum=2 for row with hfile group [{family1,hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/be65323a592c4244b8284125e070e33e}] 2023-02-09 20:56:15,793 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40919] regionserver.HStore(763): Validating hfile at hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/be65323a592c4244b8284125e070e33e for inclusion in 4b04882a70d4b3887c9c68945ea20cdc/family1 2023-02-09 20:56:15,795 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40919] regionserver.HStore(775): HFile bounds: first=r5 last=r6 2023-02-09 20:56:15,795 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40919] regionserver.HStore(777): Region bounds: first= last= 2023-02-09 20:56:15,795 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40919] regionserver.HRegion(2445): Flush status journal for 4b04882a70d4b3887c9c68945ea20cdc: 2023-02-09 20:56:15,795 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40919] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/be65323a592c4244b8284125e070e33e to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/staging/jenkins__testMinorCompactionWithMonthlyPolicy__8ls741qn4eiempe8jv15ja8bba6nkdratrlv51g6gr2ctth4519c6kigb8e7u67n/family1/be65323a592c4244b8284125e070e33e 2023-02-09 20:56:15,797 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40919] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/staging/jenkins__testMinorCompactionWithMonthlyPolicy__8ls741qn4eiempe8jv15ja8bba6nkdratrlv51g6gr2ctth4519c6kigb8e7u67n/family1/be65323a592c4244b8284125e070e33e as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithMonthlyPolicy/4b04882a70d4b3887c9c68945ea20cdc/family1/97128babd5714fc1a1136f736738619d_SeqId_44_ 2023-02-09 20:56:15,797 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40919] regionserver.HStore(849): Loaded HFile hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/staging/jenkins__testMinorCompactionWithMonthlyPolicy__8ls741qn4eiempe8jv15ja8bba6nkdratrlv51g6gr2ctth4519c6kigb8e7u67n/family1/be65323a592c4244b8284125e070e33e into 4b04882a70d4b3887c9c68945ea20cdc/family1 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithMonthlyPolicy/4b04882a70d4b3887c9c68945ea20cdc/family1/97128babd5714fc1a1136f736738619d_SeqId_44_ - updating store file list. 2023-02-09 20:56:15,800 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40919] regionserver.HStore(882): Loaded HFile hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithMonthlyPolicy/4b04882a70d4b3887c9c68945ea20cdc/family1/97128babd5714fc1a1136f736738619d_SeqId_44_ into 4b04882a70d4b3887c9c68945ea20cdc/family1 2023-02-09 20:56:15,800 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40919] regionserver.HStore(855): Successfully loaded hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/staging/jenkins__testMinorCompactionWithMonthlyPolicy__8ls741qn4eiempe8jv15ja8bba6nkdratrlv51g6gr2ctth4519c6kigb8e7u67n/family1/be65323a592c4244b8284125e070e33e into 4b04882a70d4b3887c9c68945ea20cdc/family1 (new location: hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithMonthlyPolicy/4b04882a70d4b3887c9c68945ea20cdc/family1/97128babd5714fc1a1136f736738619d_SeqId_44_) 2023-02-09 20:56:15,800 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40919] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/staging/jenkins__testMinorCompactionWithMonthlyPolicy__8ls741qn4eiempe8jv15ja8bba6nkdratrlv51g6gr2ctth4519c6kigb8e7u67n/family1/be65323a592c4244b8284125e070e33e 2023-02-09 20:56:15,800 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40919] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-02-09 20:56:15,802 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40919] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 50903 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-02-09 20:56:15,803 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40919] regionserver.HStore(1912): 4b04882a70d4b3887c9c68945ea20cdc/family1 is initiating minor compaction 2023-02-09 20:56:15,803 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40919] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@590732c2; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-09 20:56:15,803 INFO [RS:0;jenkins-hbase9:40919-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 4b04882a70d4b3887c9c68945ea20cdc/family1 in testMinorCompactionWithMonthlyPolicy,,1675976165454.4b04882a70d4b3887c9c68945ea20cdc. 2023-02-09 20:56:15,803 INFO [RS:0;jenkins-hbase9:40919-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithMonthlyPolicy/4b04882a70d4b3887c9c68945ea20cdc/family1/f1eb40b6252e4179b31f3ebccd5b74da, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithMonthlyPolicy/4b04882a70d4b3887c9c68945ea20cdc/family1/9b682b0f89a14fec859bfc32d65723b5, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithMonthlyPolicy/4b04882a70d4b3887c9c68945ea20cdc/family1/f1d7eedcf49e41c680a6b399c9f42e0a, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithMonthlyPolicy/4b04882a70d4b3887c9c68945ea20cdc/family1/755d47b20e0c480384f3f3e33448b28e, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithMonthlyPolicy/4b04882a70d4b3887c9c68945ea20cdc/family1/64b5618e950d488b97a84c26f09ca050, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithMonthlyPolicy/4b04882a70d4b3887c9c68945ea20cdc/family1/3b05107cba134cd58725a797388b3d5c, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithMonthlyPolicy/4b04882a70d4b3887c9c68945ea20cdc/family1/5c8570b4a89d45cfa5f7feaab0efdc63, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithMonthlyPolicy/4b04882a70d4b3887c9c68945ea20cdc/family1/8144f3038b55415cacd6f1c4ea39d6c8, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithMonthlyPolicy/4b04882a70d4b3887c9c68945ea20cdc/family1/608a0349bb184c1aad2ee3c70978bd62, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithMonthlyPolicy/4b04882a70d4b3887c9c68945ea20cdc/family1/97128babd5714fc1a1136f736738619d_SeqId_44_] into tmpdir=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithMonthlyPolicy/4b04882a70d4b3887c9c68945ea20cdc/.tmp, totalSize=49.7 K 2023-02-09 20:56:15,803 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] compactions.Compactor(207): Compacting f1eb40b6252e4179b31f3ebccd5b74da, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-02-09 20:56:15,803 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] compactions.Compactor(207): Compacting 9b682b0f89a14fec859bfc32d65723b5, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-02-09 20:56:15,803 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] compactions.Compactor(207): Compacting f1d7eedcf49e41c680a6b399c9f42e0a, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-02-09 20:56:15,803 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] compactions.Compactor(207): Compacting 755d47b20e0c480384f3f3e33448b28e, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-02-09 20:56:15,803 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] compactions.Compactor(207): Compacting 64b5618e950d488b97a84c26f09ca050, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-02-09 20:56:15,803 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] compactions.Compactor(207): Compacting 3b05107cba134cd58725a797388b3d5c, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-02-09 20:56:15,803 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] compactions.Compactor(207): Compacting 5c8570b4a89d45cfa5f7feaab0efdc63, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-02-09 20:56:15,803 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] compactions.Compactor(207): Compacting 8144f3038b55415cacd6f1c4ea39d6c8, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-02-09 20:56:15,803 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] compactions.Compactor(207): Compacting 608a0349bb184c1aad2ee3c70978bd62, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-02-09 20:56:15,803 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] compactions.Compactor(207): Compacting 97128babd5714fc1a1136f736738619d_SeqId_44_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=45 2023-02-09 20:56:15,804 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-02-09 20:56:15,805 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 20:56:15,806 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2016010123a67f507a6c4254adf8d8f22d268e6b to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2016010123a67f507a6c4254adf8d8f22d268e6b 2023-02-09 20:56:15,808 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160103e61e91b734cc4c40bbcacf7835a146b3 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160103e61e91b734cc4c40bbcacf7835a146b3 2023-02-09 20:56:15,808 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 2 expired mob files are deleted 2023-02-09 20:56:15,808 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101' 2023-02-09 20:56:15,808 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-02-09 20:56:15,808 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-02-09 20:56:15,839 INFO [RS:0;jenkins-hbase9:40919-shortCompactions-0] throttle.PressureAwareThroughputController(145): 4b04882a70d4b3887c9c68945ea20cdc#family1#compaction#165 average throughput is 0.68 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-09 20:56:16,656 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithMonthlyPolicy/4b04882a70d4b3887c9c68945ea20cdc/.tmp/family1/4709e4c7ab2141058263f7d6bef6d7e2 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithMonthlyPolicy/4b04882a70d4b3887c9c68945ea20cdc/family1/4709e4c7ab2141058263f7d6bef6d7e2 2023-02-09 20:56:16,658 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231e45609a533184d9b9d2a2e8bbcf663de to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151231e45609a533184d9b9d2a2e8bbcf663de 2023-02-09 20:56:16,659 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-02-09 20:56:16,660 INFO [RS:0;jenkins-hbase9:40919-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 4b04882a70d4b3887c9c68945ea20cdc/family1 of 4b04882a70d4b3887c9c68945ea20cdc into 4709e4c7ab2141058263f7d6bef6d7e2(size=6.6 K), total size for store is 172.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-09 20:56:16,660 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 4b04882a70d4b3887c9c68945ea20cdc: 2023-02-09 20:56:16,660 INFO [RS:0;jenkins-hbase9:40919-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithMonthlyPolicy,,1675976165454.4b04882a70d4b3887c9c68945ea20cdc., storeName=family1, fileCount=10, fileSize=49.7 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.2 K), priority=2, time=1675976175803; duration=0sec 2023-02-09 20:56:16,661 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-09 20:56:16,680 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/ed21f432782b4fd88f9aa33ed001039a first=Optional[r1] last=Optional[r4] 2023-02-09 20:56:16,681 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1675976165454.4b04882a70d4b3887c9c68945ea20cdc., hostname=jenkins-hbase9.apache.org,40919,1675976022294, seqNum=2 for row with hfile group [{family1,hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/ed21f432782b4fd88f9aa33ed001039a}] 2023-02-09 20:56:16,683 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40919] regionserver.HStore(763): Validating hfile at hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/ed21f432782b4fd88f9aa33ed001039a for inclusion in 4b04882a70d4b3887c9c68945ea20cdc/family1 2023-02-09 20:56:16,683 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithMonthlyPolicy/4b04882a70d4b3887c9c68945ea20cdc/family1/f1eb40b6252e4179b31f3ebccd5b74da, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithMonthlyPolicy/4b04882a70d4b3887c9c68945ea20cdc/family1/9b682b0f89a14fec859bfc32d65723b5, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithMonthlyPolicy/4b04882a70d4b3887c9c68945ea20cdc/family1/f1d7eedcf49e41c680a6b399c9f42e0a, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithMonthlyPolicy/4b04882a70d4b3887c9c68945ea20cdc/family1/755d47b20e0c480384f3f3e33448b28e, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithMonthlyPolicy/4b04882a70d4b3887c9c68945ea20cdc/family1/64b5618e950d488b97a84c26f09ca050, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithMonthlyPolicy/4b04882a70d4b3887c9c68945ea20cdc/family1/3b05107cba134cd58725a797388b3d5c, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithMonthlyPolicy/4b04882a70d4b3887c9c68945ea20cdc/family1/5c8570b4a89d45cfa5f7feaab0efdc63, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithMonthlyPolicy/4b04882a70d4b3887c9c68945ea20cdc/family1/8144f3038b55415cacd6f1c4ea39d6c8, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithMonthlyPolicy/4b04882a70d4b3887c9c68945ea20cdc/family1/608a0349bb184c1aad2ee3c70978bd62, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithMonthlyPolicy/4b04882a70d4b3887c9c68945ea20cdc/family1/97128babd5714fc1a1136f736738619d_SeqId_44_] to archive 2023-02-09 20:56:16,684 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 20:56:16,685 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40919] regionserver.HStore(775): HFile bounds: first=r1 last=r4 2023-02-09 20:56:16,685 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40919] regionserver.HStore(777): Region bounds: first= last= 2023-02-09 20:56:16,685 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40919] regionserver.HRegion(2445): Flush status journal for 4b04882a70d4b3887c9c68945ea20cdc: 2023-02-09 20:56:16,685 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithMonthlyPolicy/4b04882a70d4b3887c9c68945ea20cdc/family1/f1eb40b6252e4179b31f3ebccd5b74da to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMinorCompactionWithMonthlyPolicy/4b04882a70d4b3887c9c68945ea20cdc/family1/f1eb40b6252e4179b31f3ebccd5b74da 2023-02-09 20:56:16,686 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40919] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/ed21f432782b4fd88f9aa33ed001039a to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/staging/jenkins__testMinorCompactionWithMonthlyPolicy__igh360iarvq92loat3m22q5uprj9bvfmt1cglacs4j1lbql1jsuji0184auovvv4/family1/ed21f432782b4fd88f9aa33ed001039a 2023-02-09 20:56:16,687 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithMonthlyPolicy/4b04882a70d4b3887c9c68945ea20cdc/family1/9b682b0f89a14fec859bfc32d65723b5 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMinorCompactionWithMonthlyPolicy/4b04882a70d4b3887c9c68945ea20cdc/family1/9b682b0f89a14fec859bfc32d65723b5 2023-02-09 20:56:16,688 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40919] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/staging/jenkins__testMinorCompactionWithMonthlyPolicy__igh360iarvq92loat3m22q5uprj9bvfmt1cglacs4j1lbql1jsuji0184auovvv4/family1/ed21f432782b4fd88f9aa33ed001039a as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithMonthlyPolicy/4b04882a70d4b3887c9c68945ea20cdc/family1/e5e593d8ecac427fb157284d97163f72_SeqId_47_ 2023-02-09 20:56:16,688 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithMonthlyPolicy/4b04882a70d4b3887c9c68945ea20cdc/family1/f1d7eedcf49e41c680a6b399c9f42e0a to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMinorCompactionWithMonthlyPolicy/4b04882a70d4b3887c9c68945ea20cdc/family1/f1d7eedcf49e41c680a6b399c9f42e0a 2023-02-09 20:56:16,688 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40919] regionserver.HStore(849): Loaded HFile hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/staging/jenkins__testMinorCompactionWithMonthlyPolicy__igh360iarvq92loat3m22q5uprj9bvfmt1cglacs4j1lbql1jsuji0184auovvv4/family1/ed21f432782b4fd88f9aa33ed001039a into 4b04882a70d4b3887c9c68945ea20cdc/family1 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithMonthlyPolicy/4b04882a70d4b3887c9c68945ea20cdc/family1/e5e593d8ecac427fb157284d97163f72_SeqId_47_ - updating store file list. 2023-02-09 20:56:16,689 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithMonthlyPolicy/4b04882a70d4b3887c9c68945ea20cdc/family1/755d47b20e0c480384f3f3e33448b28e to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMinorCompactionWithMonthlyPolicy/4b04882a70d4b3887c9c68945ea20cdc/family1/755d47b20e0c480384f3f3e33448b28e 2023-02-09 20:56:16,690 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithMonthlyPolicy/4b04882a70d4b3887c9c68945ea20cdc/family1/64b5618e950d488b97a84c26f09ca050 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMinorCompactionWithMonthlyPolicy/4b04882a70d4b3887c9c68945ea20cdc/family1/64b5618e950d488b97a84c26f09ca050 2023-02-09 20:56:16,691 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40919] regionserver.HStore(882): Loaded HFile hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithMonthlyPolicy/4b04882a70d4b3887c9c68945ea20cdc/family1/e5e593d8ecac427fb157284d97163f72_SeqId_47_ into 4b04882a70d4b3887c9c68945ea20cdc/family1 2023-02-09 20:56:16,691 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40919] regionserver.HStore(855): Successfully loaded hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/staging/jenkins__testMinorCompactionWithMonthlyPolicy__igh360iarvq92loat3m22q5uprj9bvfmt1cglacs4j1lbql1jsuji0184auovvv4/family1/ed21f432782b4fd88f9aa33ed001039a into 4b04882a70d4b3887c9c68945ea20cdc/family1 (new location: hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithMonthlyPolicy/4b04882a70d4b3887c9c68945ea20cdc/family1/e5e593d8ecac427fb157284d97163f72_SeqId_47_) 2023-02-09 20:56:16,691 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithMonthlyPolicy/4b04882a70d4b3887c9c68945ea20cdc/family1/3b05107cba134cd58725a797388b3d5c to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMinorCompactionWithMonthlyPolicy/4b04882a70d4b3887c9c68945ea20cdc/family1/3b05107cba134cd58725a797388b3d5c 2023-02-09 20:56:16,692 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40919] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/staging/jenkins__testMinorCompactionWithMonthlyPolicy__igh360iarvq92loat3m22q5uprj9bvfmt1cglacs4j1lbql1jsuji0184auovvv4/family1/ed21f432782b4fd88f9aa33ed001039a 2023-02-09 20:56:16,692 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40919] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-02-09 20:56:16,692 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithMonthlyPolicy/4b04882a70d4b3887c9c68945ea20cdc/family1/5c8570b4a89d45cfa5f7feaab0efdc63 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMinorCompactionWithMonthlyPolicy/4b04882a70d4b3887c9c68945ea20cdc/family1/5c8570b4a89d45cfa5f7feaab0efdc63 2023-02-09 20:56:16,693 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40919] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 182349 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-02-09 20:56:16,693 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40919] regionserver.HStore(1912): 4b04882a70d4b3887c9c68945ea20cdc/family1 is initiating minor compaction (all files) 2023-02-09 20:56:16,693 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40919] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@197181ee; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-09 20:56:16,693 INFO [RS:0;jenkins-hbase9:40919-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 4b04882a70d4b3887c9c68945ea20cdc/family1 in testMinorCompactionWithMonthlyPolicy,,1675976165454.4b04882a70d4b3887c9c68945ea20cdc. 2023-02-09 20:56:16,693 INFO [RS:0;jenkins-hbase9:40919-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithMonthlyPolicy/4b04882a70d4b3887c9c68945ea20cdc/family1/fde798c3f77943208337e595d87520b7, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithMonthlyPolicy/4b04882a70d4b3887c9c68945ea20cdc/family1/4709e4c7ab2141058263f7d6bef6d7e2, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithMonthlyPolicy/4b04882a70d4b3887c9c68945ea20cdc/family1/e5e593d8ecac427fb157284d97163f72_SeqId_47_] into tmpdir=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithMonthlyPolicy/4b04882a70d4b3887c9c68945ea20cdc/.tmp, totalSize=178.1 K 2023-02-09 20:56:16,693 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] compactions.Compactor(207): Compacting fde798c3f77943208337e595d87520b7, keycount=1000, bloomtype=ROW, size=166.0 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878845982 2023-02-09 20:56:16,693 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithMonthlyPolicy/4b04882a70d4b3887c9c68945ea20cdc/family1/8144f3038b55415cacd6f1c4ea39d6c8 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMinorCompactionWithMonthlyPolicy/4b04882a70d4b3887c9c68945ea20cdc/family1/8144f3038b55415cacd6f1c4ea39d6c8 2023-02-09 20:56:16,694 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] compactions.Compactor(207): Compacting 4709e4c7ab2141058263f7d6bef6d7e2, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621245982 2023-02-09 20:56:16,694 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] compactions.Compactor(207): Compacting e5e593d8ecac427fb157284d97163f72_SeqId_47_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448965245982 2023-02-09 20:56:16,694 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-02-09 20:56:16,695 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithMonthlyPolicy/4b04882a70d4b3887c9c68945ea20cdc/family1/608a0349bb184c1aad2ee3c70978bd62 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMinorCompactionWithMonthlyPolicy/4b04882a70d4b3887c9c68945ea20cdc/family1/608a0349bb184c1aad2ee3c70978bd62 2023-02-09 20:56:16,695 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 20:56:16,696 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithMonthlyPolicy/4b04882a70d4b3887c9c68945ea20cdc/family1/97128babd5714fc1a1136f736738619d_SeqId_44_ to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMinorCompactionWithMonthlyPolicy/4b04882a70d4b3887c9c68945ea20cdc/family1/97128babd5714fc1a1136f736738619d_SeqId_44_ 2023-02-09 20:56:16,696 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015120132cb111cd7b549fb9a0de90d316f901d to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015120132cb111cd7b549fb9a0de90d316f901d 2023-02-09 20:56:16,698 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151205e5c1b1d85b87450a9ad54ed116ceda30 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151205e5c1b1d85b87450a9ad54ed116ceda30 2023-02-09 20:56:16,701 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151228955a3f14a5684b71b8586c696afd5b67 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151228955a3f14a5684b71b8586c696afd5b67 2023-02-09 20:56:16,702 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151231fdf17d7eb17746d5a44440187a8df216 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151231fdf17d7eb17746d5a44440187a8df216 2023-02-09 20:56:16,702 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 4 expired mob files are deleted 2023-02-09 20:56:16,702 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201' 2023-02-09 20:56:16,702 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-02-09 20:56:16,702 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-02-09 20:56:16,713 INFO [RS:0;jenkins-hbase9:40919-shortCompactions-0] throttle.PressureAwareThroughputController(145): 4b04882a70d4b3887c9c68945ea20cdc#family1#compaction#166 average throughput is 22.23 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-09 20:56:17,150 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130c1e723f1ec0546b59fd8b76914961ee5 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151130c1e723f1ec0546b59fd8b76914961ee5 2023-02-09 20:56:17,151 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-02-09 20:56:17,181 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/6db3c878f6cb41059086dc25415036a1 first=Optional[r00] last=Optional[r8] 2023-02-09 20:56:17,182 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1675976165454.4b04882a70d4b3887c9c68945ea20cdc., hostname=jenkins-hbase9.apache.org,40919,1675976022294, seqNum=2 for row with hfile group [{family1,hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/6db3c878f6cb41059086dc25415036a1}] 2023-02-09 20:56:17,183 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40919] regionserver.HStore(763): Validating hfile at hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/6db3c878f6cb41059086dc25415036a1 for inclusion in 4b04882a70d4b3887c9c68945ea20cdc/family1 2023-02-09 20:56:17,186 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40919] regionserver.HStore(775): HFile bounds: first=r00 last=r8 2023-02-09 20:56:17,186 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40919] regionserver.HStore(777): Region bounds: first= last= 2023-02-09 20:56:17,186 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40919] regionserver.HRegion(2445): Flush status journal for 4b04882a70d4b3887c9c68945ea20cdc: 2023-02-09 20:56:17,187 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40919] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/6db3c878f6cb41059086dc25415036a1 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/staging/jenkins__testMinorCompactionWithMonthlyPolicy__vo7mqnefrpjtjg9sfdrm49rrl2dp5vi44778ra6gls5bgsont715mgdimnukgng/family1/6db3c878f6cb41059086dc25415036a1 2023-02-09 20:56:17,189 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40919] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/staging/jenkins__testMinorCompactionWithMonthlyPolicy__vo7mqnefrpjtjg9sfdrm49rrl2dp5vi44778ra6gls5bgsont715mgdimnukgng/family1/6db3c878f6cb41059086dc25415036a1 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithMonthlyPolicy/4b04882a70d4b3887c9c68945ea20cdc/family1/b849ba1e713f40d5b4c6bbe9c5e90129_SeqId_49_ 2023-02-09 20:56:17,189 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40919] regionserver.HStore(849): Loaded HFile hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/staging/jenkins__testMinorCompactionWithMonthlyPolicy__vo7mqnefrpjtjg9sfdrm49rrl2dp5vi44778ra6gls5bgsont715mgdimnukgng/family1/6db3c878f6cb41059086dc25415036a1 into 4b04882a70d4b3887c9c68945ea20cdc/family1 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithMonthlyPolicy/4b04882a70d4b3887c9c68945ea20cdc/family1/b849ba1e713f40d5b4c6bbe9c5e90129_SeqId_49_ - updating store file list. 2023-02-09 20:56:17,193 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40919] regionserver.HStore(882): Loaded HFile hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithMonthlyPolicy/4b04882a70d4b3887c9c68945ea20cdc/family1/b849ba1e713f40d5b4c6bbe9c5e90129_SeqId_49_ into 4b04882a70d4b3887c9c68945ea20cdc/family1 2023-02-09 20:56:17,193 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40919] regionserver.HStore(855): Successfully loaded hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/staging/jenkins__testMinorCompactionWithMonthlyPolicy__vo7mqnefrpjtjg9sfdrm49rrl2dp5vi44778ra6gls5bgsont715mgdimnukgng/family1/6db3c878f6cb41059086dc25415036a1 into 4b04882a70d4b3887c9c68945ea20cdc/family1 (new location: hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithMonthlyPolicy/4b04882a70d4b3887c9c68945ea20cdc/family1/b849ba1e713f40d5b4c6bbe9c5e90129_SeqId_49_) 2023-02-09 20:56:17,194 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40919] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/staging/jenkins__testMinorCompactionWithMonthlyPolicy__vo7mqnefrpjtjg9sfdrm49rrl2dp5vi44778ra6gls5bgsont715mgdimnukgng/family1/6db3c878f6cb41059086dc25415036a1 2023-02-09 20:56:17,200 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-02-09 20:56:17,200 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 20:56:17,202 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151120c4844f34080b48e7a4d0e118c03e1ee8 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151120c4844f34080b48e7a4d0e118c03e1ee8 2023-02-09 20:56:17,203 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151128627b39b6da454bf9b5a15c2cc3822714 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151128627b39b6da454bf9b5a15c2cc3822714 2023-02-09 20:56:17,204 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015113014b91ac552d54637b25da64564ff4d81 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015113014b91ac552d54637b25da64564ff4d81 2023-02-09 20:56:17,204 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 3 expired mob files are deleted 2023-02-09 20:56:17,204 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-02-09 20:56:17,204 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-02-09 20:56:17,204 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-02-09 20:56:17,204 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-02-09 20:56:17,204 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1675976025848] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-02-09 20:56:17,204 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1675976025848] mob.MobUtils(840): end MOB compaction of files for table='testMinorCompactionWithMonthlyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-09 20:56:17,207 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=115, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-02-09 20:56:17,208 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=115, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE in 2.2860 sec 2023-02-09 20:56:17,351 INFO [Listener at localhost/46855] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompactionWithMonthlyPolicy Thread=254 (was 248) - Thread LEAK? -, OpenFileDescriptor=639 (was 624) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=134 (was 140), ProcessCount=168 (was 168), AvailableMemoryMB=10750 (was 10821) 2023-02-09 20:56:17,366 INFO [Listener at localhost/46855] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionFromAdmin Thread=254, OpenFileDescriptor=639, MaxFileDescriptor=60000, SystemLoadAverage=134, ProcessCount=168, AvailableMemoryMB=10749 2023-02-09 20:56:17,385 DEBUG [Listener at localhost/46855] crypto.Encryption(565): Installed org.apache.hadoop.hbase.io.crypto.KeyProviderForTesting into key provider cache 2023-02-09 20:56:17,440 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.HMaster$4(2102): Client=jenkins//172.31.2.10 create 'testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\x1E!_\x81\xD9!\x13\x11p\x0E\xDB\xCB\xCE\xF6\xFC\xDC"\x10\xC3\x14\x8CP\xC6AI\xD8\xC5\xDB1\xBC\xD3\xC3\x13\xBD*\x10\xF6\x16\x7F\x7F\xF2\xBB\xCA\xD4!p\x1B1\xC1\xAA\xDC)2\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-02-09 20:56:17,440 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure2.ProcedureExecutor(1029): Stored pid=116, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionFromAdmin 2023-02-09 20:56:17,442 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_PRE_OPERATION 2023-02-09 20:56:17,442 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(697): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionFromAdmin" procId is: 116 2023-02-09 20:56:17,443 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-09 20:56:17,443 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-02-09 20:56:17,445 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/.tmp/data/default/testMajorCompactionFromAdmin/91ac905c8115b0a77d093240ed551a1f 2023-02-09 20:56:17,445 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/.tmp/data/default/testMajorCompactionFromAdmin/1588791fd318439c4a112711b2289bfa 2023-02-09 20:56:17,445 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/.tmp/data/default/testMajorCompactionFromAdmin/02305257e8e6e518ce321ba9e1c2a48f 2023-02-09 20:56:17,445 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/.tmp/data/default/testMajorCompactionFromAdmin/91ac905c8115b0a77d093240ed551a1f empty. 2023-02-09 20:56:17,445 DEBUG [HFileArchiver-22] backup.HFileArchiver(153): Directory hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/.tmp/data/default/testMajorCompactionFromAdmin/02305257e8e6e518ce321ba9e1c2a48f empty. 2023-02-09 20:56:17,445 DEBUG [HFileArchiver-21] backup.HFileArchiver(153): Directory hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/.tmp/data/default/testMajorCompactionFromAdmin/1588791fd318439c4a112711b2289bfa empty. 2023-02-09 20:56:17,445 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/.tmp/data/default/testMajorCompactionFromAdmin/91ac905c8115b0a77d093240ed551a1f 2023-02-09 20:56:17,446 DEBUG [HFileArchiver-21] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/.tmp/data/default/testMajorCompactionFromAdmin/1588791fd318439c4a112711b2289bfa 2023-02-09 20:56:17,446 DEBUG [HFileArchiver-22] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/.tmp/data/default/testMajorCompactionFromAdmin/02305257e8e6e518ce321ba9e1c2a48f 2023-02-09 20:56:17,446 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testMajorCompactionFromAdmin regions 2023-02-09 20:56:17,544 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-02-09 20:56:17,544 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithMonthlyPolicy/4b04882a70d4b3887c9c68945ea20cdc/.tmp/family1/08fcc77fe4064b919e1adca5492ec57b as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithMonthlyPolicy/4b04882a70d4b3887c9c68945ea20cdc/family1/08fcc77fe4064b919e1adca5492ec57b 2023-02-09 20:56:17,548 INFO [RS:0;jenkins-hbase9:40919-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 4b04882a70d4b3887c9c68945ea20cdc/family1 of 4b04882a70d4b3887c9c68945ea20cdc into 08fcc77fe4064b919e1adca5492ec57b(size=167.4 K), total size for store is 333.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-09 20:56:17,548 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 4b04882a70d4b3887c9c68945ea20cdc: 2023-02-09 20:56:17,548 INFO [RS:0;jenkins-hbase9:40919-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithMonthlyPolicy,,1675976165454.4b04882a70d4b3887c9c68945ea20cdc., storeName=family1, fileCount=3, fileSize=178.1 K (166.0 K, 6.6 K, 5.5 K), priority=2, time=1675976176693; duration=0sec 2023-02-09 20:56:17,548 DEBUG [RS:0;jenkins-hbase9:40919-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-09 20:56:17,580 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithMonthlyPolicy/4b04882a70d4b3887c9c68945ea20cdc/family1/fde798c3f77943208337e595d87520b7, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithMonthlyPolicy/4b04882a70d4b3887c9c68945ea20cdc/family1/4709e4c7ab2141058263f7d6bef6d7e2, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithMonthlyPolicy/4b04882a70d4b3887c9c68945ea20cdc/family1/e5e593d8ecac427fb157284d97163f72_SeqId_47_] to archive 2023-02-09 20:56:17,581 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 20:56:17,582 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithMonthlyPolicy/4b04882a70d4b3887c9c68945ea20cdc/family1/fde798c3f77943208337e595d87520b7 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMinorCompactionWithMonthlyPolicy/4b04882a70d4b3887c9c68945ea20cdc/family1/fde798c3f77943208337e595d87520b7 2023-02-09 20:56:17,583 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithMonthlyPolicy/4b04882a70d4b3887c9c68945ea20cdc/family1/4709e4c7ab2141058263f7d6bef6d7e2 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMinorCompactionWithMonthlyPolicy/4b04882a70d4b3887c9c68945ea20cdc/family1/4709e4c7ab2141058263f7d6bef6d7e2 2023-02-09 20:56:17,584 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithMonthlyPolicy/4b04882a70d4b3887c9c68945ea20cdc/family1/e5e593d8ecac427fb157284d97163f72_SeqId_47_ to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMinorCompactionWithMonthlyPolicy/4b04882a70d4b3887c9c68945ea20cdc/family1/e5e593d8ecac427fb157284d97163f72_SeqId_47_ 2023-02-09 20:56:17,745 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-02-09 20:56:17,852 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/.tmp/data/default/testMajorCompactionFromAdmin/.tabledesc/.tableinfo.0000000001 2023-02-09 20:56:17,854 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(7671): creating {ENCODED => 02305257e8e6e518ce321ba9e1c2a48f, NAME => 'testMajorCompactionFromAdmin,2,1675976177410.02305257e8e6e518ce321ba9e1c2a48f.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\x1E!_\x81\xD9!\x13\x11p\x0E\xDB\xCB\xCE\xF6\xFC\xDC"\x10\xC3\x14\x8CP\xC6AI\xD8\xC5\xDB1\xBC\xD3\xC3\x13\xBD*\x10\xF6\x16\x7F\x7F\xF2\xBB\xCA\xD4!p\x1B1\xC1\xAA\xDC)2\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/.tmp 2023-02-09 20:56:17,854 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(7671): creating {ENCODED => 91ac905c8115b0a77d093240ed551a1f, NAME => 'testMajorCompactionFromAdmin,,1675976177410.91ac905c8115b0a77d093240ed551a1f.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\x1E!_\x81\xD9!\x13\x11p\x0E\xDB\xCB\xCE\xF6\xFC\xDC"\x10\xC3\x14\x8CP\xC6AI\xD8\xC5\xDB1\xBC\xD3\xC3\x13\xBD*\x10\xF6\x16\x7F\x7F\xF2\xBB\xCA\xD4!p\x1B1\xC1\xAA\xDC)2\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/.tmp 2023-02-09 20:56:17,854 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(7671): creating {ENCODED => 1588791fd318439c4a112711b2289bfa, NAME => 'testMajorCompactionFromAdmin,1,1675976177410.1588791fd318439c4a112711b2289bfa.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\x1E!_\x81\xD9!\x13\x11p\x0E\xDB\xCB\xCE\xF6\xFC\xDC"\x10\xC3\x14\x8CP\xC6AI\xD8\xC5\xDB1\xBC\xD3\xC3\x13\xBD*\x10\xF6\x16\x7F\x7F\xF2\xBB\xCA\xD4!p\x1B1\xC1\xAA\xDC)2\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/.tmp 2023-02-09 20:56:17,859 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(865): Instantiated testMajorCompactionFromAdmin,2,1675976177410.02305257e8e6e518ce321ba9e1c2a48f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 20:56:17,859 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1603): Closing 02305257e8e6e518ce321ba9e1c2a48f, disabling compactions & flushes 2023-02-09 20:56:17,859 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1625): Closing region testMajorCompactionFromAdmin,2,1675976177410.02305257e8e6e518ce321ba9e1c2a48f. 2023-02-09 20:56:17,859 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(865): Instantiated testMajorCompactionFromAdmin,1,1675976177410.1588791fd318439c4a112711b2289bfa.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 20:56:17,859 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionFromAdmin,2,1675976177410.02305257e8e6e518ce321ba9e1c2a48f. 2023-02-09 20:56:17,859 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1603): Closing 1588791fd318439c4a112711b2289bfa, disabling compactions & flushes 2023-02-09 20:56:17,859 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(865): Instantiated testMajorCompactionFromAdmin,,1675976177410.91ac905c8115b0a77d093240ed551a1f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 20:56:17,860 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1625): Closing region testMajorCompactionFromAdmin,1,1675976177410.1588791fd318439c4a112711b2289bfa. 2023-02-09 20:56:17,860 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1603): Closing 91ac905c8115b0a77d093240ed551a1f, disabling compactions & flushes 2023-02-09 20:56:17,860 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionFromAdmin,1,1675976177410.1588791fd318439c4a112711b2289bfa. 2023-02-09 20:56:17,859 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionFromAdmin,2,1675976177410.02305257e8e6e518ce321ba9e1c2a48f. after waiting 0 ms 2023-02-09 20:56:17,860 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionFromAdmin,1,1675976177410.1588791fd318439c4a112711b2289bfa. after waiting 0 ms 2023-02-09 20:56:17,860 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionFromAdmin,1,1675976177410.1588791fd318439c4a112711b2289bfa. 2023-02-09 20:56:17,860 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1625): Closing region testMajorCompactionFromAdmin,,1675976177410.91ac905c8115b0a77d093240ed551a1f. 2023-02-09 20:56:17,860 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1837): Closed testMajorCompactionFromAdmin,1,1675976177410.1588791fd318439c4a112711b2289bfa. 2023-02-09 20:56:17,860 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionFromAdmin,,1675976177410.91ac905c8115b0a77d093240ed551a1f. 2023-02-09 20:56:17,860 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1557): Region close journal for 1588791fd318439c4a112711b2289bfa: Waiting for close lock at 1675976177859Disabling compacts and flushes for region at 1675976177859Disabling writes for close at 1675976177860 (+1 ms)Writing region close event to WAL at 1675976177860Closed at 1675976177860 2023-02-09 20:56:17,860 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionFromAdmin,2,1675976177410.02305257e8e6e518ce321ba9e1c2a48f. 2023-02-09 20:56:17,860 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionFromAdmin,,1675976177410.91ac905c8115b0a77d093240ed551a1f. after waiting 0 ms 2023-02-09 20:56:17,860 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionFromAdmin,,1675976177410.91ac905c8115b0a77d093240ed551a1f. 2023-02-09 20:56:17,860 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1837): Closed testMajorCompactionFromAdmin,2,1675976177410.02305257e8e6e518ce321ba9e1c2a48f. 2023-02-09 20:56:17,860 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1837): Closed testMajorCompactionFromAdmin,,1675976177410.91ac905c8115b0a77d093240ed551a1f. 2023-02-09 20:56:17,860 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1557): Region close journal for 02305257e8e6e518ce321ba9e1c2a48f: Waiting for close lock at 1675976177859Disabling compacts and flushes for region at 1675976177859Disabling writes for close at 1675976177860 (+1 ms)Writing region close event to WAL at 1675976177860Closed at 1675976177860 2023-02-09 20:56:17,860 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1557): Region close journal for 91ac905c8115b0a77d093240ed551a1f: Waiting for close lock at 1675976177860Disabling compacts and flushes for region at 1675976177860Disabling writes for close at 1675976177860Writing region close event to WAL at 1675976177860Closed at 1675976177860 2023-02-09 20:56:17,862 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_ADD_TO_META 2023-02-09 20:56:17,863 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,1,1675976177410.1588791fd318439c4a112711b2289bfa.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1675976177863"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675976177863"}]},"ts":"1675976177863"} 2023-02-09 20:56:17,863 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,2,1675976177410.02305257e8e6e518ce321ba9e1c2a48f.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1675976177863"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675976177863"}]},"ts":"1675976177863"} 2023-02-09 20:56:17,863 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,,1675976177410.91ac905c8115b0a77d093240ed551a1f.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1675976177863"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675976177863"}]},"ts":"1675976177863"} 2023-02-09 20:56:17,864 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-02-09 20:56:17,865 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-09 20:56:17,865 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionFromAdmin","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675976177865"}]},"ts":"1675976177865"} 2023-02-09 20:56:17,866 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionFromAdmin, state=ENABLING in hbase:meta 2023-02-09 20:56:17,869 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=91ac905c8115b0a77d093240ed551a1f, ASSIGN}, {pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=1588791fd318439c4a112711b2289bfa, ASSIGN}, {pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=02305257e8e6e518ce321ba9e1c2a48f, ASSIGN}] 2023-02-09 20:56:17,871 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=02305257e8e6e518ce321ba9e1c2a48f, ASSIGN 2023-02-09 20:56:17,871 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=91ac905c8115b0a77d093240ed551a1f, ASSIGN 2023-02-09 20:56:17,871 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=1588791fd318439c4a112711b2289bfa, ASSIGN 2023-02-09 20:56:17,871 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=02305257e8e6e518ce321ba9e1c2a48f, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,40919,1675976022294; forceNewPlan=false, retain=false 2023-02-09 20:56:17,871 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=91ac905c8115b0a77d093240ed551a1f, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,40919,1675976022294; forceNewPlan=false, retain=false 2023-02-09 20:56:17,871 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=1588791fd318439c4a112711b2289bfa, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,40919,1675976022294; forceNewPlan=false, retain=false 2023-02-09 20:56:18,023 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=118 updating hbase:meta row=1588791fd318439c4a112711b2289bfa, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:18,023 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=117 updating hbase:meta row=91ac905c8115b0a77d093240ed551a1f, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:18,023 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=119 updating hbase:meta row=02305257e8e6e518ce321ba9e1c2a48f, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:18,023 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,1,1675976177410.1588791fd318439c4a112711b2289bfa.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1675976178023"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675976178023"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675976178023"}]},"ts":"1675976178023"} 2023-02-09 20:56:18,023 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,,1675976177410.91ac905c8115b0a77d093240ed551a1f.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1675976178023"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675976178023"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675976178023"}]},"ts":"1675976178023"} 2023-02-09 20:56:18,023 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,2,1675976177410.02305257e8e6e518ce321ba9e1c2a48f.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1675976178023"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1675976178023"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675976178023"}]},"ts":"1675976178023"} 2023-02-09 20:56:18,025 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=120, ppid=117, state=RUNNABLE; OpenRegionProcedure 91ac905c8115b0a77d093240ed551a1f, server=jenkins-hbase9.apache.org,40919,1675976022294}] 2023-02-09 20:56:18,025 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=121, ppid=119, state=RUNNABLE; OpenRegionProcedure 02305257e8e6e518ce321ba9e1c2a48f, server=jenkins-hbase9.apache.org,40919,1675976022294}] 2023-02-09 20:56:18,026 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=122, ppid=118, state=RUNNABLE; OpenRegionProcedure 1588791fd318439c4a112711b2289bfa, server=jenkins-hbase9.apache.org,40919,1675976022294}] 2023-02-09 20:56:18,046 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-02-09 20:56:18,178 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionFromAdmin,2,1675976177410.02305257e8e6e518ce321ba9e1c2a48f. 2023-02-09 20:56:18,179 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 02305257e8e6e518ce321ba9e1c2a48f, NAME => 'testMajorCompactionFromAdmin,2,1675976177410.02305257e8e6e518ce321ba9e1c2a48f.', STARTKEY => '2', ENDKEY => ''} 2023-02-09 20:56:18,179 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin 02305257e8e6e518ce321ba9e1c2a48f 2023-02-09 20:56:18,179 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionFromAdmin,2,1675976177410.02305257e8e6e518ce321ba9e1c2a48f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 20:56:18,179 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for 02305257e8e6e518ce321ba9e1c2a48f 2023-02-09 20:56:18,179 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for 02305257e8e6e518ce321ba9e1c2a48f 2023-02-09 20:56:18,200 INFO [StoreOpener-02305257e8e6e518ce321ba9e1c2a48f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 02305257e8e6e518ce321ba9e1c2a48f 2023-02-09 20:56:18,201 DEBUG [StoreOpener-02305257e8e6e518ce321ba9e1c2a48f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/02305257e8e6e518ce321ba9e1c2a48f/family1 2023-02-09 20:56:18,202 DEBUG [StoreOpener-02305257e8e6e518ce321ba9e1c2a48f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/02305257e8e6e518ce321ba9e1c2a48f/family1 2023-02-09 20:56:18,202 INFO [StoreOpener-02305257e8e6e518ce321ba9e1c2a48f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 02305257e8e6e518ce321ba9e1c2a48f columnFamilyName family1 2023-02-09 20:56:18,203 INFO [StoreOpener-02305257e8e6e518ce321ba9e1c2a48f-1] regionserver.HStore(310): Store=02305257e8e6e518ce321ba9e1c2a48f/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 20:56:18,203 INFO [StoreOpener-02305257e8e6e518ce321ba9e1c2a48f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 02305257e8e6e518ce321ba9e1c2a48f 2023-02-09 20:56:18,204 DEBUG [StoreOpener-02305257e8e6e518ce321ba9e1c2a48f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/02305257e8e6e518ce321ba9e1c2a48f/family2 2023-02-09 20:56:18,204 DEBUG [StoreOpener-02305257e8e6e518ce321ba9e1c2a48f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/02305257e8e6e518ce321ba9e1c2a48f/family2 2023-02-09 20:56:18,205 INFO [StoreOpener-02305257e8e6e518ce321ba9e1c2a48f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 02305257e8e6e518ce321ba9e1c2a48f columnFamilyName family2 2023-02-09 20:56:18,206 INFO [StoreOpener-02305257e8e6e518ce321ba9e1c2a48f-1] regionserver.HStore(310): Store=02305257e8e6e518ce321ba9e1c2a48f/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 20:56:18,206 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/02305257e8e6e518ce321ba9e1c2a48f 2023-02-09 20:56:18,207 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/02305257e8e6e518ce321ba9e1c2a48f 2023-02-09 20:56:18,208 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 20:56:18,208 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for 02305257e8e6e518ce321ba9e1c2a48f 2023-02-09 20:56:18,210 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/02305257e8e6e518ce321ba9e1c2a48f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 20:56:18,210 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened 02305257e8e6e518ce321ba9e1c2a48f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61411737, jitterRate=-0.08489380776882172}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 20:56:18,210 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for 02305257e8e6e518ce321ba9e1c2a48f: Running coprocessor pre-open hook at 1675976178179Writing region info on filesystem at 1675976178179Initializing all the Stores at 1675976178180 (+1 ms)Instantiating store for column family {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\x1E!_\x81\xD9!\x13\x11p\x0E\xDB\xCB\xCE\xF6\xFC\xDC"\x10\xC3\x14\x8CP\xC6AI\xD8\xC5\xDB1\xBC\xD3\xC3\x13\xBD*\x10\xF6\x16\x7F\x7F\xF2\xBB\xCA\xD4!p\x1B1\xC1\xAA\xDC)2\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675976178180Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675976178180Cleaning up temporary data from old regions at 1675976178207 (+27 ms)Cleaning up detritus from prior splits at 1675976178207Running coprocessor post-open hooks at 1675976178210 (+3 ms)Region opened successfully at 1675976178210 2023-02-09 20:56:18,211 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionFromAdmin,2,1675976177410.02305257e8e6e518ce321ba9e1c2a48f., pid=121, masterSystemTime=1675976178176 2023-02-09 20:56:18,212 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionFromAdmin,2,1675976177410.02305257e8e6e518ce321ba9e1c2a48f. 2023-02-09 20:56:18,212 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionFromAdmin,2,1675976177410.02305257e8e6e518ce321ba9e1c2a48f. 2023-02-09 20:56:18,212 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionFromAdmin,,1675976177410.91ac905c8115b0a77d093240ed551a1f. 2023-02-09 20:56:18,212 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 91ac905c8115b0a77d093240ed551a1f, NAME => 'testMajorCompactionFromAdmin,,1675976177410.91ac905c8115b0a77d093240ed551a1f.', STARTKEY => '', ENDKEY => '1'} 2023-02-09 20:56:18,212 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=119 updating hbase:meta row=02305257e8e6e518ce321ba9e1c2a48f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:18,212 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin 91ac905c8115b0a77d093240ed551a1f 2023-02-09 20:56:18,212 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionFromAdmin,,1675976177410.91ac905c8115b0a77d093240ed551a1f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 20:56:18,212 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,2,1675976177410.02305257e8e6e518ce321ba9e1c2a48f.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1675976178212"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675976178212"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675976178212"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675976178212"}]},"ts":"1675976178212"} 2023-02-09 20:56:18,212 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for 91ac905c8115b0a77d093240ed551a1f 2023-02-09 20:56:18,213 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for 91ac905c8115b0a77d093240ed551a1f 2023-02-09 20:56:18,215 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=121, resume processing ppid=119 2023-02-09 20:56:18,215 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=121, ppid=119, state=SUCCESS; OpenRegionProcedure 02305257e8e6e518ce321ba9e1c2a48f, server=jenkins-hbase9.apache.org,40919,1675976022294 in 188 msec 2023-02-09 20:56:18,215 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=119, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=02305257e8e6e518ce321ba9e1c2a48f, ASSIGN in 346 msec 2023-02-09 20:56:18,232 INFO [StoreOpener-91ac905c8115b0a77d093240ed551a1f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 91ac905c8115b0a77d093240ed551a1f 2023-02-09 20:56:18,233 DEBUG [StoreOpener-91ac905c8115b0a77d093240ed551a1f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/91ac905c8115b0a77d093240ed551a1f/family1 2023-02-09 20:56:18,233 DEBUG [StoreOpener-91ac905c8115b0a77d093240ed551a1f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/91ac905c8115b0a77d093240ed551a1f/family1 2023-02-09 20:56:18,234 INFO [StoreOpener-91ac905c8115b0a77d093240ed551a1f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 91ac905c8115b0a77d093240ed551a1f columnFamilyName family1 2023-02-09 20:56:18,234 INFO [StoreOpener-91ac905c8115b0a77d093240ed551a1f-1] regionserver.HStore(310): Store=91ac905c8115b0a77d093240ed551a1f/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 20:56:18,235 INFO [StoreOpener-91ac905c8115b0a77d093240ed551a1f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 91ac905c8115b0a77d093240ed551a1f 2023-02-09 20:56:18,236 DEBUG [StoreOpener-91ac905c8115b0a77d093240ed551a1f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/91ac905c8115b0a77d093240ed551a1f/family2 2023-02-09 20:56:18,236 DEBUG [StoreOpener-91ac905c8115b0a77d093240ed551a1f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/91ac905c8115b0a77d093240ed551a1f/family2 2023-02-09 20:56:18,236 INFO [StoreOpener-91ac905c8115b0a77d093240ed551a1f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 91ac905c8115b0a77d093240ed551a1f columnFamilyName family2 2023-02-09 20:56:18,237 INFO [StoreOpener-91ac905c8115b0a77d093240ed551a1f-1] regionserver.HStore(310): Store=91ac905c8115b0a77d093240ed551a1f/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 20:56:18,238 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/91ac905c8115b0a77d093240ed551a1f 2023-02-09 20:56:18,238 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/91ac905c8115b0a77d093240ed551a1f 2023-02-09 20:56:18,239 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 20:56:18,240 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for 91ac905c8115b0a77d093240ed551a1f 2023-02-09 20:56:18,242 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/91ac905c8115b0a77d093240ed551a1f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 20:56:18,242 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened 91ac905c8115b0a77d093240ed551a1f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71262702, jitterRate=0.06189700961112976}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 20:56:18,242 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for 91ac905c8115b0a77d093240ed551a1f: Running coprocessor pre-open hook at 1675976178213Writing region info on filesystem at 1675976178213Initializing all the Stores at 1675976178213Instantiating store for column family {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\x1E!_\x81\xD9!\x13\x11p\x0E\xDB\xCB\xCE\xF6\xFC\xDC"\x10\xC3\x14\x8CP\xC6AI\xD8\xC5\xDB1\xBC\xD3\xC3\x13\xBD*\x10\xF6\x16\x7F\x7F\xF2\xBB\xCA\xD4!p\x1B1\xC1\xAA\xDC)2\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675976178213Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675976178213Cleaning up temporary data from old regions at 1675976178238 (+25 ms)Cleaning up detritus from prior splits at 1675976178239 (+1 ms)Running coprocessor post-open hooks at 1675976178242 (+3 ms)Region opened successfully at 1675976178242 2023-02-09 20:56:18,243 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionFromAdmin,,1675976177410.91ac905c8115b0a77d093240ed551a1f., pid=120, masterSystemTime=1675976178176 2023-02-09 20:56:18,244 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionFromAdmin,,1675976177410.91ac905c8115b0a77d093240ed551a1f. 2023-02-09 20:56:18,244 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionFromAdmin,,1675976177410.91ac905c8115b0a77d093240ed551a1f. 2023-02-09 20:56:18,244 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionFromAdmin,1,1675976177410.1588791fd318439c4a112711b2289bfa. 2023-02-09 20:56:18,244 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588791fd318439c4a112711b2289bfa, NAME => 'testMajorCompactionFromAdmin,1,1675976177410.1588791fd318439c4a112711b2289bfa.', STARTKEY => '1', ENDKEY => '2'} 2023-02-09 20:56:18,244 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=117 updating hbase:meta row=91ac905c8115b0a77d093240ed551a1f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:18,244 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin 1588791fd318439c4a112711b2289bfa 2023-02-09 20:56:18,244 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,,1675976177410.91ac905c8115b0a77d093240ed551a1f.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1675976178244"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675976178244"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675976178244"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675976178244"}]},"ts":"1675976178244"} 2023-02-09 20:56:18,244 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionFromAdmin,1,1675976177410.1588791fd318439c4a112711b2289bfa.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-09 20:56:18,244 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7890): checking encryption for 1588791fd318439c4a112711b2289bfa 2023-02-09 20:56:18,245 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7893): checking classloading for 1588791fd318439c4a112711b2289bfa 2023-02-09 20:56:18,246 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=120, resume processing ppid=117 2023-02-09 20:56:18,247 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=120, ppid=117, state=SUCCESS; OpenRegionProcedure 91ac905c8115b0a77d093240ed551a1f, server=jenkins-hbase9.apache.org,40919,1675976022294 in 220 msec 2023-02-09 20:56:18,247 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=117, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=91ac905c8115b0a77d093240ed551a1f, ASSIGN in 378 msec 2023-02-09 20:56:18,265 INFO [StoreOpener-1588791fd318439c4a112711b2289bfa-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 1588791fd318439c4a112711b2289bfa 2023-02-09 20:56:18,266 DEBUG [StoreOpener-1588791fd318439c4a112711b2289bfa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/1588791fd318439c4a112711b2289bfa/family1 2023-02-09 20:56:18,266 DEBUG [StoreOpener-1588791fd318439c4a112711b2289bfa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/1588791fd318439c4a112711b2289bfa/family1 2023-02-09 20:56:18,266 INFO [StoreOpener-1588791fd318439c4a112711b2289bfa-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588791fd318439c4a112711b2289bfa columnFamilyName family1 2023-02-09 20:56:18,267 INFO [StoreOpener-1588791fd318439c4a112711b2289bfa-1] regionserver.HStore(310): Store=1588791fd318439c4a112711b2289bfa/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 20:56:18,267 INFO [StoreOpener-1588791fd318439c4a112711b2289bfa-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 1588791fd318439c4a112711b2289bfa 2023-02-09 20:56:18,268 DEBUG [StoreOpener-1588791fd318439c4a112711b2289bfa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/1588791fd318439c4a112711b2289bfa/family2 2023-02-09 20:56:18,268 DEBUG [StoreOpener-1588791fd318439c4a112711b2289bfa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/1588791fd318439c4a112711b2289bfa/family2 2023-02-09 20:56:18,268 INFO [StoreOpener-1588791fd318439c4a112711b2289bfa-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588791fd318439c4a112711b2289bfa columnFamilyName family2 2023-02-09 20:56:18,269 INFO [StoreOpener-1588791fd318439c4a112711b2289bfa-1] regionserver.HStore(310): Store=1588791fd318439c4a112711b2289bfa/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-09 20:56:18,269 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/1588791fd318439c4a112711b2289bfa 2023-02-09 20:56:18,270 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/1588791fd318439c4a112711b2289bfa 2023-02-09 20:56:18,271 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-09 20:56:18,272 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1054): writing seq id for 1588791fd318439c4a112711b2289bfa 2023-02-09 20:56:18,273 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/1588791fd318439c4a112711b2289bfa/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-09 20:56:18,273 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1071): Opened 1588791fd318439c4a112711b2289bfa; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69639696, jitterRate=0.03771233558654785}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-09 20:56:18,273 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(964): Region open journal for 1588791fd318439c4a112711b2289bfa: Running coprocessor pre-open hook at 1675976178245Writing region info on filesystem at 1675976178245Initializing all the Stores at 1675976178245Instantiating store for column family {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\x1E!_\x81\xD9!\x13\x11p\x0E\xDB\xCB\xCE\xF6\xFC\xDC"\x10\xC3\x14\x8CP\xC6AI\xD8\xC5\xDB1\xBC\xD3\xC3\x13\xBD*\x10\xF6\x16\x7F\x7F\xF2\xBB\xCA\xD4!p\x1B1\xC1\xAA\xDC)2\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675976178245Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675976178245Cleaning up temporary data from old regions at 1675976178270 (+25 ms)Cleaning up detritus from prior splits at 1675976178270Running coprocessor post-open hooks at 1675976178273 (+3 ms)Region opened successfully at 1675976178273 2023-02-09 20:56:18,274 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionFromAdmin,1,1675976177410.1588791fd318439c4a112711b2289bfa., pid=122, masterSystemTime=1675976178176 2023-02-09 20:56:18,275 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionFromAdmin,1,1675976177410.1588791fd318439c4a112711b2289bfa. 2023-02-09 20:56:18,275 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionFromAdmin,1,1675976177410.1588791fd318439c4a112711b2289bfa. 2023-02-09 20:56:18,275 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=118 updating hbase:meta row=1588791fd318439c4a112711b2289bfa, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:18,275 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,1,1675976177410.1588791fd318439c4a112711b2289bfa.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1675976178275"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1675976178275"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675976178275"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675976178275"}]},"ts":"1675976178275"} 2023-02-09 20:56:18,277 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=122, resume processing ppid=118 2023-02-09 20:56:18,277 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=122, ppid=118, state=SUCCESS; OpenRegionProcedure 1588791fd318439c4a112711b2289bfa, server=jenkins-hbase9.apache.org,40919,1675976022294 in 251 msec 2023-02-09 20:56:18,278 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=118, resume processing ppid=116 2023-02-09 20:56:18,278 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=118, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=1588791fd318439c4a112711b2289bfa, ASSIGN in 408 msec 2023-02-09 20:56:18,279 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-09 20:56:18,279 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionFromAdmin","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675976178279"}]},"ts":"1675976178279"} 2023-02-09 20:56:18,280 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionFromAdmin, state=ENABLED in hbase:meta 2023-02-09 20:56:18,282 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_POST_OPERATION 2023-02-09 20:56:18,283 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=116, state=SUCCESS; CreateTableProcedure table=testMajorCompactionFromAdmin in 842 msec 2023-02-09 20:56:18,547 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-02-09 20:56:18,547 INFO [Listener at localhost/46855] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionFromAdmin, procId: 116 completed 2023-02-09 20:56:18,553 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40919] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,,1675976177410.91ac905c8115b0a77d093240ed551a1f. with WAL disabled. Data may be lost in the event of a crash. 2023-02-09 20:56:18,554 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40919] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,1,1675976177410.1588791fd318439c4a112711b2289bfa. with WAL disabled. Data may be lost in the event of a crash. 2023-02-09 20:56:18,554 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40919] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,2,1675976177410.02305257e8e6e518ce321ba9e1c2a48f. with WAL disabled. Data may be lost in the event of a crash. 2023-02-09 20:56:18,556 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(933): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-02-09 20:56:18,557 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-02-09 20:56:18,557 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-02-09 20:56:18,557 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:56:18,558 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-02-09 20:56:18,558 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-02-09 20:56:18,558 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-09 20:56:18,558 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-09 20:56:18,560 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:56:18,560 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:18,560 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:56:18,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:56:18,561 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:18,561 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 20:56:18,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-09 20:56:18,561 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-09 20:56:18,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 20:56:18,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-09 20:56:18,562 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-02-09 20:56:18,562 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-02-09 20:56:18,562 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-02-09 20:56:18,562 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:56:18,562 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-02-09 20:56:18,562 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1675976177410.02305257e8e6e518ce321ba9e1c2a48f. 2023-02-09 20:56:18,562 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-09 20:56:18,562 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1675976177410.1588791fd318439c4a112711b2289bfa. 2023-02-09 20:56:18,562 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 20:56:18,562 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1675976177410.91ac905c8115b0a77d093240ed551a1f. 2023-02-09 20:56:18,562 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1675976177410.02305257e8e6e518ce321ba9e1c2a48f. started... 2023-02-09 20:56:18,562 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1675976177410.91ac905c8115b0a77d093240ed551a1f. started... 2023-02-09 20:56:18,562 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1675976177410.1588791fd318439c4a112711b2289bfa. started... 2023-02-09 20:56:18,563 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 02305257e8e6e518ce321ba9e1c2a48f 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-02-09 20:56:18,564 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 1588791fd318439c4a112711b2289bfa 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-02-09 20:56:18,564 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 91ac905c8115b0a77d093240ed551a1f 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-02-09 20:56:18,611 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202302091f5d81b311fa4e43b6b37ca81295d378 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202302091f5d81b311fa4e43b6b37ca81295d378 2023-02-09 20:56:18,615 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230209898efe405f75479692776f5bccecb08f to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230209898efe405f75479692776f5bccecb08f 2023-02-09 20:56:18,620 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023020973fbc2d6ff40430b9ed31270f2d37bf3 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023020973fbc2d6ff40430b9ed31270f2d37bf3 2023-02-09 20:56:18,629 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/91ac905c8115b0a77d093240ed551a1f/.tmp/family1/9fd8c31ed39047cab33e9fb10d8391ef 2023-02-09 20:56:19,027 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/1588791fd318439c4a112711b2289bfa/.tmp/family1/ee5a58f02d0e403990136ed3833af5de 2023-02-09 20:56:19,038 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/02305257e8e6e518ce321ba9e1c2a48f/.tmp/family1/2ace4d43880048a3a042882fecf4e5f2 2023-02-09 20:56:19,060 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230209d4e484d62e5443918c7b512ee1ac3549 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b20230209d4e484d62e5443918c7b512ee1ac3549 2023-02-09 20:56:19,061 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230209e53a568d8cda400097b81ff1ea6f203d to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e20230209e53a568d8cda400097b81ff1ea6f203d 2023-02-09 20:56:19,070 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230209bb8faa6d547147ed90538d41782fb774 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c20230209bb8faa6d547147ed90538d41782fb774 2023-02-09 20:56:19,435 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionFromAdmin' 2023-02-09 20:56:19,465 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/1588791fd318439c4a112711b2289bfa/.tmp/family2/b841fff0eeb242878e210c292593ae65 2023-02-09 20:56:19,466 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/91ac905c8115b0a77d093240ed551a1f/.tmp/family2/9984a5c8b0da4b99ba1ea91616cbc0bb 2023-02-09 20:56:19,469 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/1588791fd318439c4a112711b2289bfa/.tmp/family1/ee5a58f02d0e403990136ed3833af5de as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/1588791fd318439c4a112711b2289bfa/family1/ee5a58f02d0e403990136ed3833af5de 2023-02-09 20:56:19,469 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/91ac905c8115b0a77d093240ed551a1f/.tmp/family1/9fd8c31ed39047cab33e9fb10d8391ef as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/91ac905c8115b0a77d093240ed551a1f/family1/9fd8c31ed39047cab33e9fb10d8391ef 2023-02-09 20:56:19,475 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/02305257e8e6e518ce321ba9e1c2a48f/.tmp/family2/6ba3757933d54a6eb78157a1c5295b6d 2023-02-09 20:56:19,478 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/02305257e8e6e518ce321ba9e1c2a48f/.tmp/family1/2ace4d43880048a3a042882fecf4e5f2 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/02305257e8e6e518ce321ba9e1c2a48f/family1/2ace4d43880048a3a042882fecf4e5f2 2023-02-09 20:56:19,496 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/91ac905c8115b0a77d093240ed551a1f/family1/9fd8c31ed39047cab33e9fb10d8391ef, entries=4, sequenceid=5, filesize=5.5 K 2023-02-09 20:56:19,497 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/91ac905c8115b0a77d093240ed551a1f/.tmp/family2/9984a5c8b0da4b99ba1ea91616cbc0bb as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/91ac905c8115b0a77d093240ed551a1f/family2/9984a5c8b0da4b99ba1ea91616cbc0bb 2023-02-09 20:56:19,498 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/1588791fd318439c4a112711b2289bfa/family1/ee5a58f02d0e403990136ed3833af5de, entries=4, sequenceid=5, filesize=5.5 K 2023-02-09 20:56:19,503 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/1588791fd318439c4a112711b2289bfa/.tmp/family2/b841fff0eeb242878e210c292593ae65 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/1588791fd318439c4a112711b2289bfa/family2/b841fff0eeb242878e210c292593ae65 2023-02-09 20:56:19,504 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/91ac905c8115b0a77d093240ed551a1f/family2/9984a5c8b0da4b99ba1ea91616cbc0bb, entries=2, sequenceid=5, filesize=5.1 K 2023-02-09 20:56:19,505 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 91ac905c8115b0a77d093240ed551a1f in 941ms, sequenceid=5, compaction requested=false 2023-02-09 20:56:19,506 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 91ac905c8115b0a77d093240ed551a1f: 2023-02-09 20:56:19,506 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1675976177410.91ac905c8115b0a77d093240ed551a1f. 2023-02-09 20:56:19,506 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-09 20:56:19,507 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/02305257e8e6e518ce321ba9e1c2a48f/family1/2ace4d43880048a3a042882fecf4e5f2, entries=4, sequenceid=5, filesize=5.5 K 2023-02-09 20:56:19,507 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/02305257e8e6e518ce321ba9e1c2a48f/.tmp/family2/6ba3757933d54a6eb78157a1c5295b6d as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/02305257e8e6e518ce321ba9e1c2a48f/family2/6ba3757933d54a6eb78157a1c5295b6d 2023-02-09 20:56:19,508 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/1588791fd318439c4a112711b2289bfa/family2/b841fff0eeb242878e210c292593ae65, entries=2, sequenceid=5, filesize=5.1 K 2023-02-09 20:56:19,508 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 1588791fd318439c4a112711b2289bfa in 944ms, sequenceid=5, compaction requested=false 2023-02-09 20:56:19,509 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 1588791fd318439c4a112711b2289bfa: 2023-02-09 20:56:19,509 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1675976177410.1588791fd318439c4a112711b2289bfa. 2023-02-09 20:56:19,509 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-09 20:56:19,511 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/02305257e8e6e518ce321ba9e1c2a48f/family2/6ba3757933d54a6eb78157a1c5295b6d, entries=2, sequenceid=5, filesize=5.1 K 2023-02-09 20:56:19,512 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 02305257e8e6e518ce321ba9e1c2a48f in 949ms, sequenceid=5, compaction requested=false 2023-02-09 20:56:19,512 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 02305257e8e6e518ce321ba9e1c2a48f: 2023-02-09 20:56:19,512 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1675976177410.02305257e8e6e518ce321ba9e1c2a48f. 2023-02-09 20:56:19,512 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-09 20:56:19,512 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-09 20:56:19,512 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:19,512 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-02-09 20:56:19,512 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-02-09 20:56:19,516 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:19,516 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-09 20:56:19,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:19,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:56:19,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:56:19,517 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-09 20:56:19,517 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 20:56:19,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:56:19,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:56:19,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-09 20:56:19,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:19,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:56:19,518 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-02-09 20:56:19,518 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4de63e31[Count = 0] remaining members to acquire global barrier 2023-02-09 20:56:19,518 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-02-09 20:56:19,518 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-09 20:56:19,519 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-09 20:56:19,519 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-09 20:56:19,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-09 20:56:19,519 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-02-09 20:56:19,519 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:19,519 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 20:56:19,519 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-02-09 20:56:19,519 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase9.apache.org,40919,1675976022294' in zk 2023-02-09 20:56:19,521 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-02-09 20:56:19,521 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:19,521 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:56:19,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:19,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:56:19,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:56:19,522 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-02-09 20:56:19,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:56:19,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:56:19,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-09 20:56:19,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:19,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:56:19,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-09 20:56:19,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:19,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase9.apache.org,40919,1675976022294': 2023-02-09 20:56:19,523 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-02-09 20:56:19,523 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-02-09 20:56:19,523 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 20:56:19,523 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 20:56:19,523 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-02-09 20:56:19,523 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 20:56:19,525 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-09 20:56:19,525 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-09 20:56:19,525 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:56:19,525 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-09 20:56:19,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-09 20:56:19,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:56:19,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:56:19,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-09 20:56:19,525 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:19,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:56:19,525 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:56:19,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:56:19,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-09 20:56:19,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-09 20:56:19,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:56:19,526 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:19,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-09 20:56:19,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:19,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:56:19,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-09 20:56:19,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:19,528 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:19,528 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:56:19,528 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-09 20:56:19,528 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:56:19,529 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:56:19,528 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:56:19,529 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-02-09 20:56:19,529 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 20:56:19,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:56:19,529 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-09 20:56:19,529 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:19,529 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-09 20:56:19,529 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-09 20:56:19,529 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-09 20:56:19,529 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-02-09 20:56:19,529 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-02-09 20:56:19,529 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 20:56:19,529 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:56:19,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:56:19,629 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 20:56:19,630 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 20:56:19,631 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40919] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,,1675976177410.91ac905c8115b0a77d093240ed551a1f. with WAL disabled. Data may be lost in the event of a crash. 2023-02-09 20:56:19,631 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40919] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,1,1675976177410.1588791fd318439c4a112711b2289bfa. with WAL disabled. Data may be lost in the event of a crash. 2023-02-09 20:56:19,631 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40919] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,2,1675976177410.02305257e8e6e518ce321ba9e1c2a48f. with WAL disabled. Data may be lost in the event of a crash. 2023-02-09 20:56:19,633 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(933): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-02-09 20:56:19,635 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-02-09 20:56:19,635 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-02-09 20:56:19,635 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-02-09 20:56:19,635 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:56:19,635 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-02-09 20:56:19,635 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-02-09 20:56:19,636 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-09 20:56:19,636 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-09 20:56:19,637 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:19,637 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:56:19,637 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:56:19,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:56:19,637 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:19,637 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 20:56:19,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-09 20:56:19,638 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-09 20:56:19,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 20:56:19,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-09 20:56:19,638 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-02-09 20:56:19,638 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-02-09 20:56:19,638 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-02-09 20:56:19,638 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-02-09 20:56:19,638 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:56:19,638 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-02-09 20:56:19,638 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1675976177410.02305257e8e6e518ce321ba9e1c2a48f. 2023-02-09 20:56:19,638 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1675976177410.02305257e8e6e518ce321ba9e1c2a48f. started... 2023-02-09 20:56:19,639 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1675976177410.91ac905c8115b0a77d093240ed551a1f. 2023-02-09 20:56:19,639 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1675976177410.91ac905c8115b0a77d093240ed551a1f. started... 2023-02-09 20:56:19,639 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 02305257e8e6e518ce321ba9e1c2a48f 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-02-09 20:56:19,639 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 91ac905c8115b0a77d093240ed551a1f 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-02-09 20:56:19,639 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-09 20:56:19,639 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 20:56:19,639 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1675976177410.1588791fd318439c4a112711b2289bfa. 2023-02-09 20:56:19,639 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1675976177410.1588791fd318439c4a112711b2289bfa. started... 2023-02-09 20:56:19,639 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 1588791fd318439c4a112711b2289bfa 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-02-09 20:56:19,694 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023020939641e29b9974ae6a75451be74dbad6d to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023020939641e29b9974ae6a75451be74dbad6d 2023-02-09 20:56:20,084 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202302098a3e53a45ca04234a5f14e827cd94172 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202302098a3e53a45ca04234a5f14e827cd94172 2023-02-09 20:56:20,086 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202302094cff344d524940f7ab6cf76ba2a03270 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202302094cff344d524940f7ab6cf76ba2a03270 2023-02-09 20:56:20,100 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/1588791fd318439c4a112711b2289bfa/.tmp/family1/5454f59ade3d44ac8d154edbf8eb80f8 2023-02-09 20:56:20,109 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/02305257e8e6e518ce321ba9e1c2a48f/.tmp/family1/ed1e8d2cca4748db8d3e4b5f76daab78 2023-02-09 20:56:20,500 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/91ac905c8115b0a77d093240ed551a1f/.tmp/family1/010fbaf64c1d4a59a58718dfc3bb2f59 2023-02-09 20:56:20,532 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202302092785f22ee9414fc68d4682d44aade46c to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b202302092785f22ee9414fc68d4682d44aade46c 2023-02-09 20:56:20,547 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302095c12817a629646a28ae6b2fb65915910 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c202302095c12817a629646a28ae6b2fb65915910 2023-02-09 20:56:20,552 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/02305257e8e6e518ce321ba9e1c2a48f/.tmp/family2/7bc2475f7f9b46788e58e1175956b0bc 2023-02-09 20:56:20,555 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/02305257e8e6e518ce321ba9e1c2a48f/.tmp/family1/ed1e8d2cca4748db8d3e4b5f76daab78 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/02305257e8e6e518ce321ba9e1c2a48f/family1/ed1e8d2cca4748db8d3e4b5f76daab78 2023-02-09 20:56:20,579 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/02305257e8e6e518ce321ba9e1c2a48f/family1/ed1e8d2cca4748db8d3e4b5f76daab78, entries=4, sequenceid=9, filesize=5.5 K 2023-02-09 20:56:20,580 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/02305257e8e6e518ce321ba9e1c2a48f/.tmp/family2/7bc2475f7f9b46788e58e1175956b0bc as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/02305257e8e6e518ce321ba9e1c2a48f/family2/7bc2475f7f9b46788e58e1175956b0bc 2023-02-09 20:56:20,583 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/02305257e8e6e518ce321ba9e1c2a48f/family2/7bc2475f7f9b46788e58e1175956b0bc, entries=2, sequenceid=9, filesize=5.1 K 2023-02-09 20:56:20,584 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 02305257e8e6e518ce321ba9e1c2a48f in 945ms, sequenceid=9, compaction requested=false 2023-02-09 20:56:20,584 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 02305257e8e6e518ce321ba9e1c2a48f: 2023-02-09 20:56:20,584 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1675976177410.02305257e8e6e518ce321ba9e1c2a48f. 2023-02-09 20:56:20,584 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-09 20:56:20,932 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230209f5f02730b105496d97e1ebcfe28a947a to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e20230209f5f02730b105496d97e1ebcfe28a947a 2023-02-09 20:56:20,936 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/1588791fd318439c4a112711b2289bfa/.tmp/family2/9923670d0c6942c7899a4627dcf82e2e 2023-02-09 20:56:20,940 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/1588791fd318439c4a112711b2289bfa/.tmp/family1/5454f59ade3d44ac8d154edbf8eb80f8 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/1588791fd318439c4a112711b2289bfa/family1/5454f59ade3d44ac8d154edbf8eb80f8 2023-02-09 20:56:20,962 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/1588791fd318439c4a112711b2289bfa/family1/5454f59ade3d44ac8d154edbf8eb80f8, entries=4, sequenceid=9, filesize=5.5 K 2023-02-09 20:56:20,963 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/1588791fd318439c4a112711b2289bfa/.tmp/family2/9923670d0c6942c7899a4627dcf82e2e as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/1588791fd318439c4a112711b2289bfa/family2/9923670d0c6942c7899a4627dcf82e2e 2023-02-09 20:56:20,967 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/1588791fd318439c4a112711b2289bfa/family2/9923670d0c6942c7899a4627dcf82e2e, entries=2, sequenceid=9, filesize=5.1 K 2023-02-09 20:56:20,967 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 1588791fd318439c4a112711b2289bfa in 1328ms, sequenceid=9, compaction requested=false 2023-02-09 20:56:20,967 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 1588791fd318439c4a112711b2289bfa: 2023-02-09 20:56:20,968 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1675976177410.1588791fd318439c4a112711b2289bfa. 2023-02-09 20:56:20,968 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-09 20:56:21,337 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/91ac905c8115b0a77d093240ed551a1f/.tmp/family2/285c8bdf292e42a6bcdcf6c22ec8e90e 2023-02-09 20:56:21,341 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/91ac905c8115b0a77d093240ed551a1f/.tmp/family1/010fbaf64c1d4a59a58718dfc3bb2f59 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/91ac905c8115b0a77d093240ed551a1f/family1/010fbaf64c1d4a59a58718dfc3bb2f59 2023-02-09 20:56:21,365 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/91ac905c8115b0a77d093240ed551a1f/family1/010fbaf64c1d4a59a58718dfc3bb2f59, entries=4, sequenceid=9, filesize=5.5 K 2023-02-09 20:56:21,366 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/91ac905c8115b0a77d093240ed551a1f/.tmp/family2/285c8bdf292e42a6bcdcf6c22ec8e90e as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/91ac905c8115b0a77d093240ed551a1f/family2/285c8bdf292e42a6bcdcf6c22ec8e90e 2023-02-09 20:56:21,369 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/91ac905c8115b0a77d093240ed551a1f/family2/285c8bdf292e42a6bcdcf6c22ec8e90e, entries=2, sequenceid=9, filesize=5.1 K 2023-02-09 20:56:21,370 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 91ac905c8115b0a77d093240ed551a1f in 1731ms, sequenceid=9, compaction requested=false 2023-02-09 20:56:21,370 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 91ac905c8115b0a77d093240ed551a1f: 2023-02-09 20:56:21,370 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1675976177410.91ac905c8115b0a77d093240ed551a1f. 2023-02-09 20:56:21,370 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-09 20:56:21,370 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-09 20:56:21,370 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:21,370 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-02-09 20:56:21,370 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-02-09 20:56:21,373 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:21,373 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-09 20:56:21,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:21,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:56:21,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:56:21,373 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-09 20:56:21,373 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 20:56:21,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:56:21,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:56:21,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-09 20:56:21,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:21,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:56:21,374 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-02-09 20:56:21,374 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@8f5cf27[Count = 0] remaining members to acquire global barrier 2023-02-09 20:56:21,374 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-02-09 20:56:21,375 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-09 20:56:21,376 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-09 20:56:21,376 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-09 20:56:21,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-09 20:56:21,376 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-02-09 20:56:21,376 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-02-09 20:56:21,376 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase9.apache.org,40919,1675976022294' in zk 2023-02-09 20:56:21,376 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:21,376 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 20:56:21,377 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-02-09 20:56:21,377 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:21,377 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:56:21,377 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-02-09 20:56:21,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:21,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:56:21,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:56:21,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:56:21,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:56:21,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-09 20:56:21,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:21,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:56:21,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-09 20:56:21,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:21,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase9.apache.org,40919,1675976022294': 2023-02-09 20:56:21,380 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-02-09 20:56:21,380 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-02-09 20:56:21,380 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 20:56:21,380 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 20:56:21,380 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-02-09 20:56:21,380 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 20:56:21,381 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-09 20:56:21,381 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-09 20:56:21,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-09 20:56:21,381 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-09 20:56:21,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-09 20:56:21,381 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:56:21,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:56:21,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:56:21,382 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:21,382 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:56:21,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:56:21,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:56:21,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-09 20:56:21,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-09 20:56:21,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:56:21,383 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:21,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-09 20:56:21,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:21,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:56:21,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-09 20:56:21,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:21,386 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:21,386 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:56:21,386 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-09 20:56:21,386 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:56:21,386 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-02-09 20:56:21,386 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 20:56:21,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:56:21,386 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-09 20:56:21,386 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:56:21,386 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:56:21,387 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-02-09 20:56:21,387 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 20:56:21,387 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:21,387 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-02-09 20:56:21,387 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-09 20:56:21,387 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-09 20:56:21,387 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:56:21,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:56:21,387 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-09 20:56:21,487 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 20:56:21,488 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 20:56:21,489 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40919] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,,1675976177410.91ac905c8115b0a77d093240ed551a1f. with WAL disabled. Data may be lost in the event of a crash. 2023-02-09 20:56:21,489 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40919] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,1,1675976177410.1588791fd318439c4a112711b2289bfa. with WAL disabled. Data may be lost in the event of a crash. 2023-02-09 20:56:21,489 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40919] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,2,1675976177410.02305257e8e6e518ce321ba9e1c2a48f. with WAL disabled. Data may be lost in the event of a crash. 2023-02-09 20:56:21,491 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(933): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-02-09 20:56:21,493 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-02-09 20:56:21,493 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-02-09 20:56:21,493 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-02-09 20:56:21,493 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:56:21,493 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-02-09 20:56:21,493 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-02-09 20:56:21,494 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-09 20:56:21,494 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-09 20:56:21,495 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:56:21,495 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:21,495 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:56:21,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:56:21,496 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:21,496 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 20:56:21,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-09 20:56:21,496 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-09 20:56:21,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 20:56:21,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-09 20:56:21,496 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-02-09 20:56:21,496 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-02-09 20:56:21,497 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-02-09 20:56:21,497 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-02-09 20:56:21,497 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:56:21,497 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-02-09 20:56:21,497 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1675976177410.02305257e8e6e518ce321ba9e1c2a48f. 2023-02-09 20:56:21,497 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-09 20:56:21,497 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 20:56:21,497 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1675976177410.1588791fd318439c4a112711b2289bfa. 2023-02-09 20:56:21,497 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1675976177410.91ac905c8115b0a77d093240ed551a1f. 2023-02-09 20:56:21,497 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1675976177410.1588791fd318439c4a112711b2289bfa. started... 2023-02-09 20:56:21,497 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1675976177410.02305257e8e6e518ce321ba9e1c2a48f. started... 2023-02-09 20:56:21,497 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1675976177410.91ac905c8115b0a77d093240ed551a1f. started... 2023-02-09 20:56:21,497 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 1588791fd318439c4a112711b2289bfa 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-02-09 20:56:21,497 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 02305257e8e6e518ce321ba9e1c2a48f 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-02-09 20:56:21,497 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 91ac905c8115b0a77d093240ed551a1f 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-02-09 20:56:21,946 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023020903d92b24e4b34c9c93c1963fa743fbb7 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023020903d92b24e4b34c9c93c1963fa743fbb7 2023-02-09 20:56:21,954 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023020917c86d265ae0456daa7180605603b1aa to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023020917c86d265ae0456daa7180605603b1aa 2023-02-09 20:56:21,961 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230209515fdb1226c947de9f87a24e0fb4d393 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230209515fdb1226c947de9f87a24e0fb4d393 2023-02-09 20:56:21,973 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/91ac905c8115b0a77d093240ed551a1f/.tmp/family1/b145115774a049fe999ef9c150ad3e50 2023-02-09 20:56:22,363 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/02305257e8e6e518ce321ba9e1c2a48f/.tmp/family1/bc6d16cd5a0f46db8fe913d8f8afe039 2023-02-09 20:56:22,385 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/1588791fd318439c4a112711b2289bfa/.tmp/family1/638434f7bee34fefb7efc82d5a0756f2 2023-02-09 20:56:22,410 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230209ccc6db2fbc6f4a1db1c6002f6571b481 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e20230209ccc6db2fbc6f4a1db1c6002f6571b481 2023-02-09 20:56:22,423 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230209a6e5ca0347e64f17b008e000f4648777 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c20230209a6e5ca0347e64f17b008e000f4648777 2023-02-09 20:56:22,820 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/91ac905c8115b0a77d093240ed551a1f/.tmp/family2/519a22be5f95438e8f0c41d289a16f46 2023-02-09 20:56:22,824 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/91ac905c8115b0a77d093240ed551a1f/.tmp/family1/b145115774a049fe999ef9c150ad3e50 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/91ac905c8115b0a77d093240ed551a1f/family1/b145115774a049fe999ef9c150ad3e50 2023-02-09 20:56:22,826 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202302098f668cddde8b4a1396d4297b6097d01f to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b202302098f668cddde8b4a1396d4297b6097d01f 2023-02-09 20:56:22,829 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/02305257e8e6e518ce321ba9e1c2a48f/.tmp/family2/007f726fdf914d2e9ff97199943cf0d0 2023-02-09 20:56:22,831 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/1588791fd318439c4a112711b2289bfa/.tmp/family2/47986ab530c54d80a07d1dcd868b4cc2 2023-02-09 20:56:22,833 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/02305257e8e6e518ce321ba9e1c2a48f/.tmp/family1/bc6d16cd5a0f46db8fe913d8f8afe039 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/02305257e8e6e518ce321ba9e1c2a48f/family1/bc6d16cd5a0f46db8fe913d8f8afe039 2023-02-09 20:56:22,836 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/1588791fd318439c4a112711b2289bfa/.tmp/family1/638434f7bee34fefb7efc82d5a0756f2 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/1588791fd318439c4a112711b2289bfa/family1/638434f7bee34fefb7efc82d5a0756f2 2023-02-09 20:56:22,854 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/91ac905c8115b0a77d093240ed551a1f/family1/b145115774a049fe999ef9c150ad3e50, entries=4, sequenceid=13, filesize=5.5 K 2023-02-09 20:56:22,855 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/91ac905c8115b0a77d093240ed551a1f/.tmp/family2/519a22be5f95438e8f0c41d289a16f46 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/91ac905c8115b0a77d093240ed551a1f/family2/519a22be5f95438e8f0c41d289a16f46 2023-02-09 20:56:22,858 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/02305257e8e6e518ce321ba9e1c2a48f/family1/bc6d16cd5a0f46db8fe913d8f8afe039, entries=4, sequenceid=13, filesize=5.5 K 2023-02-09 20:56:22,859 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/02305257e8e6e518ce321ba9e1c2a48f/.tmp/family2/007f726fdf914d2e9ff97199943cf0d0 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/02305257e8e6e518ce321ba9e1c2a48f/family2/007f726fdf914d2e9ff97199943cf0d0 2023-02-09 20:56:22,860 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/91ac905c8115b0a77d093240ed551a1f/family2/519a22be5f95438e8f0c41d289a16f46, entries=2, sequenceid=13, filesize=5.1 K 2023-02-09 20:56:22,861 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 91ac905c8115b0a77d093240ed551a1f in 1364ms, sequenceid=13, compaction requested=true 2023-02-09 20:56:22,861 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 91ac905c8115b0a77d093240ed551a1f: 2023-02-09 20:56:22,861 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1675976177410.91ac905c8115b0a77d093240ed551a1f. 2023-02-09 20:56:22,861 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-09 20:56:22,863 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/02305257e8e6e518ce321ba9e1c2a48f/family2/007f726fdf914d2e9ff97199943cf0d0, entries=2, sequenceid=13, filesize=5.1 K 2023-02-09 20:56:22,864 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 02305257e8e6e518ce321ba9e1c2a48f in 1367ms, sequenceid=13, compaction requested=true 2023-02-09 20:56:22,864 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 02305257e8e6e518ce321ba9e1c2a48f: 2023-02-09 20:56:22,864 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1675976177410.02305257e8e6e518ce321ba9e1c2a48f. 2023-02-09 20:56:22,864 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-09 20:56:22,865 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/1588791fd318439c4a112711b2289bfa/family1/638434f7bee34fefb7efc82d5a0756f2, entries=4, sequenceid=13, filesize=5.5 K 2023-02-09 20:56:22,865 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/1588791fd318439c4a112711b2289bfa/.tmp/family2/47986ab530c54d80a07d1dcd868b4cc2 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/1588791fd318439c4a112711b2289bfa/family2/47986ab530c54d80a07d1dcd868b4cc2 2023-02-09 20:56:22,869 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/1588791fd318439c4a112711b2289bfa/family2/47986ab530c54d80a07d1dcd868b4cc2, entries=2, sequenceid=13, filesize=5.1 K 2023-02-09 20:56:22,869 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 1588791fd318439c4a112711b2289bfa in 1372ms, sequenceid=13, compaction requested=true 2023-02-09 20:56:22,869 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 1588791fd318439c4a112711b2289bfa: 2023-02-09 20:56:22,869 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1675976177410.1588791fd318439c4a112711b2289bfa. 2023-02-09 20:56:22,869 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-09 20:56:22,869 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-09 20:56:22,869 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:22,869 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-02-09 20:56:22,870 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-02-09 20:56:22,871 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:22,871 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-09 20:56:22,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:22,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:56:22,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:56:22,872 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-09 20:56:22,872 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 20:56:22,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:56:22,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:56:22,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-09 20:56:22,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:22,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:56:22,873 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-02-09 20:56:22,873 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@703b04e7[Count = 0] remaining members to acquire global barrier 2023-02-09 20:56:22,873 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-02-09 20:56:22,873 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-09 20:56:22,874 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-09 20:56:22,874 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-09 20:56:22,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-09 20:56:22,874 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-02-09 20:56:22,874 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-02-09 20:56:22,874 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase9.apache.org,40919,1675976022294' in zk 2023-02-09 20:56:22,875 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:22,875 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 20:56:22,876 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:22,876 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-02-09 20:56:22,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:22,876 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:56:22,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:56:22,876 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-02-09 20:56:22,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:56:22,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:56:22,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:56:22,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-09 20:56:22,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:22,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:56:22,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-09 20:56:22,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:22,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase9.apache.org,40919,1675976022294': 2023-02-09 20:56:22,878 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-02-09 20:56:22,878 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-02-09 20:56:22,878 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 20:56:22,878 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 20:56:22,878 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-02-09 20:56:22,878 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 20:56:22,881 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-09 20:56:22,881 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-09 20:56:22,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-09 20:56:22,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:56:22,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:56:22,881 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-09 20:56:22,881 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:56:22,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-09 20:56:22,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:56:22,881 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:22,881 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:56:22,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:56:22,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-09 20:56:22,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-09 20:56:22,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:56:22,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-09 20:56:22,882 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:22,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:22,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:56:22,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-09 20:56:22,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:22,885 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:22,885 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:56:22,885 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-09 20:56:22,885 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:56:22,885 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-09 20:56:22,885 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:56:22,885 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:56:22,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:56:22,885 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:22,885 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-02-09 20:56:22,885 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 20:56:22,885 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-09 20:56:22,885 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:56:22,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:56:22,885 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-09 20:56:22,885 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-09 20:56:22,885 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-02-09 20:56:22,885 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 20:56:22,985 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 20:56:22,986 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 20:56:22,987 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40919] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,,1675976177410.91ac905c8115b0a77d093240ed551a1f. with WAL disabled. Data may be lost in the event of a crash. 2023-02-09 20:56:22,987 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40919] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,1,1675976177410.1588791fd318439c4a112711b2289bfa. with WAL disabled. Data may be lost in the event of a crash. 2023-02-09 20:56:22,988 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40919] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,2,1675976177410.02305257e8e6e518ce321ba9e1c2a48f. with WAL disabled. Data may be lost in the event of a crash. 2023-02-09 20:56:22,989 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(933): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-02-09 20:56:22,991 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-02-09 20:56:22,991 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-02-09 20:56:22,991 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-02-09 20:56:22,991 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:56:22,991 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-02-09 20:56:22,991 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-02-09 20:56:22,992 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-09 20:56:22,992 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-09 20:56:22,996 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:56:22,996 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:22,996 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:56:22,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:56:22,996 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:22,996 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 20:56:22,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-09 20:56:22,996 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-09 20:56:22,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 20:56:22,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-09 20:56:22,997 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-02-09 20:56:22,997 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-02-09 20:56:22,997 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-02-09 20:56:22,997 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-02-09 20:56:22,997 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:56:22,997 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-02-09 20:56:22,997 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1675976177410.02305257e8e6e518ce321ba9e1c2a48f. 2023-02-09 20:56:22,997 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-09 20:56:22,997 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 20:56:22,997 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1675976177410.1588791fd318439c4a112711b2289bfa. 2023-02-09 20:56:22,997 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1675976177410.91ac905c8115b0a77d093240ed551a1f. 2023-02-09 20:56:22,997 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1675976177410.91ac905c8115b0a77d093240ed551a1f. started... 2023-02-09 20:56:22,997 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1675976177410.02305257e8e6e518ce321ba9e1c2a48f. started... 2023-02-09 20:56:22,997 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1675976177410.1588791fd318439c4a112711b2289bfa. started... 2023-02-09 20:56:22,998 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 91ac905c8115b0a77d093240ed551a1f 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-02-09 20:56:22,998 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 1588791fd318439c4a112711b2289bfa 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-02-09 20:56:22,998 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 02305257e8e6e518ce321ba9e1c2a48f 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-02-09 20:56:23,057 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302099bc0f1359fe443cbb05bf55ac61fd64d to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202302099bc0f1359fe443cbb05bf55ac61fd64d 2023-02-09 20:56:23,059 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023020977f921b2dfa44efc9690555eb28c5d9a to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023020977f921b2dfa44efc9690555eb28c5d9a 2023-02-09 20:56:23,461 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-09 20:56:23,461 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2e2acbf5 to 127.0.0.1:62089 2023-02-09 20:56:23,461 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 20:56:23,461 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-09 20:56:23,461 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x70a0d3fb to 127.0.0.1:62089 2023-02-09 20:56:23,461 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 20:56:23,472 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202302098d9edadf96d24c25a6463d4f684dc11d to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202302098d9edadf96d24c25a6463d4f684dc11d 2023-02-09 20:56:23,473 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/02305257e8e6e518ce321ba9e1c2a48f/.tmp/family1/0031989c1c71447bada678c823625b50 2023-02-09 20:56:23,473 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/1588791fd318439c4a112711b2289bfa/.tmp/family1/fa46ce8abdee4322826e252b6ed9eb33 2023-02-09 20:56:23,494 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/91ac905c8115b0a77d093240ed551a1f/.tmp/family1/974a23e2d6624b9f9af7eacc7927ecbc 2023-02-09 20:56:23,523 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023020934d921af6e4b4cb79fa063363c2aa6c8 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b2023020934d921af6e4b4cb79fa063363c2aa6c8 2023-02-09 20:56:23,528 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230209c685e31776364bf6bb7385252aca0a2d to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e20230209c685e31776364bf6bb7385252aca0a2d 2023-02-09 20:56:23,534 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/91ac905c8115b0a77d093240ed551a1f/.tmp/family2/a7466ab7c68848bba4d9d4a14867f0ce 2023-02-09 20:56:23,538 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/91ac905c8115b0a77d093240ed551a1f/.tmp/family1/974a23e2d6624b9f9af7eacc7927ecbc as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/91ac905c8115b0a77d093240ed551a1f/family1/974a23e2d6624b9f9af7eacc7927ecbc 2023-02-09 20:56:23,572 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/91ac905c8115b0a77d093240ed551a1f/family1/974a23e2d6624b9f9af7eacc7927ecbc, entries=4, sequenceid=17, filesize=5.5 K 2023-02-09 20:56:23,573 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/91ac905c8115b0a77d093240ed551a1f/.tmp/family2/a7466ab7c68848bba4d9d4a14867f0ce as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/91ac905c8115b0a77d093240ed551a1f/family2/a7466ab7c68848bba4d9d4a14867f0ce 2023-02-09 20:56:23,576 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/91ac905c8115b0a77d093240ed551a1f/family2/a7466ab7c68848bba4d9d4a14867f0ce, entries=2, sequenceid=17, filesize=5.1 K 2023-02-09 20:56:23,577 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 91ac905c8115b0a77d093240ed551a1f in 579ms, sequenceid=17, compaction requested=true 2023-02-09 20:56:23,577 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 91ac905c8115b0a77d093240ed551a1f: 2023-02-09 20:56:23,577 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1675976177410.91ac905c8115b0a77d093240ed551a1f. 2023-02-09 20:56:23,577 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-09 20:56:23,720 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-09 20:56:23,923 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302093d93a71d1e8349d1b90105d3d01d9e10 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c202302093d93a71d1e8349d1b90105d3d01d9e10 2023-02-09 20:56:23,932 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/1588791fd318439c4a112711b2289bfa/.tmp/family2/dc51153b0778405fadafc2aa5570ffb8 2023-02-09 20:56:23,936 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/1588791fd318439c4a112711b2289bfa/.tmp/family1/fa46ce8abdee4322826e252b6ed9eb33 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/1588791fd318439c4a112711b2289bfa/family1/fa46ce8abdee4322826e252b6ed9eb33 2023-02-09 20:56:23,959 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/1588791fd318439c4a112711b2289bfa/family1/fa46ce8abdee4322826e252b6ed9eb33, entries=4, sequenceid=17, filesize=5.5 K 2023-02-09 20:56:23,960 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/1588791fd318439c4a112711b2289bfa/.tmp/family2/dc51153b0778405fadafc2aa5570ffb8 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/1588791fd318439c4a112711b2289bfa/family2/dc51153b0778405fadafc2aa5570ffb8 2023-02-09 20:56:23,963 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/1588791fd318439c4a112711b2289bfa/family2/dc51153b0778405fadafc2aa5570ffb8, entries=2, sequenceid=17, filesize=5.1 K 2023-02-09 20:56:23,964 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 1588791fd318439c4a112711b2289bfa in 966ms, sequenceid=17, compaction requested=true 2023-02-09 20:56:23,964 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 1588791fd318439c4a112711b2289bfa: 2023-02-09 20:56:23,964 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1675976177410.1588791fd318439c4a112711b2289bfa. 2023-02-09 20:56:23,964 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-09 20:56:24,327 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/02305257e8e6e518ce321ba9e1c2a48f/.tmp/family2/d657eb711fbb481c8b651c9cb6bd6e17 2023-02-09 20:56:24,332 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/02305257e8e6e518ce321ba9e1c2a48f/.tmp/family1/0031989c1c71447bada678c823625b50 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/02305257e8e6e518ce321ba9e1c2a48f/family1/0031989c1c71447bada678c823625b50 2023-02-09 20:56:24,359 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/02305257e8e6e518ce321ba9e1c2a48f/family1/0031989c1c71447bada678c823625b50, entries=4, sequenceid=17, filesize=5.5 K 2023-02-09 20:56:24,360 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/02305257e8e6e518ce321ba9e1c2a48f/.tmp/family2/d657eb711fbb481c8b651c9cb6bd6e17 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/02305257e8e6e518ce321ba9e1c2a48f/family2/d657eb711fbb481c8b651c9cb6bd6e17 2023-02-09 20:56:24,363 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/02305257e8e6e518ce321ba9e1c2a48f/family2/d657eb711fbb481c8b651c9cb6bd6e17, entries=2, sequenceid=17, filesize=5.1 K 2023-02-09 20:56:24,364 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 02305257e8e6e518ce321ba9e1c2a48f in 1366ms, sequenceid=17, compaction requested=true 2023-02-09 20:56:24,364 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 02305257e8e6e518ce321ba9e1c2a48f: 2023-02-09 20:56:24,364 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1675976177410.02305257e8e6e518ce321ba9e1c2a48f. 2023-02-09 20:56:24,364 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-09 20:56:24,364 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-09 20:56:24,364 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:24,365 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-02-09 20:56:24,365 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-02-09 20:56:24,367 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-09 20:56:24,367 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:24,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:24,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:56:24,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:56:24,368 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-09 20:56:24,368 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 20:56:24,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:56:24,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:56:24,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-09 20:56:24,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:24,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:56:24,369 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-02-09 20:56:24,369 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4f54ee11[Count = 0] remaining members to acquire global barrier 2023-02-09 20:56:24,369 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-02-09 20:56:24,369 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-09 20:56:24,370 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-09 20:56:24,370 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-09 20:56:24,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-09 20:56:24,370 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-02-09 20:56:24,370 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:24,371 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 20:56:24,370 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-02-09 20:56:24,371 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase9.apache.org,40919,1675976022294' in zk 2023-02-09 20:56:24,372 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:24,372 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-02-09 20:56:24,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:24,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:56:24,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:56:24,372 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:56:24,372 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-02-09 20:56:24,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:56:24,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:56:24,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-09 20:56:24,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:24,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:56:24,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-09 20:56:24,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:24,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase9.apache.org,40919,1675976022294': 2023-02-09 20:56:24,374 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-02-09 20:56:24,374 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-02-09 20:56:24,374 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 20:56:24,374 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 20:56:24,374 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-02-09 20:56:24,374 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 20:56:24,375 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-09 20:56:24,375 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-09 20:56:24,375 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:56:24,375 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-09 20:56:24,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-09 20:56:24,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-09 20:56:24,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:56:24,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:56:24,376 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:56:24,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:56:24,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:56:24,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-09 20:56:24,376 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:24,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-09 20:56:24,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:56:24,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-09 20:56:24,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:24,377 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:24,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:56:24,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-09 20:56:24,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:24,380 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:24,380 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:56:24,380 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-09 20:56:24,380 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:56:24,380 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-02-09 20:56:24,380 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 20:56:24,380 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:56:24,380 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-09 20:56:24,380 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:56:24,380 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:24,380 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-09 20:56:24,380 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-09 20:56:24,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:56:24,380 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-02-09 20:56:24,381 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 20:56:24,380 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-09 20:56:24,381 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:56:24,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:56:24,481 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 20:56:24,481 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 20:56:24,490 DEBUG [Listener at localhost/46855] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-09 20:56:24,497 DEBUG [Listener at localhost/46855] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-09 20:56:24,505 DEBUG [Listener at localhost/46855] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-09 20:56:24,506 DEBUG [Listener at localhost/46855] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-09 20:56:24,586 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(933): Client=jenkins//172.31.2.10 procedure request for: flush-table-proc 2023-02-09 20:56:24,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-02-09 20:56:24,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-02-09 20:56:24,587 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-02-09 20:56:24,587 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:56:24,588 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-02-09 20:56:24,588 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-02-09 20:56:24,588 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-09 20:56:24,588 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-09 20:56:24,589 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:56:24,589 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:24,589 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:56:24,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:56:24,589 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:24,589 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-09 20:56:24,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-09 20:56:24,590 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-09 20:56:24,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-09 20:56:24,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-09 20:56:24,590 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-02-09 20:56:24,590 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-02-09 20:56:24,590 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-02-09 20:56:24,590 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-02-09 20:56:24,590 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-09 20:56:24,591 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-02-09 20:56:24,591 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1675976177410.02305257e8e6e518ce321ba9e1c2a48f. 2023-02-09 20:56:24,591 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1675976177410.02305257e8e6e518ce321ba9e1c2a48f. started... 2023-02-09 20:56:24,591 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-09 20:56:24,591 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 02305257e8e6e518ce321ba9e1c2a48f 2/2 column families, dataSize=138 B heapSize=944 B 2023-02-09 20:56:24,591 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1675976177410.1588791fd318439c4a112711b2289bfa. 2023-02-09 20:56:24,591 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1675976177410.91ac905c8115b0a77d093240ed551a1f. 2023-02-09 20:56:24,591 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1675976177410.1588791fd318439c4a112711b2289bfa. started... 2023-02-09 20:56:24,591 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-09 20:56:24,591 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1675976177410.91ac905c8115b0a77d093240ed551a1f. started... 2023-02-09 20:56:24,591 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 1588791fd318439c4a112711b2289bfa 2/2 column families, dataSize=138 B heapSize=944 B 2023-02-09 20:56:24,591 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 91ac905c8115b0a77d093240ed551a1f 2/2 column families, dataSize=138 B heapSize=944 B 2023-02-09 20:56:25,031 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/1588791fd318439c4a112711b2289bfa/.tmp/family1/993477876a9f4ef29cd3ce066397dc23 2023-02-09 20:56:25,033 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/91ac905c8115b0a77d093240ed551a1f/.tmp/family1/9147a1585d3a4b84b956f3d86ca0c75c 2023-02-09 20:56:25,055 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9147a1585d3a4b84b956f3d86ca0c75c 2023-02-09 20:56:25,065 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 993477876a9f4ef29cd3ce066397dc23 2023-02-09 20:56:25,430 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/02305257e8e6e518ce321ba9e1c2a48f/.tmp/family1/44128efdf21d4e20b3c5b9cb86507ff6 2023-02-09 20:56:25,454 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 44128efdf21d4e20b3c5b9cb86507ff6 2023-02-09 20:56:25,475 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/1588791fd318439c4a112711b2289bfa/.tmp/family2/bbc7e1c86dce4b728183f84c52d58aa9 2023-02-09 20:56:25,478 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for bbc7e1c86dce4b728183f84c52d58aa9 2023-02-09 20:56:25,478 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/1588791fd318439c4a112711b2289bfa/.tmp/family1/993477876a9f4ef29cd3ce066397dc23 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/1588791fd318439c4a112711b2289bfa/family1/993477876a9f4ef29cd3ce066397dc23 2023-02-09 20:56:25,508 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 993477876a9f4ef29cd3ce066397dc23 2023-02-09 20:56:25,508 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/1588791fd318439c4a112711b2289bfa/family1/993477876a9f4ef29cd3ce066397dc23, entries=3, sequenceid=23, filesize=5.2 K 2023-02-09 20:56:25,509 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/1588791fd318439c4a112711b2289bfa/.tmp/family2/bbc7e1c86dce4b728183f84c52d58aa9 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/1588791fd318439c4a112711b2289bfa/family2/bbc7e1c86dce4b728183f84c52d58aa9 2023-02-09 20:56:25,511 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for bbc7e1c86dce4b728183f84c52d58aa9 2023-02-09 20:56:25,511 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/1588791fd318439c4a112711b2289bfa/family2/bbc7e1c86dce4b728183f84c52d58aa9, entries=1, sequenceid=23, filesize=5.0 K 2023-02-09 20:56:25,512 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 1588791fd318439c4a112711b2289bfa in 921ms, sequenceid=23, compaction requested=true 2023-02-09 20:56:25,512 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 1588791fd318439c4a112711b2289bfa: 2023-02-09 20:56:25,512 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1675976177410.1588791fd318439c4a112711b2289bfa. 2023-02-09 20:56:25,512 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-09 20:56:25,868 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/91ac905c8115b0a77d093240ed551a1f/.tmp/family2/49ddb9cc2897423f90e3a6f3d07a3e41 2023-02-09 20:56:25,871 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 49ddb9cc2897423f90e3a6f3d07a3e41 2023-02-09 20:56:25,872 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/91ac905c8115b0a77d093240ed551a1f/.tmp/family1/9147a1585d3a4b84b956f3d86ca0c75c as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/91ac905c8115b0a77d093240ed551a1f/family1/9147a1585d3a4b84b956f3d86ca0c75c 2023-02-09 20:56:25,894 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9147a1585d3a4b84b956f3d86ca0c75c 2023-02-09 20:56:25,894 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/91ac905c8115b0a77d093240ed551a1f/family1/9147a1585d3a4b84b956f3d86ca0c75c, entries=3, sequenceid=23, filesize=5.2 K 2023-02-09 20:56:25,895 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/91ac905c8115b0a77d093240ed551a1f/.tmp/family2/49ddb9cc2897423f90e3a6f3d07a3e41 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/91ac905c8115b0a77d093240ed551a1f/family2/49ddb9cc2897423f90e3a6f3d07a3e41 2023-02-09 20:56:25,899 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 49ddb9cc2897423f90e3a6f3d07a3e41 2023-02-09 20:56:25,899 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/91ac905c8115b0a77d093240ed551a1f/family2/49ddb9cc2897423f90e3a6f3d07a3e41, entries=1, sequenceid=23, filesize=5.0 K 2023-02-09 20:56:25,900 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 91ac905c8115b0a77d093240ed551a1f in 1309ms, sequenceid=23, compaction requested=true 2023-02-09 20:56:25,900 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 91ac905c8115b0a77d093240ed551a1f: 2023-02-09 20:56:25,900 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1675976177410.91ac905c8115b0a77d093240ed551a1f. 2023-02-09 20:56:25,900 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-09 20:56:26,269 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/02305257e8e6e518ce321ba9e1c2a48f/.tmp/family2/802b8ffbc13d4079a3e2a80b640910e1 2023-02-09 20:56:26,272 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 802b8ffbc13d4079a3e2a80b640910e1 2023-02-09 20:56:26,273 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/02305257e8e6e518ce321ba9e1c2a48f/.tmp/family1/44128efdf21d4e20b3c5b9cb86507ff6 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/02305257e8e6e518ce321ba9e1c2a48f/family1/44128efdf21d4e20b3c5b9cb86507ff6 2023-02-09 20:56:26,295 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 44128efdf21d4e20b3c5b9cb86507ff6 2023-02-09 20:56:26,295 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/02305257e8e6e518ce321ba9e1c2a48f/family1/44128efdf21d4e20b3c5b9cb86507ff6, entries=3, sequenceid=23, filesize=5.2 K 2023-02-09 20:56:26,296 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/02305257e8e6e518ce321ba9e1c2a48f/.tmp/family2/802b8ffbc13d4079a3e2a80b640910e1 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/02305257e8e6e518ce321ba9e1c2a48f/family2/802b8ffbc13d4079a3e2a80b640910e1 2023-02-09 20:56:26,299 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 802b8ffbc13d4079a3e2a80b640910e1 2023-02-09 20:56:26,299 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/02305257e8e6e518ce321ba9e1c2a48f/family2/802b8ffbc13d4079a3e2a80b640910e1, entries=1, sequenceid=23, filesize=5.0 K 2023-02-09 20:56:26,300 INFO [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 02305257e8e6e518ce321ba9e1c2a48f in 1709ms, sequenceid=23, compaction requested=true 2023-02-09 20:56:26,300 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 02305257e8e6e518ce321ba9e1c2a48f: 2023-02-09 20:56:26,300 DEBUG [rs(jenkins-hbase9.apache.org,40919,1675976022294)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1675976177410.02305257e8e6e518ce321ba9e1c2a48f. 2023-02-09 20:56:26,300 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-09 20:56:26,300 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-09 20:56:26,300 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:26,300 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-02-09 20:56:26,300 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-02-09 20:56:26,302 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:26,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:26,302 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-09 20:56:26,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:56:26,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:56:26,302 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-09 20:56:26,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:56:26,302 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-09 20:56:26,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:56:26,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-09 20:56:26,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:26,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:56:26,303 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,40919,1675976022294' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-02-09 20:56:26,304 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@333f467c[Count = 0] remaining members to acquire global barrier 2023-02-09 20:56:26,304 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-02-09 20:56:26,304 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-09 20:56:26,305 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-09 20:56:26,305 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-09 20:56:26,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-09 20:56:26,305 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-02-09 20:56:26,305 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-02-09 20:56:26,305 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase9.apache.org,40919,1675976022294' in zk 2023-02-09 20:56:26,305 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:26,305 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-09 20:56:26,307 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:26,307 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-02-09 20:56:26,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:26,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:56:26,307 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:56:26,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:56:26,307 DEBUG [member: 'jenkins-hbase9.apache.org,40919,1675976022294' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-02-09 20:56:26,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:56:26,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:56:26,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-09 20:56:26,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:26,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:56:26,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-09 20:56:26,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:26,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase9.apache.org,40919,1675976022294': 2023-02-09 20:56:26,309 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,40919,1675976022294' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-02-09 20:56:26,309 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-02-09 20:56:26,309 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-09 20:56:26,309 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-09 20:56:26,309 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-02-09 20:56:26,309 INFO [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-09 20:56:26,310 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-09 20:56:26,310 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-09 20:56:26,310 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-09 20:56:26,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-09 20:56:26,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-09 20:56:26,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-09 20:56:26,310 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:56:26,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-09 20:56:26,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-09 20:56:26,311 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:26,311 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:56:26,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:56:26,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-09 20:56:26,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-09 20:56:26,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-09 20:56:26,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-09 20:56:26,312 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:26,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:26,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-09 20:56:26,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-09 20:56:26,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:26,314 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:26,314 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-09 20:56:26,314 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-09 20:56:26,314 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-09 20:56:26,314 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-09 20:56:26,314 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-02-09 20:56:26,314 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-02-09 20:56:26,314 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-09 20:56:26,314 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-09 20:56:26,314 DEBUG [(jenkins-hbase9.apache.org,42951,1675976021166)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-09 20:56:26,314 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:26,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-09 20:56:26,314 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-09 20:56:26,314 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-09 20:56:26,314 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-09 20:56:26,314 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-02-09 20:56:26,314 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-09 20:56:26,314 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-09 20:56:26,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-09 20:56:26,414 DEBUG [Listener at localhost/46855] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-09 20:56:26,415 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42951] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-09 20:56:26,416 DEBUG [Listener at localhost/46855] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-09 20:56:26,416 DEBUG [Listener at localhost/46855] regionserver.HStore(1912): 02305257e8e6e518ce321ba9e1c2a48f/family1 is initiating major compaction (all files) 2023-02-09 20:56:26,416 INFO [Listener at localhost/46855] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-09 20:56:26,416 INFO [Listener at localhost/46855] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 20:56:26,418 INFO [Listener at localhost/46855] regionserver.HRegion(2258): Starting compaction of 02305257e8e6e518ce321ba9e1c2a48f/family1 in testMajorCompactionFromAdmin,2,1675976177410.02305257e8e6e518ce321ba9e1c2a48f. 2023-02-09 20:56:26,418 INFO [Listener at localhost/46855] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/02305257e8e6e518ce321ba9e1c2a48f/family1/2ace4d43880048a3a042882fecf4e5f2, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/02305257e8e6e518ce321ba9e1c2a48f/family1/ed1e8d2cca4748db8d3e4b5f76daab78, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/02305257e8e6e518ce321ba9e1c2a48f/family1/bc6d16cd5a0f46db8fe913d8f8afe039, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/02305257e8e6e518ce321ba9e1c2a48f/family1/0031989c1c71447bada678c823625b50, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/02305257e8e6e518ce321ba9e1c2a48f/family1/44128efdf21d4e20b3c5b9cb86507ff6] into tmpdir=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/02305257e8e6e518ce321ba9e1c2a48f/.tmp, totalSize=27.1 K 2023-02-09 20:56:26,418 DEBUG [Listener at localhost/46855] compactions.Compactor(207): Compacting 2ace4d43880048a3a042882fecf4e5f2, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1675976178554 2023-02-09 20:56:26,419 DEBUG [Listener at localhost/46855] compactions.Compactor(207): Compacting ed1e8d2cca4748db8d3e4b5f76daab78, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1675976179631 2023-02-09 20:56:26,419 DEBUG [Listener at localhost/46855] compactions.Compactor(207): Compacting bc6d16cd5a0f46db8fe913d8f8afe039, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1675976181489 2023-02-09 20:56:26,420 DEBUG [Listener at localhost/46855] compactions.Compactor(207): Compacting 0031989c1c71447bada678c823625b50, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1675976182988 2023-02-09 20:56:26,420 DEBUG [Listener at localhost/46855] compactions.Compactor(207): Compacting 44128efdf21d4e20b3c5b9cb86507ff6, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-09 20:56:26,428 INFO [Listener at localhost/46855] throttle.PressureAwareThroughputController(145): 02305257e8e6e518ce321ba9e1c2a48f#family1#compaction#197 average throughput is 0.86 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-09 20:56:26,878 INFO [Listener at localhost/46855] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20230209bd72bd48f89549b5addec99da2814c7b_del 2023-02-09 20:56:26,878 INFO [Listener at localhost/46855] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230209bd72bd48f89549b5addec99da2814c7b_del to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230209bd72bd48f89549b5addec99da2814c7b_del 2023-02-09 20:56:27,737 INFO [Listener at localhost/46855] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f94003ef181f4126a8e81d667b286d5d 2023-02-09 20:56:27,737 DEBUG [Listener at localhost/46855] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/02305257e8e6e518ce321ba9e1c2a48f/.tmp/family1/f94003ef181f4126a8e81d667b286d5d as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/02305257e8e6e518ce321ba9e1c2a48f/family1/f94003ef181f4126a8e81d667b286d5d 2023-02-09 20:56:27,759 INFO [Listener at localhost/46855] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f94003ef181f4126a8e81d667b286d5d 2023-02-09 20:56:27,760 INFO [Listener at localhost/46855] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 02305257e8e6e518ce321ba9e1c2a48f/family1 of 02305257e8e6e518ce321ba9e1c2a48f into f94003ef181f4126a8e81d667b286d5d(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-09 20:56:27,760 DEBUG [Listener at localhost/46855] regionserver.HRegion(2288): Compaction status journal for 02305257e8e6e518ce321ba9e1c2a48f: 2023-02-09 20:56:27,760 DEBUG [Listener at localhost/46855] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-09 20:56:27,760 DEBUG [Listener at localhost/46855] regionserver.HStore(1912): 02305257e8e6e518ce321ba9e1c2a48f/family2 is initiating major compaction (all files) 2023-02-09 20:56:27,760 INFO [Listener at localhost/46855] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-09 20:56:27,760 INFO [Listener at localhost/46855] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 20:56:27,761 INFO [Listener at localhost/46855] regionserver.HRegion(2258): Starting compaction of 02305257e8e6e518ce321ba9e1c2a48f/family2 in testMajorCompactionFromAdmin,2,1675976177410.02305257e8e6e518ce321ba9e1c2a48f. 2023-02-09 20:56:27,761 INFO [Listener at localhost/46855] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/02305257e8e6e518ce321ba9e1c2a48f/family2/6ba3757933d54a6eb78157a1c5295b6d, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/02305257e8e6e518ce321ba9e1c2a48f/family2/7bc2475f7f9b46788e58e1175956b0bc, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/02305257e8e6e518ce321ba9e1c2a48f/family2/007f726fdf914d2e9ff97199943cf0d0, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/02305257e8e6e518ce321ba9e1c2a48f/family2/d657eb711fbb481c8b651c9cb6bd6e17, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/02305257e8e6e518ce321ba9e1c2a48f/family2/802b8ffbc13d4079a3e2a80b640910e1] into tmpdir=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/02305257e8e6e518ce321ba9e1c2a48f/.tmp, totalSize=25.4 K 2023-02-09 20:56:27,761 DEBUG [Listener at localhost/46855] compactions.Compactor(207): Compacting 6ba3757933d54a6eb78157a1c5295b6d, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1675976178554 2023-02-09 20:56:27,761 DEBUG [Listener at localhost/46855] compactions.Compactor(207): Compacting 7bc2475f7f9b46788e58e1175956b0bc, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1675976179631 2023-02-09 20:56:27,762 DEBUG [Listener at localhost/46855] compactions.Compactor(207): Compacting 007f726fdf914d2e9ff97199943cf0d0, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1675976181489 2023-02-09 20:56:27,762 DEBUG [Listener at localhost/46855] compactions.Compactor(207): Compacting d657eb711fbb481c8b651c9cb6bd6e17, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1675976182988 2023-02-09 20:56:27,762 DEBUG [Listener at localhost/46855] compactions.Compactor(207): Compacting 802b8ffbc13d4079a3e2a80b640910e1, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-09 20:56:27,768 INFO [Listener at localhost/46855] throttle.PressureAwareThroughputController(145): 02305257e8e6e518ce321ba9e1c2a48f#family2#compaction#198 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-09 20:56:27,774 INFO [Listener at localhost/46855] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20230209d937e2e7dc0343609e975e009cc2839e_del 2023-02-09 20:56:27,775 INFO [Listener at localhost/46855] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230209d937e2e7dc0343609e975e009cc2839e_del to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c20230209d937e2e7dc0343609e975e009cc2839e_del 2023-02-09 20:56:27,775 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/02305257e8e6e518ce321ba9e1c2a48f/family1/2ace4d43880048a3a042882fecf4e5f2, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/02305257e8e6e518ce321ba9e1c2a48f/family1/ed1e8d2cca4748db8d3e4b5f76daab78, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/02305257e8e6e518ce321ba9e1c2a48f/family1/bc6d16cd5a0f46db8fe913d8f8afe039, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/02305257e8e6e518ce321ba9e1c2a48f/family1/0031989c1c71447bada678c823625b50, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/02305257e8e6e518ce321ba9e1c2a48f/family1/44128efdf21d4e20b3c5b9cb86507ff6] to archive 2023-02-09 20:56:27,775 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 20:56:27,777 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/02305257e8e6e518ce321ba9e1c2a48f/family1/2ace4d43880048a3a042882fecf4e5f2 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMajorCompactionFromAdmin/02305257e8e6e518ce321ba9e1c2a48f/family1/2ace4d43880048a3a042882fecf4e5f2 2023-02-09 20:56:27,778 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/02305257e8e6e518ce321ba9e1c2a48f/family1/ed1e8d2cca4748db8d3e4b5f76daab78 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMajorCompactionFromAdmin/02305257e8e6e518ce321ba9e1c2a48f/family1/ed1e8d2cca4748db8d3e4b5f76daab78 2023-02-09 20:56:27,779 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/02305257e8e6e518ce321ba9e1c2a48f/family1/bc6d16cd5a0f46db8fe913d8f8afe039 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMajorCompactionFromAdmin/02305257e8e6e518ce321ba9e1c2a48f/family1/bc6d16cd5a0f46db8fe913d8f8afe039 2023-02-09 20:56:27,780 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/02305257e8e6e518ce321ba9e1c2a48f/family1/0031989c1c71447bada678c823625b50 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMajorCompactionFromAdmin/02305257e8e6e518ce321ba9e1c2a48f/family1/0031989c1c71447bada678c823625b50 2023-02-09 20:56:27,781 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/02305257e8e6e518ce321ba9e1c2a48f/family1/44128efdf21d4e20b3c5b9cb86507ff6 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMajorCompactionFromAdmin/02305257e8e6e518ce321ba9e1c2a48f/family1/44128efdf21d4e20b3c5b9cb86507ff6 2023-02-09 20:56:28,191 INFO [Listener at localhost/46855] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2e1f87149b5c4736ab138e0a0828d494 2023-02-09 20:56:28,192 DEBUG [Listener at localhost/46855] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/02305257e8e6e518ce321ba9e1c2a48f/.tmp/family2/2e1f87149b5c4736ab138e0a0828d494 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/02305257e8e6e518ce321ba9e1c2a48f/family2/2e1f87149b5c4736ab138e0a0828d494 2023-02-09 20:56:28,194 INFO [Listener at localhost/46855] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2e1f87149b5c4736ab138e0a0828d494 2023-02-09 20:56:28,195 INFO [Listener at localhost/46855] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 02305257e8e6e518ce321ba9e1c2a48f/family2 of 02305257e8e6e518ce321ba9e1c2a48f into 2e1f87149b5c4736ab138e0a0828d494(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-09 20:56:28,195 DEBUG [Listener at localhost/46855] regionserver.HRegion(2288): Compaction status journal for 02305257e8e6e518ce321ba9e1c2a48f: 2023-02-09 20:56:28,195 DEBUG [Listener at localhost/46855] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-09 20:56:28,196 DEBUG [Listener at localhost/46855] regionserver.HStore(1912): 91ac905c8115b0a77d093240ed551a1f/family1 is initiating major compaction (all files) 2023-02-09 20:56:28,196 INFO [Listener at localhost/46855] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-09 20:56:28,196 INFO [Listener at localhost/46855] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 20:56:28,196 INFO [Listener at localhost/46855] regionserver.HRegion(2258): Starting compaction of 91ac905c8115b0a77d093240ed551a1f/family1 in testMajorCompactionFromAdmin,,1675976177410.91ac905c8115b0a77d093240ed551a1f. 2023-02-09 20:56:28,196 INFO [Listener at localhost/46855] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/91ac905c8115b0a77d093240ed551a1f/family1/9fd8c31ed39047cab33e9fb10d8391ef, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/91ac905c8115b0a77d093240ed551a1f/family1/010fbaf64c1d4a59a58718dfc3bb2f59, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/91ac905c8115b0a77d093240ed551a1f/family1/b145115774a049fe999ef9c150ad3e50, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/91ac905c8115b0a77d093240ed551a1f/family1/974a23e2d6624b9f9af7eacc7927ecbc, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/91ac905c8115b0a77d093240ed551a1f/family1/9147a1585d3a4b84b956f3d86ca0c75c] into tmpdir=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/91ac905c8115b0a77d093240ed551a1f/.tmp, totalSize=27.1 K 2023-02-09 20:56:28,197 DEBUG [Listener at localhost/46855] compactions.Compactor(207): Compacting 9fd8c31ed39047cab33e9fb10d8391ef, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1675976178553 2023-02-09 20:56:28,197 DEBUG [Listener at localhost/46855] compactions.Compactor(207): Compacting 010fbaf64c1d4a59a58718dfc3bb2f59, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1675976179631 2023-02-09 20:56:28,197 DEBUG [Listener at localhost/46855] compactions.Compactor(207): Compacting b145115774a049fe999ef9c150ad3e50, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1675976181489 2023-02-09 20:56:28,197 DEBUG [Listener at localhost/46855] compactions.Compactor(207): Compacting 974a23e2d6624b9f9af7eacc7927ecbc, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1675976182987 2023-02-09 20:56:28,198 DEBUG [Listener at localhost/46855] compactions.Compactor(207): Compacting 9147a1585d3a4b84b956f3d86ca0c75c, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-09 20:56:28,206 INFO [Listener at localhost/46855] throttle.PressureAwareThroughputController(145): 91ac905c8115b0a77d093240ed551a1f#family1#compaction#199 average throughput is 0.86 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-09 20:56:28,274 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/02305257e8e6e518ce321ba9e1c2a48f/family2/6ba3757933d54a6eb78157a1c5295b6d, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/02305257e8e6e518ce321ba9e1c2a48f/family2/7bc2475f7f9b46788e58e1175956b0bc, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/02305257e8e6e518ce321ba9e1c2a48f/family2/007f726fdf914d2e9ff97199943cf0d0, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/02305257e8e6e518ce321ba9e1c2a48f/family2/d657eb711fbb481c8b651c9cb6bd6e17, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/02305257e8e6e518ce321ba9e1c2a48f/family2/802b8ffbc13d4079a3e2a80b640910e1] to archive 2023-02-09 20:56:28,275 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 20:56:28,276 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/02305257e8e6e518ce321ba9e1c2a48f/family2/6ba3757933d54a6eb78157a1c5295b6d to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMajorCompactionFromAdmin/02305257e8e6e518ce321ba9e1c2a48f/family2/6ba3757933d54a6eb78157a1c5295b6d 2023-02-09 20:56:28,277 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/02305257e8e6e518ce321ba9e1c2a48f/family2/7bc2475f7f9b46788e58e1175956b0bc to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMajorCompactionFromAdmin/02305257e8e6e518ce321ba9e1c2a48f/family2/7bc2475f7f9b46788e58e1175956b0bc 2023-02-09 20:56:28,278 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/02305257e8e6e518ce321ba9e1c2a48f/family2/007f726fdf914d2e9ff97199943cf0d0 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMajorCompactionFromAdmin/02305257e8e6e518ce321ba9e1c2a48f/family2/007f726fdf914d2e9ff97199943cf0d0 2023-02-09 20:56:28,279 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/02305257e8e6e518ce321ba9e1c2a48f/family2/d657eb711fbb481c8b651c9cb6bd6e17 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMajorCompactionFromAdmin/02305257e8e6e518ce321ba9e1c2a48f/family2/d657eb711fbb481c8b651c9cb6bd6e17 2023-02-09 20:56:28,280 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/02305257e8e6e518ce321ba9e1c2a48f/family2/802b8ffbc13d4079a3e2a80b640910e1 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMajorCompactionFromAdmin/02305257e8e6e518ce321ba9e1c2a48f/family2/802b8ffbc13d4079a3e2a80b640910e1 2023-02-09 20:56:28,643 INFO [Listener at localhost/46855] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e202302098b4f9b4563d242aa90305e3f71e52301_del 2023-02-09 20:56:28,643 INFO [Listener at localhost/46855] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202302098b4f9b4563d242aa90305e3f71e52301_del to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202302098b4f9b4563d242aa90305e3f71e52301_del 2023-02-09 20:56:29,495 INFO [Listener at localhost/46855] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 14416b6b68a44f2dafc682f6316408af 2023-02-09 20:56:29,496 DEBUG [Listener at localhost/46855] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/91ac905c8115b0a77d093240ed551a1f/.tmp/family1/14416b6b68a44f2dafc682f6316408af as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/91ac905c8115b0a77d093240ed551a1f/family1/14416b6b68a44f2dafc682f6316408af 2023-02-09 20:56:29,520 INFO [Listener at localhost/46855] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 14416b6b68a44f2dafc682f6316408af 2023-02-09 20:56:29,521 INFO [Listener at localhost/46855] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 91ac905c8115b0a77d093240ed551a1f/family1 of 91ac905c8115b0a77d093240ed551a1f into 14416b6b68a44f2dafc682f6316408af(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-09 20:56:29,521 DEBUG [Listener at localhost/46855] regionserver.HRegion(2288): Compaction status journal for 91ac905c8115b0a77d093240ed551a1f: 2023-02-09 20:56:29,521 DEBUG [Listener at localhost/46855] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-09 20:56:29,521 DEBUG [Listener at localhost/46855] regionserver.HStore(1912): 91ac905c8115b0a77d093240ed551a1f/family2 is initiating major compaction (all files) 2023-02-09 20:56:29,521 INFO [Listener at localhost/46855] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-09 20:56:29,521 INFO [Listener at localhost/46855] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 20:56:29,521 INFO [Listener at localhost/46855] regionserver.HRegion(2258): Starting compaction of 91ac905c8115b0a77d093240ed551a1f/family2 in testMajorCompactionFromAdmin,,1675976177410.91ac905c8115b0a77d093240ed551a1f. 2023-02-09 20:56:29,521 INFO [Listener at localhost/46855] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/91ac905c8115b0a77d093240ed551a1f/family2/9984a5c8b0da4b99ba1ea91616cbc0bb, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/91ac905c8115b0a77d093240ed551a1f/family2/285c8bdf292e42a6bcdcf6c22ec8e90e, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/91ac905c8115b0a77d093240ed551a1f/family2/519a22be5f95438e8f0c41d289a16f46, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/91ac905c8115b0a77d093240ed551a1f/family2/a7466ab7c68848bba4d9d4a14867f0ce, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/91ac905c8115b0a77d093240ed551a1f/family2/49ddb9cc2897423f90e3a6f3d07a3e41] into tmpdir=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/91ac905c8115b0a77d093240ed551a1f/.tmp, totalSize=25.4 K 2023-02-09 20:56:29,522 DEBUG [Listener at localhost/46855] compactions.Compactor(207): Compacting 9984a5c8b0da4b99ba1ea91616cbc0bb, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1675976178553 2023-02-09 20:56:29,522 DEBUG [Listener at localhost/46855] compactions.Compactor(207): Compacting 285c8bdf292e42a6bcdcf6c22ec8e90e, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1675976179631 2023-02-09 20:56:29,523 DEBUG [Listener at localhost/46855] compactions.Compactor(207): Compacting 519a22be5f95438e8f0c41d289a16f46, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1675976181489 2023-02-09 20:56:29,523 DEBUG [Listener at localhost/46855] compactions.Compactor(207): Compacting a7466ab7c68848bba4d9d4a14867f0ce, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1675976182987 2023-02-09 20:56:29,523 DEBUG [Listener at localhost/46855] compactions.Compactor(207): Compacting 49ddb9cc2897423f90e3a6f3d07a3e41, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-09 20:56:29,531 INFO [Listener at localhost/46855] throttle.PressureAwareThroughputController(145): 91ac905c8115b0a77d093240ed551a1f#family2#compaction#200 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-09 20:56:29,574 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/91ac905c8115b0a77d093240ed551a1f/family1/9fd8c31ed39047cab33e9fb10d8391ef, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/91ac905c8115b0a77d093240ed551a1f/family1/010fbaf64c1d4a59a58718dfc3bb2f59, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/91ac905c8115b0a77d093240ed551a1f/family1/b145115774a049fe999ef9c150ad3e50, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/91ac905c8115b0a77d093240ed551a1f/family1/974a23e2d6624b9f9af7eacc7927ecbc, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/91ac905c8115b0a77d093240ed551a1f/family1/9147a1585d3a4b84b956f3d86ca0c75c] to archive 2023-02-09 20:56:29,575 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 20:56:29,576 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/91ac905c8115b0a77d093240ed551a1f/family1/9fd8c31ed39047cab33e9fb10d8391ef to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMajorCompactionFromAdmin/91ac905c8115b0a77d093240ed551a1f/family1/9fd8c31ed39047cab33e9fb10d8391ef 2023-02-09 20:56:29,577 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/91ac905c8115b0a77d093240ed551a1f/family1/010fbaf64c1d4a59a58718dfc3bb2f59 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMajorCompactionFromAdmin/91ac905c8115b0a77d093240ed551a1f/family1/010fbaf64c1d4a59a58718dfc3bb2f59 2023-02-09 20:56:29,578 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/91ac905c8115b0a77d093240ed551a1f/family1/b145115774a049fe999ef9c150ad3e50 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMajorCompactionFromAdmin/91ac905c8115b0a77d093240ed551a1f/family1/b145115774a049fe999ef9c150ad3e50 2023-02-09 20:56:29,578 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/91ac905c8115b0a77d093240ed551a1f/family1/974a23e2d6624b9f9af7eacc7927ecbc to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMajorCompactionFromAdmin/91ac905c8115b0a77d093240ed551a1f/family1/974a23e2d6624b9f9af7eacc7927ecbc 2023-02-09 20:56:29,579 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/91ac905c8115b0a77d093240ed551a1f/family1/9147a1585d3a4b84b956f3d86ca0c75c to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMajorCompactionFromAdmin/91ac905c8115b0a77d093240ed551a1f/family1/9147a1585d3a4b84b956f3d86ca0c75c 2023-02-09 20:56:29,938 INFO [Listener at localhost/46855] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20230209b3a9aa294d8f43f9851033afc9c58075_del 2023-02-09 20:56:29,938 INFO [Listener at localhost/46855] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230209b3a9aa294d8f43f9851033afc9c58075_del to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e20230209b3a9aa294d8f43f9851033afc9c58075_del 2023-02-09 20:56:30,349 INFO [Listener at localhost/46855] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a82b45ce891e495285103ede6e7069e1 2023-02-09 20:56:30,350 DEBUG [Listener at localhost/46855] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/91ac905c8115b0a77d093240ed551a1f/.tmp/family2/a82b45ce891e495285103ede6e7069e1 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/91ac905c8115b0a77d093240ed551a1f/family2/a82b45ce891e495285103ede6e7069e1 2023-02-09 20:56:30,353 INFO [Listener at localhost/46855] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a82b45ce891e495285103ede6e7069e1 2023-02-09 20:56:30,354 INFO [Listener at localhost/46855] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 91ac905c8115b0a77d093240ed551a1f/family2 of 91ac905c8115b0a77d093240ed551a1f into a82b45ce891e495285103ede6e7069e1(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-09 20:56:30,354 DEBUG [Listener at localhost/46855] regionserver.HRegion(2288): Compaction status journal for 91ac905c8115b0a77d093240ed551a1f: 2023-02-09 20:56:30,354 DEBUG [Listener at localhost/46855] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-09 20:56:30,354 DEBUG [Listener at localhost/46855] regionserver.HStore(1912): 1588791fd318439c4a112711b2289bfa/family1 is initiating major compaction (all files) 2023-02-09 20:56:30,354 INFO [Listener at localhost/46855] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-09 20:56:30,354 INFO [Listener at localhost/46855] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 20:56:30,355 INFO [Listener at localhost/46855] regionserver.HRegion(2258): Starting compaction of 1588791fd318439c4a112711b2289bfa/family1 in testMajorCompactionFromAdmin,1,1675976177410.1588791fd318439c4a112711b2289bfa. 2023-02-09 20:56:30,355 INFO [Listener at localhost/46855] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/1588791fd318439c4a112711b2289bfa/family1/ee5a58f02d0e403990136ed3833af5de, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/1588791fd318439c4a112711b2289bfa/family1/5454f59ade3d44ac8d154edbf8eb80f8, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/1588791fd318439c4a112711b2289bfa/family1/638434f7bee34fefb7efc82d5a0756f2, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/1588791fd318439c4a112711b2289bfa/family1/fa46ce8abdee4322826e252b6ed9eb33, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/1588791fd318439c4a112711b2289bfa/family1/993477876a9f4ef29cd3ce066397dc23] into tmpdir=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/1588791fd318439c4a112711b2289bfa/.tmp, totalSize=27.1 K 2023-02-09 20:56:30,356 DEBUG [Listener at localhost/46855] compactions.Compactor(207): Compacting ee5a58f02d0e403990136ed3833af5de, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1675976178554 2023-02-09 20:56:30,356 DEBUG [Listener at localhost/46855] compactions.Compactor(207): Compacting 5454f59ade3d44ac8d154edbf8eb80f8, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1675976179631 2023-02-09 20:56:30,356 DEBUG [Listener at localhost/46855] compactions.Compactor(207): Compacting 638434f7bee34fefb7efc82d5a0756f2, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1675976181489 2023-02-09 20:56:30,356 DEBUG [Listener at localhost/46855] compactions.Compactor(207): Compacting fa46ce8abdee4322826e252b6ed9eb33, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1675976182987 2023-02-09 20:56:30,357 DEBUG [Listener at localhost/46855] compactions.Compactor(207): Compacting 993477876a9f4ef29cd3ce066397dc23, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-09 20:56:30,363 INFO [Listener at localhost/46855] throttle.PressureAwareThroughputController(145): 1588791fd318439c4a112711b2289bfa#family1#compaction#201 average throughput is 0.86 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-09 20:56:30,374 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/91ac905c8115b0a77d093240ed551a1f/family2/9984a5c8b0da4b99ba1ea91616cbc0bb, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/91ac905c8115b0a77d093240ed551a1f/family2/285c8bdf292e42a6bcdcf6c22ec8e90e, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/91ac905c8115b0a77d093240ed551a1f/family2/519a22be5f95438e8f0c41d289a16f46, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/91ac905c8115b0a77d093240ed551a1f/family2/a7466ab7c68848bba4d9d4a14867f0ce, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/91ac905c8115b0a77d093240ed551a1f/family2/49ddb9cc2897423f90e3a6f3d07a3e41] to archive 2023-02-09 20:56:30,375 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 20:56:30,377 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/91ac905c8115b0a77d093240ed551a1f/family2/9984a5c8b0da4b99ba1ea91616cbc0bb to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMajorCompactionFromAdmin/91ac905c8115b0a77d093240ed551a1f/family2/9984a5c8b0da4b99ba1ea91616cbc0bb 2023-02-09 20:56:30,378 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/91ac905c8115b0a77d093240ed551a1f/family2/285c8bdf292e42a6bcdcf6c22ec8e90e to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMajorCompactionFromAdmin/91ac905c8115b0a77d093240ed551a1f/family2/285c8bdf292e42a6bcdcf6c22ec8e90e 2023-02-09 20:56:30,379 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/91ac905c8115b0a77d093240ed551a1f/family2/519a22be5f95438e8f0c41d289a16f46 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMajorCompactionFromAdmin/91ac905c8115b0a77d093240ed551a1f/family2/519a22be5f95438e8f0c41d289a16f46 2023-02-09 20:56:30,380 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/91ac905c8115b0a77d093240ed551a1f/family2/a7466ab7c68848bba4d9d4a14867f0ce to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMajorCompactionFromAdmin/91ac905c8115b0a77d093240ed551a1f/family2/a7466ab7c68848bba4d9d4a14867f0ce 2023-02-09 20:56:30,381 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/91ac905c8115b0a77d093240ed551a1f/family2/49ddb9cc2897423f90e3a6f3d07a3e41 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMajorCompactionFromAdmin/91ac905c8115b0a77d093240ed551a1f/family2/49ddb9cc2897423f90e3a6f3d07a3e41 2023-02-09 20:56:30,809 INFO [Listener at localhost/46855] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b202302091ecf3e9ce0df40e38a1f396731825a40_del 2023-02-09 20:56:30,809 INFO [Listener at localhost/46855] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202302091ecf3e9ce0df40e38a1f396731825a40_del to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202302091ecf3e9ce0df40e38a1f396731825a40_del 2023-02-09 20:56:31,673 INFO [Listener at localhost/46855] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 82a79afad8924acbba1c8b8df56246a7 2023-02-09 20:56:31,674 DEBUG [Listener at localhost/46855] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/1588791fd318439c4a112711b2289bfa/.tmp/family1/82a79afad8924acbba1c8b8df56246a7 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/1588791fd318439c4a112711b2289bfa/family1/82a79afad8924acbba1c8b8df56246a7 2023-02-09 20:56:31,698 INFO [Listener at localhost/46855] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 82a79afad8924acbba1c8b8df56246a7 2023-02-09 20:56:31,699 INFO [Listener at localhost/46855] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 1588791fd318439c4a112711b2289bfa/family1 of 1588791fd318439c4a112711b2289bfa into 82a79afad8924acbba1c8b8df56246a7(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-09 20:56:31,699 DEBUG [Listener at localhost/46855] regionserver.HRegion(2288): Compaction status journal for 1588791fd318439c4a112711b2289bfa: 2023-02-09 20:56:31,699 DEBUG [Listener at localhost/46855] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-09 20:56:31,699 DEBUG [Listener at localhost/46855] regionserver.HStore(1912): 1588791fd318439c4a112711b2289bfa/family2 is initiating major compaction (all files) 2023-02-09 20:56:31,699 INFO [Listener at localhost/46855] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-09 20:56:31,699 INFO [Listener at localhost/46855] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-09 20:56:31,699 INFO [Listener at localhost/46855] regionserver.HRegion(2258): Starting compaction of 1588791fd318439c4a112711b2289bfa/family2 in testMajorCompactionFromAdmin,1,1675976177410.1588791fd318439c4a112711b2289bfa. 2023-02-09 20:56:31,699 INFO [Listener at localhost/46855] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/1588791fd318439c4a112711b2289bfa/family2/b841fff0eeb242878e210c292593ae65, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/1588791fd318439c4a112711b2289bfa/family2/9923670d0c6942c7899a4627dcf82e2e, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/1588791fd318439c4a112711b2289bfa/family2/47986ab530c54d80a07d1dcd868b4cc2, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/1588791fd318439c4a112711b2289bfa/family2/dc51153b0778405fadafc2aa5570ffb8, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/1588791fd318439c4a112711b2289bfa/family2/bbc7e1c86dce4b728183f84c52d58aa9] into tmpdir=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/1588791fd318439c4a112711b2289bfa/.tmp, totalSize=25.4 K 2023-02-09 20:56:31,700 DEBUG [Listener at localhost/46855] compactions.Compactor(207): Compacting b841fff0eeb242878e210c292593ae65, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1675976178554 2023-02-09 20:56:31,700 DEBUG [Listener at localhost/46855] compactions.Compactor(207): Compacting 9923670d0c6942c7899a4627dcf82e2e, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1675976179631 2023-02-09 20:56:31,700 DEBUG [Listener at localhost/46855] compactions.Compactor(207): Compacting 47986ab530c54d80a07d1dcd868b4cc2, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1675976181489 2023-02-09 20:56:31,701 DEBUG [Listener at localhost/46855] compactions.Compactor(207): Compacting dc51153b0778405fadafc2aa5570ffb8, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1675976182987 2023-02-09 20:56:31,701 DEBUG [Listener at localhost/46855] compactions.Compactor(207): Compacting bbc7e1c86dce4b728183f84c52d58aa9, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-09 20:56:31,708 INFO [Listener at localhost/46855] throttle.PressureAwareThroughputController(145): 1588791fd318439c4a112711b2289bfa#family2#compaction#202 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-09 20:56:31,774 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/1588791fd318439c4a112711b2289bfa/family1/ee5a58f02d0e403990136ed3833af5de, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/1588791fd318439c4a112711b2289bfa/family1/5454f59ade3d44ac8d154edbf8eb80f8, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/1588791fd318439c4a112711b2289bfa/family1/638434f7bee34fefb7efc82d5a0756f2, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/1588791fd318439c4a112711b2289bfa/family1/fa46ce8abdee4322826e252b6ed9eb33, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/1588791fd318439c4a112711b2289bfa/family1/993477876a9f4ef29cd3ce066397dc23] to archive 2023-02-09 20:56:31,774 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 20:56:31,776 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/1588791fd318439c4a112711b2289bfa/family1/ee5a58f02d0e403990136ed3833af5de to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMajorCompactionFromAdmin/1588791fd318439c4a112711b2289bfa/family1/ee5a58f02d0e403990136ed3833af5de 2023-02-09 20:56:31,777 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/1588791fd318439c4a112711b2289bfa/family1/5454f59ade3d44ac8d154edbf8eb80f8 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMajorCompactionFromAdmin/1588791fd318439c4a112711b2289bfa/family1/5454f59ade3d44ac8d154edbf8eb80f8 2023-02-09 20:56:31,778 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/1588791fd318439c4a112711b2289bfa/family1/638434f7bee34fefb7efc82d5a0756f2 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMajorCompactionFromAdmin/1588791fd318439c4a112711b2289bfa/family1/638434f7bee34fefb7efc82d5a0756f2 2023-02-09 20:56:31,779 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/1588791fd318439c4a112711b2289bfa/family1/fa46ce8abdee4322826e252b6ed9eb33 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMajorCompactionFromAdmin/1588791fd318439c4a112711b2289bfa/family1/fa46ce8abdee4322826e252b6ed9eb33 2023-02-09 20:56:31,779 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/1588791fd318439c4a112711b2289bfa/family1/993477876a9f4ef29cd3ce066397dc23 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMajorCompactionFromAdmin/1588791fd318439c4a112711b2289bfa/family1/993477876a9f4ef29cd3ce066397dc23 2023-02-09 20:56:32,115 INFO [Listener at localhost/46855] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20230209df3318d9414049448419de2db9dfe0be_del 2023-02-09 20:56:32,115 INFO [Listener at localhost/46855] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230209df3318d9414049448419de2db9dfe0be_del to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b20230209df3318d9414049448419de2db9dfe0be_del 2023-02-09 20:56:32,927 INFO [Listener at localhost/46855] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4b37c47507404a81975fcee57acdb731 2023-02-09 20:56:32,928 DEBUG [Listener at localhost/46855] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/1588791fd318439c4a112711b2289bfa/.tmp/family2/4b37c47507404a81975fcee57acdb731 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/1588791fd318439c4a112711b2289bfa/family2/4b37c47507404a81975fcee57acdb731 2023-02-09 20:56:32,931 INFO [Listener at localhost/46855] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4b37c47507404a81975fcee57acdb731 2023-02-09 20:56:32,932 INFO [Listener at localhost/46855] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 1588791fd318439c4a112711b2289bfa/family2 of 1588791fd318439c4a112711b2289bfa into 4b37c47507404a81975fcee57acdb731(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-09 20:56:32,932 DEBUG [Listener at localhost/46855] regionserver.HRegion(2288): Compaction status journal for 1588791fd318439c4a112711b2289bfa: 2023-02-09 20:56:32,935 DEBUG [Listener at localhost/46855] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-09 20:56:32,938 DEBUG [Listener at localhost/46855] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-09 20:56:32,941 DEBUG [Listener at localhost/46855] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-09 20:56:32,941 DEBUG [Listener at localhost/46855] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-09 20:56:32,946 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=42951] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\x1E!_\x81\xD9!\x13\x11p\x0E\xDB\xCB\xCE\xF6\xFC\xDC"\x10\xC3\x14\x8CP\xC6AI\xD8\xC5\xDB1\xBC\xD3\xC3\x13\xBD*\x10\xF6\x16\x7F\x7F\xF2\xBB\xCA\xD4!p\x1B1\xC1\xAA\xDC)2\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testMajorCompactionFromAdmin 2023-02-09 20:56:32,967 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1675976025848] procedure2.ProcedureExecutor(1029): Stored pid=123, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-02-09 20:56:32,968 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=123, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-02-09 20:56:32,969 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1675976025848] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionFromAdmin', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-09 20:56:32,969 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=123, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1675976792969 2023-02-09 20:56:32,969 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1675976025848] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-09 20:56:32,978 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/1588791fd318439c4a112711b2289bfa/family2/b841fff0eeb242878e210c292593ae65, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/1588791fd318439c4a112711b2289bfa/family2/9923670d0c6942c7899a4627dcf82e2e, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/1588791fd318439c4a112711b2289bfa/family2/47986ab530c54d80a07d1dcd868b4cc2, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/1588791fd318439c4a112711b2289bfa/family2/dc51153b0778405fadafc2aa5570ffb8, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/1588791fd318439c4a112711b2289bfa/family2/bbc7e1c86dce4b728183f84c52d58aa9] to archive 2023-02-09 20:56:32,979 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 20:56:32,980 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/1588791fd318439c4a112711b2289bfa/family2/b841fff0eeb242878e210c292593ae65 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMajorCompactionFromAdmin/1588791fd318439c4a112711b2289bfa/family2/b841fff0eeb242878e210c292593ae65 2023-02-09 20:56:32,981 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/1588791fd318439c4a112711b2289bfa/family2/9923670d0c6942c7899a4627dcf82e2e to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMajorCompactionFromAdmin/1588791fd318439c4a112711b2289bfa/family2/9923670d0c6942c7899a4627dcf82e2e 2023-02-09 20:56:32,982 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/1588791fd318439c4a112711b2289bfa/family2/47986ab530c54d80a07d1dcd868b4cc2 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMajorCompactionFromAdmin/1588791fd318439c4a112711b2289bfa/family2/47986ab530c54d80a07d1dcd868b4cc2 2023-02-09 20:56:32,982 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/1588791fd318439c4a112711b2289bfa/family2/dc51153b0778405fadafc2aa5570ffb8 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMajorCompactionFromAdmin/1588791fd318439c4a112711b2289bfa/family2/dc51153b0778405fadafc2aa5570ffb8 2023-02-09 20:56:32,984 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/1588791fd318439c4a112711b2289bfa/family2/bbc7e1c86dce4b728183f84c52d58aa9 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMajorCompactionFromAdmin/1588791fd318439c4a112711b2289bfa/family2/bbc7e1c86dce4b728183f84c52d58aa9 2023-02-09 20:56:33,301 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1675976025848] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 3 del files, 12 selected files, and 0 irrelevant files table 'testMajorCompactionFromAdmin' and column 'family1' 2023-02-09 20:56:33,326 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1675976025848] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e202302098b4f9b4563d242aa90305e3f71e52301_del 2023-02-09 20:56:33,347 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1675976025848] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b202302091ecf3e9ce0df40e38a1f396731825a40_del 2023-02-09 20:56:33,367 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1675976025848] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20230209bd72bd48f89549b5addec99da2814c7b_del 2023-02-09 20:56:33,367 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1675976025848] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='testMajorCompactionFromAdmin' column='family1' 2023-02-09 20:56:33,368 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1675976025848] zookeeper.ReadOnlyZKClient(139): Connect 0x5cd549c6 to 127.0.0.1:62089 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-09 20:56:33,372 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1675976025848] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@33ca6534, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-09 20:56:33,373 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20230209 for table='testMajorCompactionFromAdmin' and column='family1' 2023-02-09 20:56:34,331 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302097753aa3185e44ca7b556666e0adecbff to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202302097753aa3185e44ca7b556666e0adecbff 2023-02-09 20:56:34,332 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230209 table='testMajorCompactionFromAdmin' column='family1' 2023-02-09 20:56:34,348 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-09 20:56:34,351 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:52140, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-09 20:56:34,360 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-09 20:56:34,361 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:42926, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-09 20:56:34,401 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20230209/family1/47cb91f46a814dffbd573a08d9120bb0 first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x07] 2023-02-09 20:56:34,402 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionFromAdmin,2,1675976177410.02305257e8e6e518ce321ba9e1c2a48f., hostname=jenkins-hbase9.apache.org,40919,1675976022294, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20230209/family1/47cb91f46a814dffbd573a08d9120bb0}] 2023-02-09 20:56:34,408 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40919] regionserver.HStore(763): Validating hfile at hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20230209/family1/47cb91f46a814dffbd573a08d9120bb0 for inclusion in 02305257e8e6e518ce321ba9e1c2a48f/family1 2023-02-09 20:56:34,441 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40919] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x07 2023-02-09 20:56:34,441 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40919] regionserver.HStore(777): Region bounds: first=2 last= 2023-02-09 20:56:34,441 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40919] regionserver.HRegion(2445): Flush status journal for 02305257e8e6e518ce321ba9e1c2a48f: 2023-02-09 20:56:34,442 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40919] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20230209/family1/47cb91f46a814dffbd573a08d9120bb0 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/staging/jenkins__testMajorCompactionFromAdmin__4dn61flefbeahui06913jrjv39nuuvdps82asfq2akenoule3qhqvbdnrc9u1cjt/family1/47cb91f46a814dffbd573a08d9120bb0 2023-02-09 20:56:34,444 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40919] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/staging/jenkins__testMajorCompactionFromAdmin__4dn61flefbeahui06913jrjv39nuuvdps82asfq2akenoule3qhqvbdnrc9u1cjt/family1/47cb91f46a814dffbd573a08d9120bb0 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/02305257e8e6e518ce321ba9e1c2a48f/family1/11c199697a0241c5ab8097575a4078db_SeqId_28_ 2023-02-09 20:56:34,445 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40919] regionserver.HStore(849): Loaded HFile hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/staging/jenkins__testMajorCompactionFromAdmin__4dn61flefbeahui06913jrjv39nuuvdps82asfq2akenoule3qhqvbdnrc9u1cjt/family1/47cb91f46a814dffbd573a08d9120bb0 into 02305257e8e6e518ce321ba9e1c2a48f/family1 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/02305257e8e6e518ce321ba9e1c2a48f/family1/11c199697a0241c5ab8097575a4078db_SeqId_28_ - updating store file list. 2023-02-09 20:56:34,467 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40919] regionserver.HStore(882): Loaded HFile hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/02305257e8e6e518ce321ba9e1c2a48f/family1/11c199697a0241c5ab8097575a4078db_SeqId_28_ into 02305257e8e6e518ce321ba9e1c2a48f/family1 2023-02-09 20:56:34,467 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40919] regionserver.HStore(855): Successfully loaded hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/staging/jenkins__testMajorCompactionFromAdmin__4dn61flefbeahui06913jrjv39nuuvdps82asfq2akenoule3qhqvbdnrc9u1cjt/family1/47cb91f46a814dffbd573a08d9120bb0 into 02305257e8e6e518ce321ba9e1c2a48f/family1 (new location: hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/02305257e8e6e518ce321ba9e1c2a48f/family1/11c199697a0241c5ab8097575a4078db_SeqId_28_) 2023-02-09 20:56:34,467 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40919] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/staging/jenkins__testMajorCompactionFromAdmin__4dn61flefbeahui06913jrjv39nuuvdps82asfq2akenoule3qhqvbdnrc9u1cjt/family1/47cb91f46a814dffbd573a08d9120bb0 2023-02-09 20:56:34,469 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230209 table='testMajorCompactionFromAdmin' column='family1' 2023-02-09 20:56:34,470 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 20:56:34,472 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023020903d92b24e4b34c9c93c1963fa743fbb7 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023020903d92b24e4b34c9c93c1963fa743fbb7 2023-02-09 20:56:34,473 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023020939641e29b9974ae6a75451be74dbad6d to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023020939641e29b9974ae6a75451be74dbad6d 2023-02-09 20:56:34,474 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023020973fbc2d6ff40430b9ed31270f2d37bf3 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023020973fbc2d6ff40430b9ed31270f2d37bf3 2023-02-09 20:56:34,475 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202302099bc0f1359fe443cbb05bf55ac61fd64d to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202302099bc0f1359fe443cbb05bf55ac61fd64d 2023-02-09 20:56:34,475 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-02-09 20:56:34,475 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20230209' 2023-02-09 20:56:34,475 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20230209 for table='testMajorCompactionFromAdmin' and column='family1' 2023-02-09 20:56:34,475 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20230209 for table='testMajorCompactionFromAdmin' and column='family1' 2023-02-09 20:56:34,805 DEBUG [regionserver/jenkins-hbase9:0.Chore.2] throttle.PressureAwareCompactionThroughputController(103): CompactionPressure is 0.0, tune throughput to 50.00 MB/second 2023-02-09 20:56:35,422 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023020966946dc7bd7242489a8026145729605d to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023020966946dc7bd7242489a8026145729605d 2023-02-09 20:56:35,423 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230209 table='testMajorCompactionFromAdmin' column='family1' 2023-02-09 20:56:35,463 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20230209/family1/0f804f5daeda4742a9bd38cc05b95efd first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x07] 2023-02-09 20:56:35,464 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionFromAdmin,,1675976177410.91ac905c8115b0a77d093240ed551a1f., hostname=jenkins-hbase9.apache.org,40919,1675976022294, seqNum=2 for row with hfile group [{family1,hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20230209/family1/0f804f5daeda4742a9bd38cc05b95efd}] 2023-02-09 20:56:35,466 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40919] regionserver.HStore(763): Validating hfile at hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20230209/family1/0f804f5daeda4742a9bd38cc05b95efd for inclusion in 91ac905c8115b0a77d093240ed551a1f/family1 2023-02-09 20:56:35,486 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40919] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x07 2023-02-09 20:56:35,486 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40919] regionserver.HStore(777): Region bounds: first= last=1 2023-02-09 20:56:35,486 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40919] regionserver.HRegion(2445): Flush status journal for 91ac905c8115b0a77d093240ed551a1f: 2023-02-09 20:56:35,487 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40919] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20230209/family1/0f804f5daeda4742a9bd38cc05b95efd to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/staging/jenkins__testMajorCompactionFromAdmin__fsodrtf1dluisr44q75m5kcvnrpibqojvdasf4vtlug83257ib84ltb89l1nk0qg/family1/0f804f5daeda4742a9bd38cc05b95efd 2023-02-09 20:56:35,488 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40919] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/staging/jenkins__testMajorCompactionFromAdmin__fsodrtf1dluisr44q75m5kcvnrpibqojvdasf4vtlug83257ib84ltb89l1nk0qg/family1/0f804f5daeda4742a9bd38cc05b95efd as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/91ac905c8115b0a77d093240ed551a1f/family1/b7e915e8333e442ba9477082f0a6a2f1_SeqId_28_ 2023-02-09 20:56:35,489 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40919] regionserver.HStore(849): Loaded HFile hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/staging/jenkins__testMajorCompactionFromAdmin__fsodrtf1dluisr44q75m5kcvnrpibqojvdasf4vtlug83257ib84ltb89l1nk0qg/family1/0f804f5daeda4742a9bd38cc05b95efd into 91ac905c8115b0a77d093240ed551a1f/family1 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/91ac905c8115b0a77d093240ed551a1f/family1/b7e915e8333e442ba9477082f0a6a2f1_SeqId_28_ - updating store file list. 2023-02-09 20:56:35,511 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40919] regionserver.HStore(882): Loaded HFile hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/91ac905c8115b0a77d093240ed551a1f/family1/b7e915e8333e442ba9477082f0a6a2f1_SeqId_28_ into 91ac905c8115b0a77d093240ed551a1f/family1 2023-02-09 20:56:35,511 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40919] regionserver.HStore(855): Successfully loaded hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/staging/jenkins__testMajorCompactionFromAdmin__fsodrtf1dluisr44q75m5kcvnrpibqojvdasf4vtlug83257ib84ltb89l1nk0qg/family1/0f804f5daeda4742a9bd38cc05b95efd into 91ac905c8115b0a77d093240ed551a1f/family1 (new location: hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/91ac905c8115b0a77d093240ed551a1f/family1/b7e915e8333e442ba9477082f0a6a2f1_SeqId_28_) 2023-02-09 20:56:35,511 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40919] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/staging/jenkins__testMajorCompactionFromAdmin__fsodrtf1dluisr44q75m5kcvnrpibqojvdasf4vtlug83257ib84ltb89l1nk0qg/family1/0f804f5daeda4742a9bd38cc05b95efd 2023-02-09 20:56:35,513 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230209 table='testMajorCompactionFromAdmin' column='family1' 2023-02-09 20:56:35,514 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 20:56:35,515 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023020917c86d265ae0456daa7180605603b1aa to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023020917c86d265ae0456daa7180605603b1aa 2023-02-09 20:56:35,516 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230209898efe405f75479692776f5bccecb08f to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230209898efe405f75479692776f5bccecb08f 2023-02-09 20:56:35,517 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202302098a3e53a45ca04234a5f14e827cd94172 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202302098a3e53a45ca04234a5f14e827cd94172 2023-02-09 20:56:35,518 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202302098d9edadf96d24c25a6463d4f684dc11d to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202302098d9edadf96d24c25a6463d4f684dc11d 2023-02-09 20:56:35,518 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-02-09 20:56:35,518 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20230209' 2023-02-09 20:56:35,518 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20230209 for table='testMajorCompactionFromAdmin' and column='family1' 2023-02-09 20:56:35,518 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20230209 for table='testMajorCompactionFromAdmin' and column='family1' 2023-02-09 20:56:36,045 DEBUG [regionserver/jenkins-hbase9:0.Chore.2] throttle.PressureAwareCompactionThroughputController(103): CompactionPressure is 0.0, tune throughput to 50.00 MB/second 2023-02-09 20:56:36,067 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230209a45ff0aa641f44c8952a4962c8e8670e to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230209a45ff0aa641f44c8952a4962c8e8670e 2023-02-09 20:56:36,068 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230209 table='testMajorCompactionFromAdmin' column='family1' 2023-02-09 20:56:36,109 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20230209/family1/76eb4c5ee27a49f8b05ed5770a55b1d0 first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x07] 2023-02-09 20:56:36,110 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionFromAdmin,1,1675976177410.1588791fd318439c4a112711b2289bfa., hostname=jenkins-hbase9.apache.org,40919,1675976022294, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20230209/family1/76eb4c5ee27a49f8b05ed5770a55b1d0}] 2023-02-09 20:56:36,111 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40919] regionserver.HStore(763): Validating hfile at hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20230209/family1/76eb4c5ee27a49f8b05ed5770a55b1d0 for inclusion in 1588791fd318439c4a112711b2289bfa/family1 2023-02-09 20:56:36,132 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40919] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x07 2023-02-09 20:56:36,132 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40919] regionserver.HStore(777): Region bounds: first=1 last=2 2023-02-09 20:56:36,132 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40919] regionserver.HRegion(2445): Flush status journal for 1588791fd318439c4a112711b2289bfa: 2023-02-09 20:56:36,133 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40919] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20230209/family1/76eb4c5ee27a49f8b05ed5770a55b1d0 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/staging/jenkins__testMajorCompactionFromAdmin__ap1atq3tvjank832to9aibdk08q4dp8ah72bovrul480akf9qnpl1pboev6kf45/family1/76eb4c5ee27a49f8b05ed5770a55b1d0 2023-02-09 20:56:36,134 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40919] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/staging/jenkins__testMajorCompactionFromAdmin__ap1atq3tvjank832to9aibdk08q4dp8ah72bovrul480akf9qnpl1pboev6kf45/family1/76eb4c5ee27a49f8b05ed5770a55b1d0 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/1588791fd318439c4a112711b2289bfa/family1/e135a2daf1214910859a35a8be856e8e_SeqId_28_ 2023-02-09 20:56:36,134 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40919] regionserver.HStore(849): Loaded HFile hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/staging/jenkins__testMajorCompactionFromAdmin__ap1atq3tvjank832to9aibdk08q4dp8ah72bovrul480akf9qnpl1pboev6kf45/family1/76eb4c5ee27a49f8b05ed5770a55b1d0 into 1588791fd318439c4a112711b2289bfa/family1 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/1588791fd318439c4a112711b2289bfa/family1/e135a2daf1214910859a35a8be856e8e_SeqId_28_ - updating store file list. 2023-02-09 20:56:36,156 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40919] regionserver.HStore(882): Loaded HFile hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/1588791fd318439c4a112711b2289bfa/family1/e135a2daf1214910859a35a8be856e8e_SeqId_28_ into 1588791fd318439c4a112711b2289bfa/family1 2023-02-09 20:56:36,156 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40919] regionserver.HStore(855): Successfully loaded hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/staging/jenkins__testMajorCompactionFromAdmin__ap1atq3tvjank832to9aibdk08q4dp8ah72bovrul480akf9qnpl1pboev6kf45/family1/76eb4c5ee27a49f8b05ed5770a55b1d0 into 1588791fd318439c4a112711b2289bfa/family1 (new location: hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/1588791fd318439c4a112711b2289bfa/family1/e135a2daf1214910859a35a8be856e8e_SeqId_28_) 2023-02-09 20:56:36,156 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40919] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/staging/jenkins__testMajorCompactionFromAdmin__ap1atq3tvjank832to9aibdk08q4dp8ah72bovrul480akf9qnpl1pboev6kf45/family1/76eb4c5ee27a49f8b05ed5770a55b1d0 2023-02-09 20:56:36,158 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230209 table='testMajorCompactionFromAdmin' column='family1' 2023-02-09 20:56:36,158 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 20:56:36,160 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202302091f5d81b311fa4e43b6b37ca81295d378 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202302091f5d81b311fa4e43b6b37ca81295d378 2023-02-09 20:56:36,160 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202302094cff344d524940f7ab6cf76ba2a03270 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202302094cff344d524940f7ab6cf76ba2a03270 2023-02-09 20:56:36,161 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230209515fdb1226c947de9f87a24e0fb4d393 to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230209515fdb1226c947de9f87a24e0fb4d393 2023-02-09 20:56:36,162 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023020977f921b2dfa44efc9690555eb28c5d9a to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023020977f921b2dfa44efc9690555eb28c5d9a 2023-02-09 20:56:36,162 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-02-09 20:56:36,162 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20230209' 2023-02-09 20:56:36,162 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20230209 for table='testMajorCompactionFromAdmin' and column='family1' 2023-02-09 20:56:36,162 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1675976025848] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testMajorCompactionFromAdmin' column='family1' 2023-02-09 20:56:36,162 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1675976025848] compactions.PartitionedMobCompactor(364): After a mob compaction with all files selected, archiving the del files for table='testMajorCompactionFromAdmin' and column='family1' 2023-02-09 20:56:36,162 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1675976025848] compactions.PartitionedMobCompactor(367): [hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202302098b4f9b4563d242aa90305e3f71e52301_del] 2023-02-09 20:56:36,163 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1675976025848] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 20:56:36,164 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1675976025848] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202302098b4f9b4563d242aa90305e3f71e52301_del to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202302098b4f9b4563d242aa90305e3f71e52301_del 2023-02-09 20:56:36,164 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1675976025848] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-02-09 20:56:36,164 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1675976025848] compactions.PartitionedMobCompactor(367): [hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202302091ecf3e9ce0df40e38a1f396731825a40_del] 2023-02-09 20:56:36,164 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1675976025848] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 20:56:36,165 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1675976025848] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202302091ecf3e9ce0df40e38a1f396731825a40_del to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202302091ecf3e9ce0df40e38a1f396731825a40_del 2023-02-09 20:56:36,165 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1675976025848] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-02-09 20:56:36,166 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1675976025848] compactions.PartitionedMobCompactor(367): [hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230209bd72bd48f89549b5addec99da2814c7b_del] 2023-02-09 20:56:36,166 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1675976025848] backup.HFileArchiver(360): Archiving compacted files. 2023-02-09 20:56:36,167 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1675976025848] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230209bd72bd48f89549b5addec99da2814c7b_del to hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230209bd72bd48f89549b5addec99da2814c7b_del 2023-02-09 20:56:36,167 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1675976025848] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-02-09 20:56:36,167 INFO [master/jenkins-hbase9:0:becomeActiveMaster-MasterMobCompaction-1675976025848] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionFromAdmin', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-09 20:56:36,168 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=123, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-02-09 20:56:36,169 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=123, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE in 3.2010 sec 2023-02-09 20:56:36,188 DEBUG [Listener at localhost/46855] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-09 20:56:36,190 DEBUG [Listener at localhost/46855] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-09 20:56:36,192 DEBUG [Listener at localhost/46855] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-09 20:56:36,193 DEBUG [Listener at localhost/46855] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-09 20:56:36,196 INFO [Listener at localhost/46855] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-09 20:56:36,230 INFO [Listener at localhost/46855] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionFromAdmin Thread=246 (was 254), OpenFileDescriptor=640 (was 639) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=132 (was 134), ProcessCount=168 (was 168), AvailableMemoryMB=10728 (was 10749) 2023-02-09 20:56:36,230 DEBUG [Listener at localhost/46855] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7defec53 to 127.0.0.1:62089 2023-02-09 20:56:36,231 DEBUG [Listener at localhost/46855] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 20:56:36,231 INFO [Listener at localhost/46855] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-09 20:56:36,231 INFO [Listener at localhost/46855] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-09 20:56:36,231 DEBUG [Listener at localhost/46855] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0629018b to 127.0.0.1:62089 2023-02-09 20:56:36,231 DEBUG [Listener at localhost/46855] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 20:56:36,231 DEBUG [Listener at localhost/46855] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-09 20:56:36,231 DEBUG [Listener at localhost/46855] util.JVMClusterUtil(257): Found active master hash=1019338664, stopped=false 2023-02-09 20:56:36,231 INFO [Listener at localhost/46855] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase9.apache.org,42951,1675976021166 2023-02-09 20:56:36,234 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-09 20:56:36,234 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-09 20:56:36,234 INFO [Listener at localhost/46855] procedure2.ProcedureExecutor(629): Stopping 2023-02-09 20:56:36,234 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 20:56:36,234 DEBUG [Listener at localhost/46855] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x03d96e17 to 127.0.0.1:62089 2023-02-09 20:56:36,234 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 20:56:36,234 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-09 20:56:36,234 DEBUG [Listener at localhost/46855] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 20:56:36,234 INFO [Listener at localhost/46855] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase9.apache.org,40919,1675976022294' ***** 2023-02-09 20:56:36,234 INFO [Listener at localhost/46855] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-09 20:56:36,235 INFO [RS:0;jenkins-hbase9:40919] regionserver.HeapMemoryManager(220): Stopping 2023-02-09 20:56:36,235 INFO [RS:0;jenkins-hbase9:40919] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-09 20:56:36,235 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-09 20:56:36,235 INFO [RS:0;jenkins-hbase9:40919] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-09 20:56:36,235 INFO [RS:0;jenkins-hbase9:40919] regionserver.HRegionServer(3304): Received CLOSE for d3a98fcfad73ec6f98096a0e81049c21 2023-02-09 20:56:36,236 INFO [RS:0;jenkins-hbase9:40919] regionserver.HRegionServer(3304): Received CLOSE for c01761bb5658622fd63528c8f312a31c 2023-02-09 20:56:36,236 INFO [RS:0;jenkins-hbase9:40919] regionserver.HRegionServer(3304): Received CLOSE for 8dc66f5ff2c0373922a1a609b1d90cf4 2023-02-09 20:56:36,236 INFO [RS:0;jenkins-hbase9:40919] regionserver.HRegionServer(3304): Received CLOSE for 9dee656d29adb7e6b7d42a643b66b07b 2023-02-09 20:56:36,236 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing d3a98fcfad73ec6f98096a0e81049c21, disabling compactions & flushes 2023-02-09 20:56:36,236 INFO [RS:0;jenkins-hbase9:40919] regionserver.HRegionServer(3304): Received CLOSE for fd99e712d029b1479ee16c3a0c467ce5 2023-02-09 20:56:36,236 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region testCompactionWithHFileLink,1,1675976119971.d3a98fcfad73ec6f98096a0e81049c21. 2023-02-09 20:56:36,236 INFO [RS:0;jenkins-hbase9:40919] regionserver.HRegionServer(3304): Received CLOSE for d516db36738f07b6767e3c994ea08b05 2023-02-09 20:56:36,236 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1675976119971.d3a98fcfad73ec6f98096a0e81049c21. 2023-02-09 20:56:36,236 INFO [RS:0;jenkins-hbase9:40919] regionserver.HRegionServer(3304): Received CLOSE for 8d52c5e30d26c0f1140cf795dd05ef4f 2023-02-09 20:56:36,236 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on testCompactionWithHFileLink,1,1675976119971.d3a98fcfad73ec6f98096a0e81049c21. after waiting 0 ms 2023-02-09 20:56:36,236 INFO [RS:0;jenkins-hbase9:40919] regionserver.HRegionServer(3304): Received CLOSE for 8118d0623b8f6e97dbcdc1af278e0072 2023-02-09 20:56:36,236 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region testCompactionWithHFileLink,1,1675976119971.d3a98fcfad73ec6f98096a0e81049c21. 2023-02-09 20:56:36,237 INFO [RS:0;jenkins-hbase9:40919] regionserver.HRegionServer(3304): Received CLOSE for 02305257e8e6e518ce321ba9e1c2a48f 2023-02-09 20:56:36,237 INFO [RS:0;jenkins-hbase9:40919] regionserver.HRegionServer(3304): Received CLOSE for c77a33661b401b5917147f4c5d4a93f8 2023-02-09 20:56:36,237 INFO [RS:0;jenkins-hbase9:40919] regionserver.HRegionServer(3304): Received CLOSE for 7b664758b0f2a40178d815ef9f2c6c7f 2023-02-09 20:56:36,237 INFO [RS:0;jenkins-hbase9:40919] regionserver.HRegionServer(3304): Received CLOSE for 4b04882a70d4b3887c9c68945ea20cdc 2023-02-09 20:56:36,237 INFO [RS:0;jenkins-hbase9:40919] regionserver.HRegionServer(3304): Received CLOSE for 15bceddc51e736adeea65067f01af28b 2023-02-09 20:56:36,237 INFO [RS:0;jenkins-hbase9:40919] regionserver.HRegionServer(3304): Received CLOSE for 1b246bc14d14521c9a184bb2e9c29b83 2023-02-09 20:56:36,237 INFO [RS:0;jenkins-hbase9:40919] regionserver.HRegionServer(3304): Received CLOSE for 91ac905c8115b0a77d093240ed551a1f 2023-02-09 20:56:36,237 INFO [RS:0;jenkins-hbase9:40919] regionserver.HRegionServer(3304): Received CLOSE for 534ed4e0950fb6e77e8b28dd7e0eebb4 2023-02-09 20:56:36,237 INFO [RS:0;jenkins-hbase9:40919] regionserver.HRegionServer(3304): Received CLOSE for e45b0667ca59a312bd230beb34d49fe9 2023-02-09 20:56:36,237 INFO [RS:0;jenkins-hbase9:40919] regionserver.HRegionServer(3304): Received CLOSE for 2453f3b87d227457629ba8909b526463 2023-02-09 20:56:36,237 INFO [RS:0;jenkins-hbase9:40919] regionserver.HRegionServer(3304): Received CLOSE for a405dceeac89784cda948f90b491cbc9 2023-02-09 20:56:36,237 INFO [RS:0;jenkins-hbase9:40919] regionserver.HRegionServer(3304): Received CLOSE for 1588791fd318439c4a112711b2289bfa 2023-02-09 20:56:36,237 INFO [RS:0;jenkins-hbase9:40919] regionserver.HRegionServer(1145): stopping server jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:36,237 DEBUG [RS:0;jenkins-hbase9:40919] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x01a9cf94 to 127.0.0.1:62089 2023-02-09 20:56:36,237 DEBUG [RS:0;jenkins-hbase9:40919] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 20:56:36,238 INFO [RS:0;jenkins-hbase9:40919] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-09 20:56:36,238 INFO [RS:0;jenkins-hbase9:40919] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-09 20:56:36,238 INFO [RS:0;jenkins-hbase9:40919] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-09 20:56:36,238 INFO [RS:0;jenkins-hbase9:40919] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-09 20:56:36,238 INFO [RS:0;jenkins-hbase9:40919] regionserver.HRegionServer(1475): Waiting on 21 regions to close 2023-02-09 20:56:36,238 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-09 20:56:36,238 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-09 20:56:36,238 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-09 20:56:36,238 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-09 20:56:36,238 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-09 20:56:36,238 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=50.56 KB heapSize=78.23 KB 2023-02-09 20:56:36,239 DEBUG [RS:0;jenkins-hbase9:40919] regionserver.HRegionServer(1505): Waiting on 02305257e8e6e518ce321ba9e1c2a48f, 1588230740, 1588791fd318439c4a112711b2289bfa, 15bceddc51e736adeea65067f01af28b, 1b246bc14d14521c9a184bb2e9c29b83, 2453f3b87d227457629ba8909b526463, 4b04882a70d4b3887c9c68945ea20cdc, 534ed4e0950fb6e77e8b28dd7e0eebb4, 7b664758b0f2a40178d815ef9f2c6c7f, 8118d0623b8f6e97dbcdc1af278e0072, 8d52c5e30d26c0f1140cf795dd05ef4f, 8dc66f5ff2c0373922a1a609b1d90cf4, 91ac905c8115b0a77d093240ed551a1f, 9dee656d29adb7e6b7d42a643b66b07b, a405dceeac89784cda948f90b491cbc9, c01761bb5658622fd63528c8f312a31c, c77a33661b401b5917147f4c5d4a93f8, d3a98fcfad73ec6f98096a0e81049c21, d516db36738f07b6767e3c994ea08b05, e45b0667ca59a312bd230beb34d49fe9, fd99e712d029b1479ee16c3a0c467ce5 2023-02-09 20:56:36,240 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/d3a98fcfad73ec6f98096a0e81049c21/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-02-09 20:56:36,241 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed testCompactionWithHFileLink,1,1675976119971.d3a98fcfad73ec6f98096a0e81049c21. 2023-02-09 20:56:36,241 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for d3a98fcfad73ec6f98096a0e81049c21: Waiting for close lock at 1675976196236Running coprocessor pre-close hooks at 1675976196236Disabling compacts and flushes for region at 1675976196236Disabling writes for close at 1675976196236Writing region close event to WAL at 1675976196238 (+2 ms)Running coprocessor post-close hooks at 1675976196241 (+3 ms)Closed at 1675976196241 2023-02-09 20:56:36,242 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,1,1675976119971.d3a98fcfad73ec6f98096a0e81049c21. 2023-02-09 20:56:36,242 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing c01761bb5658622fd63528c8f312a31c, disabling compactions & flushes 2023-02-09 20:56:36,242 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region ns:testMinorCompaction,,1675976147822.c01761bb5658622fd63528c8f312a31c. 2023-02-09 20:56:36,242 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on ns:testMinorCompaction,,1675976147822.c01761bb5658622fd63528c8f312a31c. 2023-02-09 20:56:36,242 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on ns:testMinorCompaction,,1675976147822.c01761bb5658622fd63528c8f312a31c. after waiting 0 ms 2023-02-09 20:56:36,242 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region ns:testMinorCompaction,,1675976147822.c01761bb5658622fd63528c8f312a31c. 2023-02-09 20:56:36,245 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/c01761bb5658622fd63528c8f312a31c/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-02-09 20:56:36,246 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed ns:testMinorCompaction,,1675976147822.c01761bb5658622fd63528c8f312a31c. 2023-02-09 20:56:36,246 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for c01761bb5658622fd63528c8f312a31c: Waiting for close lock at 1675976196242Running coprocessor pre-close hooks at 1675976196242Disabling compacts and flushes for region at 1675976196242Disabling writes for close at 1675976196242Writing region close event to WAL at 1675976196242Running coprocessor post-close hooks at 1675976196245 (+3 ms)Closed at 1675976196246 (+1 ms) 2023-02-09 20:56:36,246 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,,1675976147822.c01761bb5658622fd63528c8f312a31c. 2023-02-09 20:56:36,246 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing 8dc66f5ff2c0373922a1a609b1d90cf4, disabling compactions & flushes 2023-02-09 20:56:36,246 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1675976026024.8dc66f5ff2c0373922a1a609b1d90cf4. 2023-02-09 20:56:36,246 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1675976026024.8dc66f5ff2c0373922a1a609b1d90cf4. 2023-02-09 20:56:36,246 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1675976026024.8dc66f5ff2c0373922a1a609b1d90cf4. after waiting 0 ms 2023-02-09 20:56:36,246 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1675976026024.8dc66f5ff2c0373922a1a609b1d90cf4. 2023-02-09 20:56:36,252 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=48.28 KB at sequenceid=130 (bloomFilter=false), to=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/hbase/meta/1588230740/.tmp/info/018787dd020a4cee8825ecfbbf3bfcda 2023-02-09 20:56:36,253 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/8dc66f5ff2c0373922a1a609b1d90cf4/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=50 2023-02-09 20:56:36,254 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1675976026024.8dc66f5ff2c0373922a1a609b1d90cf4. 2023-02-09 20:56:36,254 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for 8dc66f5ff2c0373922a1a609b1d90cf4: Waiting for close lock at 1675976196246Running coprocessor pre-close hooks at 1675976196246Disabling compacts and flushes for region at 1675976196246Disabling writes for close at 1675976196246Writing region close event to WAL at 1675976196250 (+4 ms)Running coprocessor post-close hooks at 1675976196253 (+3 ms)Closed at 1675976196254 (+1 ms) 2023-02-09 20:56:36,254 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1675976026024.8dc66f5ff2c0373922a1a609b1d90cf4. 2023-02-09 20:56:36,254 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing 9dee656d29adb7e6b7d42a643b66b07b, disabling compactions & flushes 2023-02-09 20:56:36,254 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region testCompactionWithHFileLink,2,1675976119971.9dee656d29adb7e6b7d42a643b66b07b. 2023-02-09 20:56:36,254 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1675976119971.9dee656d29adb7e6b7d42a643b66b07b. 2023-02-09 20:56:36,254 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on testCompactionWithHFileLink,2,1675976119971.9dee656d29adb7e6b7d42a643b66b07b. after waiting 0 ms 2023-02-09 20:56:36,254 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region testCompactionWithHFileLink,2,1675976119971.9dee656d29adb7e6b7d42a643b66b07b. 2023-02-09 20:56:36,255 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 018787dd020a4cee8825ecfbbf3bfcda 2023-02-09 20:56:36,257 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/9dee656d29adb7e6b7d42a643b66b07b/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-02-09 20:56:36,257 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed testCompactionWithHFileLink,2,1675976119971.9dee656d29adb7e6b7d42a643b66b07b. 2023-02-09 20:56:36,258 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for 9dee656d29adb7e6b7d42a643b66b07b: Waiting for close lock at 1675976196254Running coprocessor pre-close hooks at 1675976196254Disabling compacts and flushes for region at 1675976196254Disabling writes for close at 1675976196254Writing region close event to WAL at 1675976196255 (+1 ms)Running coprocessor post-close hooks at 1675976196257 (+2 ms)Closed at 1675976196257 2023-02-09 20:56:36,258 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,2,1675976119971.9dee656d29adb7e6b7d42a643b66b07b. 2023-02-09 20:56:36,258 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing fd99e712d029b1479ee16c3a0c467ce5, disabling compactions & flushes 2023-02-09 20:56:36,258 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region testCompactionWithHFileLink,,1675976119971.fd99e712d029b1479ee16c3a0c467ce5. 2023-02-09 20:56:36,258 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testCompactionWithHFileLink,,1675976119971.fd99e712d029b1479ee16c3a0c467ce5. 2023-02-09 20:56:36,258 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on testCompactionWithHFileLink,,1675976119971.fd99e712d029b1479ee16c3a0c467ce5. after waiting 0 ms 2023-02-09 20:56:36,258 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region testCompactionWithHFileLink,,1675976119971.fd99e712d029b1479ee16c3a0c467ce5. 2023-02-09 20:56:36,262 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testCompactionWithHFileLink/fd99e712d029b1479ee16c3a0c467ce5/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-02-09 20:56:36,263 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed testCompactionWithHFileLink,,1675976119971.fd99e712d029b1479ee16c3a0c467ce5. 2023-02-09 20:56:36,263 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for fd99e712d029b1479ee16c3a0c467ce5: Waiting for close lock at 1675976196258Running coprocessor pre-close hooks at 1675976196258Disabling compacts and flushes for region at 1675976196258Disabling writes for close at 1675976196258Writing region close event to WAL at 1675976196260 (+2 ms)Running coprocessor post-close hooks at 1675976196262 (+2 ms)Closed at 1675976196263 (+1 ms) 2023-02-09 20:56:36,263 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,,1675976119971.fd99e712d029b1479ee16c3a0c467ce5. 2023-02-09 20:56:36,263 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing d516db36738f07b6767e3c994ea08b05, disabling compactions & flushes 2023-02-09 20:56:36,263 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1675976024825.d516db36738f07b6767e3c994ea08b05. 2023-02-09 20:56:36,263 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1675976024825.d516db36738f07b6767e3c994ea08b05. 2023-02-09 20:56:36,263 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1675976024825.d516db36738f07b6767e3c994ea08b05. after waiting 0 ms 2023-02-09 20:56:36,263 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1675976024825.d516db36738f07b6767e3c994ea08b05. 2023-02-09 20:56:36,263 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2744): Flushing d516db36738f07b6767e3c994ea08b05 1/1 column families, dataSize=109 B heapSize=592 B 2023-02-09 20:56:36,273 INFO [regionserver/jenkins-hbase9:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactedHFilesCleaner was stopped 2023-02-09 20:56:36,332 INFO [regionserver/jenkins-hbase9:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-09 20:56:36,439 DEBUG [RS:0;jenkins-hbase9:40919] regionserver.HRegionServer(1505): Waiting on 02305257e8e6e518ce321ba9e1c2a48f, 1588230740, 1588791fd318439c4a112711b2289bfa, 15bceddc51e736adeea65067f01af28b, 1b246bc14d14521c9a184bb2e9c29b83, 2453f3b87d227457629ba8909b526463, 4b04882a70d4b3887c9c68945ea20cdc, 534ed4e0950fb6e77e8b28dd7e0eebb4, 7b664758b0f2a40178d815ef9f2c6c7f, 8118d0623b8f6e97dbcdc1af278e0072, 8d52c5e30d26c0f1140cf795dd05ef4f, 91ac905c8115b0a77d093240ed551a1f, a405dceeac89784cda948f90b491cbc9, c77a33661b401b5917147f4c5d4a93f8, d516db36738f07b6767e3c994ea08b05, e45b0667ca59a312bd230beb34d49fe9 2023-02-09 20:56:36,453 INFO [regionserver/jenkins-hbase9:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-02-09 20:56:36,453 INFO [regionserver/jenkins-hbase9:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-02-09 20:56:36,639 DEBUG [RS:0;jenkins-hbase9:40919] regionserver.HRegionServer(1505): Waiting on 02305257e8e6e518ce321ba9e1c2a48f, 1588230740, 1588791fd318439c4a112711b2289bfa, 15bceddc51e736adeea65067f01af28b, 1b246bc14d14521c9a184bb2e9c29b83, 2453f3b87d227457629ba8909b526463, 4b04882a70d4b3887c9c68945ea20cdc, 534ed4e0950fb6e77e8b28dd7e0eebb4, 7b664758b0f2a40178d815ef9f2c6c7f, 8118d0623b8f6e97dbcdc1af278e0072, 8d52c5e30d26c0f1140cf795dd05ef4f, 91ac905c8115b0a77d093240ed551a1f, a405dceeac89784cda948f90b491cbc9, c77a33661b401b5917147f4c5d4a93f8, d516db36738f07b6767e3c994ea08b05, e45b0667ca59a312bd230beb34d49fe9 2023-02-09 20:56:36,662 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=102 B at sequenceid=130 (bloomFilter=false), to=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/hbase/meta/1588230740/.tmp/rep_barrier/8df2cc262bd3495c9908fd4a3ec3ea4b 2023-02-09 20:56:36,666 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8df2cc262bd3495c9908fd4a3ec3ea4b 2023-02-09 20:56:36,668 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=109 B at sequenceid=7 (bloomFilter=true), to=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/hbase/namespace/d516db36738f07b6767e3c994ea08b05/.tmp/info/38b764abf9da44699b349ea7aff75ed3 2023-02-09 20:56:36,673 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/hbase/namespace/d516db36738f07b6767e3c994ea08b05/.tmp/info/38b764abf9da44699b349ea7aff75ed3 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/hbase/namespace/d516db36738f07b6767e3c994ea08b05/info/38b764abf9da44699b349ea7aff75ed3 2023-02-09 20:56:36,676 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/hbase/namespace/d516db36738f07b6767e3c994ea08b05/info/38b764abf9da44699b349ea7aff75ed3, entries=3, sequenceid=7, filesize=4.8 K 2023-02-09 20:56:36,677 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~109 B/109, heapSize ~576 B/576, currentSize=0 B/0 for d516db36738f07b6767e3c994ea08b05 in 414ms, sequenceid=7, compaction requested=false 2023-02-09 20:56:36,680 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/hbase/namespace/d516db36738f07b6767e3c994ea08b05/recovered.edits/10.seqid, newMaxSeqId=10, maxSeqId=1 2023-02-09 20:56:36,681 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1675976024825.d516db36738f07b6767e3c994ea08b05. 2023-02-09 20:56:36,681 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for d516db36738f07b6767e3c994ea08b05: Waiting for close lock at 1675976196263Running coprocessor pre-close hooks at 1675976196263Disabling compacts and flushes for region at 1675976196263Disabling writes for close at 1675976196263Obtaining lock to block concurrent updates at 1675976196263Preparing flush snapshotting stores in d516db36738f07b6767e3c994ea08b05 at 1675976196263Finished memstore snapshotting hbase:namespace,,1675976024825.d516db36738f07b6767e3c994ea08b05., syncing WAL and waiting on mvcc, flushsize=dataSize=109, getHeapSize=576, getOffHeapSize=0, getCellsCount=3 at 1675976196263Flushing stores of hbase:namespace,,1675976024825.d516db36738f07b6767e3c994ea08b05. at 1675976196264 (+1 ms)Flushing d516db36738f07b6767e3c994ea08b05/info: creating writer at 1675976196264Flushing d516db36738f07b6767e3c994ea08b05/info: appending metadata at 1675976196265 (+1 ms)Flushing d516db36738f07b6767e3c994ea08b05/info: closing flushed file at 1675976196265Flushing d516db36738f07b6767e3c994ea08b05/info: reopening flushed file at 1675976196674 (+409 ms)Finished flush of dataSize ~109 B/109, heapSize ~576 B/576, currentSize=0 B/0 for d516db36738f07b6767e3c994ea08b05 in 414ms, sequenceid=7, compaction requested=false at 1675976196677 (+3 ms)Writing region close event to WAL at 1675976196678 (+1 ms)Running coprocessor post-close hooks at 1675976196681 (+3 ms)Closed at 1675976196681 2023-02-09 20:56:36,681 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1675976024825.d516db36738f07b6767e3c994ea08b05. 2023-02-09 20:56:36,681 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing 8d52c5e30d26c0f1140cf795dd05ef4f, disabling compactions & flushes 2023-02-09 20:56:36,682 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyPolicy,,1675976066938.8d52c5e30d26c0f1140cf795dd05ef4f. 2023-02-09 20:56:36,682 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyPolicy,,1675976066938.8d52c5e30d26c0f1140cf795dd05ef4f. 2023-02-09 20:56:36,682 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyPolicy,,1675976066938.8d52c5e30d26c0f1140cf795dd05ef4f. after waiting 0 ms 2023-02-09 20:56:36,682 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyPolicy,,1675976066938.8d52c5e30d26c0f1140cf795dd05ef4f. 2023-02-09 20:56:36,685 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyPolicy/8d52c5e30d26c0f1140cf795dd05ef4f/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-02-09 20:56:36,686 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyPolicy,,1675976066938.8d52c5e30d26c0f1140cf795dd05ef4f. 2023-02-09 20:56:36,686 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for 8d52c5e30d26c0f1140cf795dd05ef4f: Waiting for close lock at 1675976196681Running coprocessor pre-close hooks at 1675976196681Disabling compacts and flushes for region at 1675976196681Disabling writes for close at 1675976196682 (+1 ms)Writing region close event to WAL at 1675976196682Running coprocessor post-close hooks at 1675976196685 (+3 ms)Closed at 1675976196686 (+1 ms) 2023-02-09 20:56:36,686 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyPolicy,,1675976066938.8d52c5e30d26c0f1140cf795dd05ef4f. 2023-02-09 20:56:36,686 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing 8118d0623b8f6e97dbcdc1af278e0072, disabling compactions & flushes 2023-02-09 20:56:36,686 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region testScannerOnBulkLoadRefHFiles,1,1675976062940.8118d0623b8f6e97dbcdc1af278e0072. 2023-02-09 20:56:36,686 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,1,1675976062940.8118d0623b8f6e97dbcdc1af278e0072. 2023-02-09 20:56:36,686 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on testScannerOnBulkLoadRefHFiles,1,1675976062940.8118d0623b8f6e97dbcdc1af278e0072. after waiting 0 ms 2023-02-09 20:56:36,686 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region testScannerOnBulkLoadRefHFiles,1,1675976062940.8118d0623b8f6e97dbcdc1af278e0072. 2023-02-09 20:56:36,688 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testScannerOnBulkLoadRefHFiles/8118d0623b8f6e97dbcdc1af278e0072/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-09 20:56:36,689 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed testScannerOnBulkLoadRefHFiles,1,1675976062940.8118d0623b8f6e97dbcdc1af278e0072. 2023-02-09 20:56:36,689 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for 8118d0623b8f6e97dbcdc1af278e0072: Waiting for close lock at 1675976196686Running coprocessor pre-close hooks at 1675976196686Disabling compacts and flushes for region at 1675976196686Disabling writes for close at 1675976196686Writing region close event to WAL at 1675976196686Running coprocessor post-close hooks at 1675976196689 (+3 ms)Closed at 1675976196689 2023-02-09 20:56:36,689 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,1,1675976062940.8118d0623b8f6e97dbcdc1af278e0072. 2023-02-09 20:56:36,689 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing 02305257e8e6e518ce321ba9e1c2a48f, disabling compactions & flushes 2023-02-09 20:56:36,689 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionFromAdmin,2,1675976177410.02305257e8e6e518ce321ba9e1c2a48f. 2023-02-09 20:56:36,689 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionFromAdmin,2,1675976177410.02305257e8e6e518ce321ba9e1c2a48f. 2023-02-09 20:56:36,689 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionFromAdmin,2,1675976177410.02305257e8e6e518ce321ba9e1c2a48f. after waiting 0 ms 2023-02-09 20:56:36,689 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionFromAdmin,2,1675976177410.02305257e8e6e518ce321ba9e1c2a48f. 2023-02-09 20:56:36,692 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/02305257e8e6e518ce321ba9e1c2a48f/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-02-09 20:56:36,692 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed testMajorCompactionFromAdmin,2,1675976177410.02305257e8e6e518ce321ba9e1c2a48f. 2023-02-09 20:56:36,692 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for 02305257e8e6e518ce321ba9e1c2a48f: Waiting for close lock at 1675976196689Running coprocessor pre-close hooks at 1675976196689Disabling compacts and flushes for region at 1675976196689Disabling writes for close at 1675976196689Writing region close event to WAL at 1675976196690 (+1 ms)Running coprocessor post-close hooks at 1675976196692 (+2 ms)Closed at 1675976196692 2023-02-09 20:56:36,692 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,2,1675976177410.02305257e8e6e518ce321ba9e1c2a48f. 2023-02-09 20:56:36,693 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing c77a33661b401b5917147f4c5d4a93f8, disabling compactions & flushes 2023-02-09 20:56:36,693 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region testScannerOnBulkLoadRefHFiles,,1675976062940.c77a33661b401b5917147f4c5d4a93f8. 2023-02-09 20:56:36,693 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,,1675976062940.c77a33661b401b5917147f4c5d4a93f8. 2023-02-09 20:56:36,693 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on testScannerOnBulkLoadRefHFiles,,1675976062940.c77a33661b401b5917147f4c5d4a93f8. after waiting 0 ms 2023-02-09 20:56:36,693 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region testScannerOnBulkLoadRefHFiles,,1675976062940.c77a33661b401b5917147f4c5d4a93f8. 2023-02-09 20:56:36,699 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testScannerOnBulkLoadRefHFiles/c77a33661b401b5917147f4c5d4a93f8/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-09 20:56:36,700 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed testScannerOnBulkLoadRefHFiles,,1675976062940.c77a33661b401b5917147f4c5d4a93f8. 2023-02-09 20:56:36,700 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for c77a33661b401b5917147f4c5d4a93f8: Waiting for close lock at 1675976196693Running coprocessor pre-close hooks at 1675976196693Disabling compacts and flushes for region at 1675976196693Disabling writes for close at 1675976196693Writing region close event to WAL at 1675976196695 (+2 ms)Running coprocessor post-close hooks at 1675976196699 (+4 ms)Closed at 1675976196700 (+1 ms) 2023-02-09 20:56:36,700 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,,1675976062940.c77a33661b401b5917147f4c5d4a93f8. 2023-02-09 20:56:36,700 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing 7b664758b0f2a40178d815ef9f2c6c7f, disabling compactions & flushes 2023-02-09 20:56:36,700 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675976096855.7b664758b0f2a40178d815ef9f2c6c7f. 2023-02-09 20:56:36,700 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675976096855.7b664758b0f2a40178d815ef9f2c6c7f. 2023-02-09 20:56:36,700 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675976096855.7b664758b0f2a40178d815ef9f2c6c7f. after waiting 0 ms 2023-02-09 20:56:36,700 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675976096855.7b664758b0f2a40178d815ef9f2c6c7f. 2023-02-09 20:56:36,702 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/7b664758b0f2a40178d815ef9f2c6c7f/recovered.edits/58.seqid, newMaxSeqId=58, maxSeqId=55 2023-02-09 20:56:36,703 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675976096855.7b664758b0f2a40178d815ef9f2c6c7f. 2023-02-09 20:56:36,703 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for 7b664758b0f2a40178d815ef9f2c6c7f: Waiting for close lock at 1675976196700Running coprocessor pre-close hooks at 1675976196700Disabling compacts and flushes for region at 1675976196700Disabling writes for close at 1675976196700Writing region close event to WAL at 1675976196700Running coprocessor post-close hooks at 1675976196702 (+2 ms)Closed at 1675976196703 (+1 ms) 2023-02-09 20:56:36,703 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675976096855.7b664758b0f2a40178d815ef9f2c6c7f. 2023-02-09 20:56:36,703 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing 4b04882a70d4b3887c9c68945ea20cdc, disabling compactions & flushes 2023-02-09 20:56:36,703 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region testMinorCompactionWithMonthlyPolicy,,1675976165454.4b04882a70d4b3887c9c68945ea20cdc. 2023-02-09 20:56:36,703 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMinorCompactionWithMonthlyPolicy,,1675976165454.4b04882a70d4b3887c9c68945ea20cdc. 2023-02-09 20:56:36,703 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on testMinorCompactionWithMonthlyPolicy,,1675976165454.4b04882a70d4b3887c9c68945ea20cdc. after waiting 0 ms 2023-02-09 20:56:36,703 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region testMinorCompactionWithMonthlyPolicy,,1675976165454.4b04882a70d4b3887c9c68945ea20cdc. 2023-02-09 20:56:36,705 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithMonthlyPolicy/4b04882a70d4b3887c9c68945ea20cdc/recovered.edits/52.seqid, newMaxSeqId=52, maxSeqId=1 2023-02-09 20:56:36,706 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed testMinorCompactionWithMonthlyPolicy,,1675976165454.4b04882a70d4b3887c9c68945ea20cdc. 2023-02-09 20:56:36,706 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for 4b04882a70d4b3887c9c68945ea20cdc: Waiting for close lock at 1675976196703Running coprocessor pre-close hooks at 1675976196703Disabling compacts and flushes for region at 1675976196703Disabling writes for close at 1675976196703Writing region close event to WAL at 1675976196703Running coprocessor post-close hooks at 1675976196706 (+3 ms)Closed at 1675976196706 2023-02-09 20:56:36,706 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed testMinorCompactionWithMonthlyPolicy,,1675976165454.4b04882a70d4b3887c9c68945ea20cdc. 2023-02-09 20:56:36,706 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing 15bceddc51e736adeea65067f01af28b, disabling compactions & flushes 2023-02-09 20:56:36,706 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region ns:testMinorCompaction,2,1675976147822.15bceddc51e736adeea65067f01af28b. 2023-02-09 20:56:36,706 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on ns:testMinorCompaction,2,1675976147822.15bceddc51e736adeea65067f01af28b. 2023-02-09 20:56:36,706 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on ns:testMinorCompaction,2,1675976147822.15bceddc51e736adeea65067f01af28b. after waiting 0 ms 2023-02-09 20:56:36,706 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region ns:testMinorCompaction,2,1675976147822.15bceddc51e736adeea65067f01af28b. 2023-02-09 20:56:36,709 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/15bceddc51e736adeea65067f01af28b/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-02-09 20:56:36,711 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed ns:testMinorCompaction,2,1675976147822.15bceddc51e736adeea65067f01af28b. 2023-02-09 20:56:36,711 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for 15bceddc51e736adeea65067f01af28b: Waiting for close lock at 1675976196706Running coprocessor pre-close hooks at 1675976196706Disabling compacts and flushes for region at 1675976196706Disabling writes for close at 1675976196706Writing region close event to WAL at 1675976196707 (+1 ms)Running coprocessor post-close hooks at 1675976196709 (+2 ms)Closed at 1675976196711 (+2 ms) 2023-02-09 20:56:36,711 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,2,1675976147822.15bceddc51e736adeea65067f01af28b. 2023-02-09 20:56:36,711 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing 1b246bc14d14521c9a184bb2e9c29b83, disabling compactions & flushes 2023-02-09 20:56:36,711 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region ns:testMinorCompaction,1,1675976147822.1b246bc14d14521c9a184bb2e9c29b83. 2023-02-09 20:56:36,711 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on ns:testMinorCompaction,1,1675976147822.1b246bc14d14521c9a184bb2e9c29b83. 2023-02-09 20:56:36,711 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on ns:testMinorCompaction,1,1675976147822.1b246bc14d14521c9a184bb2e9c29b83. after waiting 0 ms 2023-02-09 20:56:36,711 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region ns:testMinorCompaction,1,1675976147822.1b246bc14d14521c9a184bb2e9c29b83. 2023-02-09 20:56:36,714 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/ns/testMinorCompaction/1b246bc14d14521c9a184bb2e9c29b83/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-02-09 20:56:36,714 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed ns:testMinorCompaction,1,1675976147822.1b246bc14d14521c9a184bb2e9c29b83. 2023-02-09 20:56:36,714 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for 1b246bc14d14521c9a184bb2e9c29b83: Waiting for close lock at 1675976196711Running coprocessor pre-close hooks at 1675976196711Disabling compacts and flushes for region at 1675976196711Disabling writes for close at 1675976196711Writing region close event to WAL at 1675976196712 (+1 ms)Running coprocessor post-close hooks at 1675976196714 (+2 ms)Closed at 1675976196714 2023-02-09 20:56:36,714 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,1,1675976147822.1b246bc14d14521c9a184bb2e9c29b83. 2023-02-09 20:56:36,714 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing 91ac905c8115b0a77d093240ed551a1f, disabling compactions & flushes 2023-02-09 20:56:36,714 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionFromAdmin,,1675976177410.91ac905c8115b0a77d093240ed551a1f. 2023-02-09 20:56:36,714 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionFromAdmin,,1675976177410.91ac905c8115b0a77d093240ed551a1f. 2023-02-09 20:56:36,714 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionFromAdmin,,1675976177410.91ac905c8115b0a77d093240ed551a1f. after waiting 0 ms 2023-02-09 20:56:36,714 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionFromAdmin,,1675976177410.91ac905c8115b0a77d093240ed551a1f. 2023-02-09 20:56:36,717 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/91ac905c8115b0a77d093240ed551a1f/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-02-09 20:56:36,717 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed testMajorCompactionFromAdmin,,1675976177410.91ac905c8115b0a77d093240ed551a1f. 2023-02-09 20:56:36,718 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for 91ac905c8115b0a77d093240ed551a1f: Waiting for close lock at 1675976196714Running coprocessor pre-close hooks at 1675976196714Disabling compacts and flushes for region at 1675976196714Disabling writes for close at 1675976196714Writing region close event to WAL at 1675976196715 (+1 ms)Running coprocessor post-close hooks at 1675976196717 (+2 ms)Closed at 1675976196717 2023-02-09 20:56:36,718 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,,1675976177410.91ac905c8115b0a77d093240ed551a1f. 2023-02-09 20:56:36,718 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing 534ed4e0950fb6e77e8b28dd7e0eebb4, disabling compactions & flushes 2023-02-09 20:56:36,718 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region testScannerOnBulkLoadRefHFiles,2,1675976062940.534ed4e0950fb6e77e8b28dd7e0eebb4. 2023-02-09 20:56:36,718 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,2,1675976062940.534ed4e0950fb6e77e8b28dd7e0eebb4. 2023-02-09 20:56:36,718 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on testScannerOnBulkLoadRefHFiles,2,1675976062940.534ed4e0950fb6e77e8b28dd7e0eebb4. after waiting 0 ms 2023-02-09 20:56:36,718 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region testScannerOnBulkLoadRefHFiles,2,1675976062940.534ed4e0950fb6e77e8b28dd7e0eebb4. 2023-02-09 20:56:36,720 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testScannerOnBulkLoadRefHFiles/534ed4e0950fb6e77e8b28dd7e0eebb4/recovered.edits/15.seqid, newMaxSeqId=15, maxSeqId=1 2023-02-09 20:56:36,721 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed testScannerOnBulkLoadRefHFiles,2,1675976062940.534ed4e0950fb6e77e8b28dd7e0eebb4. 2023-02-09 20:56:36,721 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for 534ed4e0950fb6e77e8b28dd7e0eebb4: Waiting for close lock at 1675976196718Running coprocessor pre-close hooks at 1675976196718Disabling compacts and flushes for region at 1675976196718Disabling writes for close at 1675976196718Writing region close event to WAL at 1675976196718Running coprocessor post-close hooks at 1675976196721 (+3 ms)Closed at 1675976196721 2023-02-09 20:56:36,721 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,2,1675976062940.534ed4e0950fb6e77e8b28dd7e0eebb4. 2023-02-09 20:56:36,721 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing e45b0667ca59a312bd230beb34d49fe9, disabling compactions & flushes 2023-02-09 20:56:36,721 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region testMinorCompactionWithWeeklyPolicy,,1675976050709.e45b0667ca59a312bd230beb34d49fe9. 2023-02-09 20:56:36,721 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMinorCompactionWithWeeklyPolicy,,1675976050709.e45b0667ca59a312bd230beb34d49fe9. 2023-02-09 20:56:36,721 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on testMinorCompactionWithWeeklyPolicy,,1675976050709.e45b0667ca59a312bd230beb34d49fe9. after waiting 0 ms 2023-02-09 20:56:36,721 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region testMinorCompactionWithWeeklyPolicy,,1675976050709.e45b0667ca59a312bd230beb34d49fe9. 2023-02-09 20:56:36,724 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMinorCompactionWithWeeklyPolicy/e45b0667ca59a312bd230beb34d49fe9/recovered.edits/49.seqid, newMaxSeqId=49, maxSeqId=1 2023-02-09 20:56:36,725 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed testMinorCompactionWithWeeklyPolicy,,1675976050709.e45b0667ca59a312bd230beb34d49fe9. 2023-02-09 20:56:36,725 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for e45b0667ca59a312bd230beb34d49fe9: Waiting for close lock at 1675976196721Running coprocessor pre-close hooks at 1675976196721Disabling compacts and flushes for region at 1675976196721Disabling writes for close at 1675976196721Writing region close event to WAL at 1675976196721Running coprocessor post-close hooks at 1675976196725 (+4 ms)Closed at 1675976196725 2023-02-09 20:56:36,725 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed testMinorCompactionWithWeeklyPolicy,,1675976050709.e45b0667ca59a312bd230beb34d49fe9. 2023-02-09 20:56:36,725 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing 2453f3b87d227457629ba8909b526463, disabling compactions & flushes 2023-02-09 20:56:36,725 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithMonthlyPolicy,,1675976040214.2453f3b87d227457629ba8909b526463. 2023-02-09 20:56:36,725 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithMonthlyPolicy,,1675976040214.2453f3b87d227457629ba8909b526463. 2023-02-09 20:56:36,725 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithMonthlyPolicy,,1675976040214.2453f3b87d227457629ba8909b526463. after waiting 0 ms 2023-02-09 20:56:36,725 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithMonthlyPolicy,,1675976040214.2453f3b87d227457629ba8909b526463. 2023-02-09 20:56:36,727 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithMonthlyPolicy/2453f3b87d227457629ba8909b526463/recovered.edits/52.seqid, newMaxSeqId=52, maxSeqId=1 2023-02-09 20:56:36,728 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed testMajorCompactionWithMonthlyPolicy,,1675976040214.2453f3b87d227457629ba8909b526463. 2023-02-09 20:56:36,728 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for 2453f3b87d227457629ba8909b526463: Waiting for close lock at 1675976196725Running coprocessor pre-close hooks at 1675976196725Disabling compacts and flushes for region at 1675976196725Disabling writes for close at 1675976196725Writing region close event to WAL at 1675976196726 (+1 ms)Running coprocessor post-close hooks at 1675976196728 (+2 ms)Closed at 1675976196728 2023-02-09 20:56:36,728 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithMonthlyPolicy,,1675976040214.2453f3b87d227457629ba8909b526463. 2023-02-09 20:56:36,728 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing a405dceeac89784cda948f90b491cbc9, disabling compactions & flushes 2023-02-09 20:56:36,728 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675976080230.a405dceeac89784cda948f90b491cbc9. 2023-02-09 20:56:36,728 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675976080230.a405dceeac89784cda948f90b491cbc9. 2023-02-09 20:56:36,728 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675976080230.a405dceeac89784cda948f90b491cbc9. after waiting 0 ms 2023-02-09 20:56:36,728 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675976080230.a405dceeac89784cda948f90b491cbc9. 2023-02-09 20:56:36,730 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/a405dceeac89784cda948f90b491cbc9/recovered.edits/58.seqid, newMaxSeqId=58, maxSeqId=55 2023-02-09 20:56:36,731 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675976080230.a405dceeac89784cda948f90b491cbc9. 2023-02-09 20:56:36,731 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for a405dceeac89784cda948f90b491cbc9: Waiting for close lock at 1675976196728Running coprocessor pre-close hooks at 1675976196728Disabling compacts and flushes for region at 1675976196728Disabling writes for close at 1675976196728Writing region close event to WAL at 1675976196729 (+1 ms)Running coprocessor post-close hooks at 1675976196731 (+2 ms)Closed at 1675976196731 2023-02-09 20:56:36,731 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675976080230.a405dceeac89784cda948f90b491cbc9. 2023-02-09 20:56:36,731 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1603): Closing 1588791fd318439c4a112711b2289bfa, disabling compactions & flushes 2023-02-09 20:56:36,731 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionFromAdmin,1,1675976177410.1588791fd318439c4a112711b2289bfa. 2023-02-09 20:56:36,731 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionFromAdmin,1,1675976177410.1588791fd318439c4a112711b2289bfa. 2023-02-09 20:56:36,731 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionFromAdmin,1,1675976177410.1588791fd318439c4a112711b2289bfa. after waiting 0 ms 2023-02-09 20:56:36,731 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionFromAdmin,1,1675976177410.1588791fd318439c4a112711b2289bfa. 2023-02-09 20:56:36,734 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/default/testMajorCompactionFromAdmin/1588791fd318439c4a112711b2289bfa/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-02-09 20:56:36,734 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed testMajorCompactionFromAdmin,1,1675976177410.1588791fd318439c4a112711b2289bfa. 2023-02-09 20:56:36,734 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for 1588791fd318439c4a112711b2289bfa: Waiting for close lock at 1675976196731Running coprocessor pre-close hooks at 1675976196731Disabling compacts and flushes for region at 1675976196731Disabling writes for close at 1675976196731Writing region close event to WAL at 1675976196732 (+1 ms)Running coprocessor post-close hooks at 1675976196734 (+2 ms)Closed at 1675976196734 2023-02-09 20:56:36,734 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,1,1675976177410.1588791fd318439c4a112711b2289bfa. 2023-02-09 20:56:36,840 DEBUG [RS:0;jenkins-hbase9:40919] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-09 20:56:37,040 DEBUG [RS:0;jenkins-hbase9:40919] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-09 20:56:37,073 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.18 KB at sequenceid=130 (bloomFilter=false), to=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/hbase/meta/1588230740/.tmp/table/09b111165e254cf992be755e81c4cc2e 2023-02-09 20:56:37,077 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 09b111165e254cf992be755e81c4cc2e 2023-02-09 20:56:37,078 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/hbase/meta/1588230740/.tmp/info/018787dd020a4cee8825ecfbbf3bfcda as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/hbase/meta/1588230740/info/018787dd020a4cee8825ecfbbf3bfcda 2023-02-09 20:56:37,082 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 018787dd020a4cee8825ecfbbf3bfcda 2023-02-09 20:56:37,082 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/hbase/meta/1588230740/info/018787dd020a4cee8825ecfbbf3bfcda, entries=226, sequenceid=130, filesize=37.9 K 2023-02-09 20:56:37,082 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/hbase/meta/1588230740/.tmp/rep_barrier/8df2cc262bd3495c9908fd4a3ec3ea4b as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/hbase/meta/1588230740/rep_barrier/8df2cc262bd3495c9908fd4a3ec3ea4b 2023-02-09 20:56:37,086 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8df2cc262bd3495c9908fd4a3ec3ea4b 2023-02-09 20:56:37,086 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/hbase/meta/1588230740/rep_barrier/8df2cc262bd3495c9908fd4a3ec3ea4b, entries=1, sequenceid=130, filesize=5.0 K 2023-02-09 20:56:37,086 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/hbase/meta/1588230740/.tmp/table/09b111165e254cf992be755e81c4cc2e as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/hbase/meta/1588230740/table/09b111165e254cf992be755e81c4cc2e 2023-02-09 20:56:37,089 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 09b111165e254cf992be755e81c4cc2e 2023-02-09 20:56:37,089 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/hbase/meta/1588230740/table/09b111165e254cf992be755e81c4cc2e, entries=27, sequenceid=130, filesize=6.6 K 2023-02-09 20:56:37,091 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~50.56 KB/51772, heapSize ~78.19 KB/80064, currentSize=0 B/0 for 1588230740 in 853ms, sequenceid=130, compaction requested=false 2023-02-09 20:56:37,094 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/data/hbase/meta/1588230740/recovered.edits/133.seqid, newMaxSeqId=133, maxSeqId=1 2023-02-09 20:56:37,094 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-09 20:56:37,094 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-09 20:56:37,094 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1675976196238Running coprocessor pre-close hooks at 1675976196238Disabling compacts and flushes for region at 1675976196238Disabling writes for close at 1675976196238Obtaining lock to block concurrent updates at 1675976196238Preparing flush snapshotting stores in 1588230740 at 1675976196238Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=51772, getHeapSize=80064, getOffHeapSize=0, getCellsCount=365 at 1675976196239 (+1 ms)Flushing stores of hbase:meta,,1.1588230740 at 1675976196239Flushing 1588230740/info: creating writer at 1675976196239Flushing 1588230740/info: appending metadata at 1675976196243 (+4 ms)Flushing 1588230740/info: closing flushed file at 1675976196243Flushing 1588230740/rep_barrier: creating writer at 1675976196256 (+13 ms)Flushing 1588230740/rep_barrier: appending metadata at 1675976196258 (+2 ms)Flushing 1588230740/rep_barrier: closing flushed file at 1675976196258Flushing 1588230740/table: creating writer at 1675976196666 (+408 ms)Flushing 1588230740/table: appending metadata at 1675976196669 (+3 ms)Flushing 1588230740/table: closing flushed file at 1675976196669Flushing 1588230740/info: reopening flushed file at 1675976197078 (+409 ms)Flushing 1588230740/rep_barrier: reopening flushed file at 1675976197083 (+5 ms)Flushing 1588230740/table: reopening flushed file at 1675976197087 (+4 ms)Finished flush of dataSize ~50.56 KB/51772, heapSize ~78.19 KB/80064, currentSize=0 B/0 for 1588230740 in 853ms, sequenceid=130, compaction requested=false at 1675976197091 (+4 ms)Writing region close event to WAL at 1675976197092 (+1 ms)Running coprocessor post-close hooks at 1675976197094 (+2 ms)Closed at 1675976197094 2023-02-09 20:56:37,094 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-09 20:56:37,240 INFO [RS:0;jenkins-hbase9:40919] regionserver.HRegionServer(1171): stopping server jenkins-hbase9.apache.org,40919,1675976022294; all regions closed. 2023-02-09 20:56:37,248 DEBUG [RS:0;jenkins-hbase9:40919] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/oldWALs 2023-02-09 20:56:37,248 INFO [RS:0;jenkins-hbase9:40919] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase9.apache.org%2C40919%2C1675976022294.meta:.meta(num 1675976024589) 2023-02-09 20:56:37,251 DEBUG [RS:0;jenkins-hbase9:40919] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/oldWALs 2023-02-09 20:56:37,251 INFO [RS:0;jenkins-hbase9:40919] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase9.apache.org%2C40919%2C1675976022294:(num 1675976023601) 2023-02-09 20:56:37,251 DEBUG [RS:0;jenkins-hbase9:40919] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 20:56:37,251 INFO [RS:0;jenkins-hbase9:40919] regionserver.LeaseManager(133): Closed leases 2023-02-09 20:56:37,252 INFO [RS:0;jenkins-hbase9:40919] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase9:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-09 20:56:37,252 INFO [regionserver/jenkins-hbase9:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-09 20:56:37,253 INFO [RS:0;jenkins-hbase9:40919] ipc.NettyRpcServer(158): Stopping server on /172.31.2.10:40919 2023-02-09 20:56:37,260 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-09 20:56:37,260 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,40919,1675976022294 2023-02-09 20:56:37,261 ERROR [Listener at localhost/46855-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@41c24c5f rejected from java.util.concurrent.ThreadPoolExecutor@45fdc0bf[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 532] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 20:56:37,261 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase9.apache.org,40919,1675976022294] 2023-02-09 20:56:37,261 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-09 20:56:37,262 ERROR [Listener at localhost/46855-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6246ce67 rejected from java.util.concurrent.ThreadPoolExecutor@45fdc0bf[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 532] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 20:56:37,262 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase9.apache.org,40919,1675976022294; numProcessing=1 2023-02-09 20:56:37,263 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase9.apache.org,40919,1675976022294 already deleted, retry=false 2023-02-09 20:56:37,263 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase9.apache.org,40919,1675976022294 expired; onlineServers=0 2023-02-09 20:56:37,263 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase9.apache.org,42951,1675976021166' ***** 2023-02-09 20:56:37,263 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-09 20:56:37,264 DEBUG [M:0;jenkins-hbase9:42951] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7dfcd593, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase9.apache.org/172.31.2.10:0 2023-02-09 20:56:37,264 INFO [M:0;jenkins-hbase9:42951] regionserver.HRegionServer(1145): stopping server jenkins-hbase9.apache.org,42951,1675976021166 2023-02-09 20:56:37,264 INFO [M:0;jenkins-hbase9:42951] regionserver.HRegionServer(1171): stopping server jenkins-hbase9.apache.org,42951,1675976021166; all regions closed. 2023-02-09 20:56:37,264 DEBUG [M:0;jenkins-hbase9:42951] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-09 20:56:37,264 DEBUG [M:0;jenkins-hbase9:42951] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-09 20:56:37,264 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-09 20:56:37,264 DEBUG [M:0;jenkins-hbase9:42951] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-09 20:56:37,264 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.large.0-1675976023343] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.large.0-1675976023343,5,FailOnTimeoutGroup] 2023-02-09 20:56:37,264 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.small.0-1675976023344] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.small.0-1675976023344,5,FailOnTimeoutGroup] 2023-02-09 20:56:37,264 INFO [M:0;jenkins-hbase9:42951] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-09 20:56:37,264 INFO [M:0;jenkins-hbase9:42951] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-09 20:56:37,264 INFO [M:0;jenkins-hbase9:42951] hbase.ChoreService(369): Chore service for: master/jenkins-hbase9:0 had [] on shutdown 2023-02-09 20:56:37,265 DEBUG [M:0;jenkins-hbase9:42951] master.HMaster(1502): Stopping service threads 2023-02-09 20:56:37,265 INFO [M:0;jenkins-hbase9:42951] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-09 20:56:37,265 ERROR [M:0;jenkins-hbase9:42951] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-20,5,PEWorkerGroup] Thread[HFileArchiver-21,5,PEWorkerGroup] Thread[HFileArchiver-22,5,PEWorkerGroup] 2023-02-09 20:56:37,266 INFO [M:0;jenkins-hbase9:42951] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-09 20:56:37,266 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-09 20:56:37,268 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-09 20:56:37,268 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-09 20:56:37,268 DEBUG [M:0;jenkins-hbase9:42951] zookeeper.ZKUtil(398): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-09 20:56:37,268 WARN [M:0;jenkins-hbase9:42951] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-09 20:56:37,268 INFO [M:0;jenkins-hbase9:42951] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-09 20:56:37,268 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-09 20:56:37,268 INFO [M:0;jenkins-hbase9:42951] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-09 20:56:37,268 DEBUG [M:0;jenkins-hbase9:42951] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-09 20:56:37,268 INFO [M:0;jenkins-hbase9:42951] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 20:56:37,268 DEBUG [M:0;jenkins-hbase9:42951] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 20:56:37,268 DEBUG [M:0;jenkins-hbase9:42951] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-09 20:56:37,268 DEBUG [M:0;jenkins-hbase9:42951] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 20:56:37,268 INFO [M:0;jenkins-hbase9:42951] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=512.48 KB heapSize=598.20 KB 2023-02-09 20:56:37,362 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 20:56:37,362 INFO [RS:0;jenkins-hbase9:40919] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase9.apache.org,40919,1675976022294; zookeeper connection closed. 2023-02-09 20:56:37,363 ERROR [Listener at localhost/46855-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1ae61075 rejected from java.util.concurrent.ThreadPoolExecutor@45fdc0bf[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 532] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 20:56:37,363 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): regionserver:40919-0x1003add715a0001, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 20:56:37,363 ERROR [Listener at localhost/46855-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@343166a0 rejected from java.util.concurrent.ThreadPoolExecutor@45fdc0bf[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 532] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 20:56:37,363 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@2acf0f1] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@2acf0f1 2023-02-09 20:56:37,363 INFO [Listener at localhost/46855] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 1 regionserver(s) complete 2023-02-09 20:56:37,676 INFO [M:0;jenkins-hbase9:42951] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=512.48 KB at sequenceid=1005 (bloomFilter=true), to=hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/1d42ed6c5f8e4bba97eab8c66c168182 2023-02-09 20:56:37,679 INFO [M:0;jenkins-hbase9:42951] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1d42ed6c5f8e4bba97eab8c66c168182 2023-02-09 20:56:37,680 DEBUG [M:0;jenkins-hbase9:42951] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/1d42ed6c5f8e4bba97eab8c66c168182 as hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/1d42ed6c5f8e4bba97eab8c66c168182 2023-02-09 20:56:37,683 INFO [M:0;jenkins-hbase9:42951] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1d42ed6c5f8e4bba97eab8c66c168182 2023-02-09 20:56:37,683 INFO [M:0;jenkins-hbase9:42951] regionserver.HStore(1080): Added hdfs://localhost:34119/user/jenkins/test-data/93140cd6-01d5-bb58-9883-27f1e0ddc56c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/1d42ed6c5f8e4bba97eab8c66c168182, entries=123, sequenceid=1005, filesize=33.3 K 2023-02-09 20:56:37,683 INFO [M:0;jenkins-hbase9:42951] regionserver.HRegion(2947): Finished flush of dataSize ~512.48 KB/524780, heapSize ~598.18 KB/612536, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 415ms, sequenceid=1005, compaction requested=false 2023-02-09 20:56:37,684 INFO [M:0;jenkins-hbase9:42951] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-09 20:56:37,684 DEBUG [M:0;jenkins-hbase9:42951] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1675976197268Disabling compacts and flushes for region at 1675976197268Disabling writes for close at 1675976197268Obtaining lock to block concurrent updates at 1675976197268Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1675976197268Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=524780, getHeapSize=612536, getOffHeapSize=0, getCellsCount=1160 at 1675976197269 (+1 ms)Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1675976197269Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1675976197269Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1675976197272 (+3 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1675976197272Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1675976197680 (+408 ms)Finished flush of dataSize ~512.48 KB/524780, heapSize ~598.18 KB/612536, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 415ms, sequenceid=1005, compaction requested=false at 1675976197683 (+3 ms)Writing region close event to WAL at 1675976197684 (+1 ms)Closed at 1675976197684 2023-02-09 20:56:37,687 INFO [M:0;jenkins-hbase9:42951] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-09 20:56:37,687 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-09 20:56:37,687 INFO [M:0;jenkins-hbase9:42951] ipc.NettyRpcServer(158): Stopping server on /172.31.2.10:42951 2023-02-09 20:56:37,689 DEBUG [M:0;jenkins-hbase9:42951] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase9.apache.org,42951,1675976021166 already deleted, retry=false 2023-02-09 20:56:37,791 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 20:56:37,791 INFO [M:0;jenkins-hbase9:42951] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase9.apache.org,42951,1675976021166; zookeeper connection closed. 2023-02-09 20:56:37,791 ERROR [Listener at localhost/46855-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@31988f4e rejected from java.util.concurrent.ThreadPoolExecutor@71eb4e60[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 907] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 20:56:37,791 DEBUG [Listener at localhost/46855-EventThread] zookeeper.ZKWatcher(600): master:42951-0x1003add715a0000, quorum=127.0.0.1:62089, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-09 20:56:37,791 ERROR [Listener at localhost/46855-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@34cb46a1 rejected from java.util.concurrent.ThreadPoolExecutor@71eb4e60[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 907] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-09 20:56:37,793 WARN [Listener at localhost/46855] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-09 20:56:37,797 INFO [Listener at localhost/46855] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-09 20:56:37,905 WARN [BP-1461392624-172.31.2.10-1675976018075 heartbeating to localhost/127.0.0.1:34119] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-09 20:56:37,905 WARN [BP-1461392624-172.31.2.10-1675976018075 heartbeating to localhost/127.0.0.1:34119] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1461392624-172.31.2.10-1675976018075 (Datanode Uuid 4947dc58-e5b7-43d6-abae-ca3f0a22a31e) service to localhost/127.0.0.1:34119 2023-02-09 20:56:37,907 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c2e7a7e1-d76d-10d1-eb7e-79dd8ea5a0ce/cluster_fa6f1a2e-f8e7-684c-e5cc-577d8df2e8bf/dfs/data/data1/current/BP-1461392624-172.31.2.10-1675976018075] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-09 20:56:37,907 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/c2e7a7e1-d76d-10d1-eb7e-79dd8ea5a0ce/cluster_fa6f1a2e-f8e7-684c-e5cc-577d8df2e8bf/dfs/data/data2/current/BP-1461392624-172.31.2.10-1675976018075] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-09 20:56:37,936 INFO [Listener at localhost/46855] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-09 20:56:38,071 INFO [Listener at localhost/46855] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-09 20:56:38,162 INFO [Listener at localhost/46855] hbase.HBaseTestingUtility(1293): Minicluster is down