2023-02-12 03:52:56,330 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.mob.compactions.TestMobCompactor timeout: 13 mins 2023-02-12 03:52:56,556 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3c8cff1a-3314-a11f-82b4-27989886696f 2023-02-12 03:52:56,569 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=1, rsPorts=, rsClass=null, numDataNodes=1, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-02-12 03:52:56,569 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3c8cff1a-3314-a11f-82b4-27989886696f/cluster_8d46982c-f2f0-5a04-0a7b-ed62cf4de184, deleteOnExit=true 2023-02-12 03:52:56,569 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-12 03:52:56,570 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3c8cff1a-3314-a11f-82b4-27989886696f/test.cache.data in system properties and HBase conf 2023-02-12 03:52:56,570 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3c8cff1a-3314-a11f-82b4-27989886696f/hadoop.tmp.dir in system properties and HBase conf 2023-02-12 03:52:56,571 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3c8cff1a-3314-a11f-82b4-27989886696f/hadoop.log.dir in system properties and HBase conf 2023-02-12 03:52:56,571 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3c8cff1a-3314-a11f-82b4-27989886696f/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-12 03:52:56,571 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3c8cff1a-3314-a11f-82b4-27989886696f/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-12 03:52:56,571 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-12 03:52:56,667 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-02-12 03:52:57,030 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-12 03:52:57,035 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3c8cff1a-3314-a11f-82b4-27989886696f/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-12 03:52:57,035 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3c8cff1a-3314-a11f-82b4-27989886696f/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-12 03:52:57,036 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3c8cff1a-3314-a11f-82b4-27989886696f/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-12 03:52:57,036 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3c8cff1a-3314-a11f-82b4-27989886696f/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-12 03:52:57,037 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3c8cff1a-3314-a11f-82b4-27989886696f/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-12 03:52:57,037 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3c8cff1a-3314-a11f-82b4-27989886696f/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-12 03:52:57,037 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3c8cff1a-3314-a11f-82b4-27989886696f/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-12 03:52:57,038 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3c8cff1a-3314-a11f-82b4-27989886696f/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-12 03:52:57,038 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3c8cff1a-3314-a11f-82b4-27989886696f/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-12 03:52:57,039 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3c8cff1a-3314-a11f-82b4-27989886696f/nfs.dump.dir in system properties and HBase conf 2023-02-12 03:52:57,039 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3c8cff1a-3314-a11f-82b4-27989886696f/java.io.tmpdir in system properties and HBase conf 2023-02-12 03:52:57,039 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3c8cff1a-3314-a11f-82b4-27989886696f/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-12 03:52:57,040 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3c8cff1a-3314-a11f-82b4-27989886696f/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-12 03:52:57,040 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3c8cff1a-3314-a11f-82b4-27989886696f/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-12 03:52:57,550 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-12 03:52:57,554 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-12 03:52:57,801 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-02-12 03:52:57,948 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-02-12 03:52:57,962 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-12 03:52:57,996 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-02-12 03:52:58,060 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3c8cff1a-3314-a11f-82b4-27989886696f/java.io.tmpdir/Jetty_localhost_localdomain_36449_hdfs____i2jp00/webapp 2023-02-12 03:52:58,176 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost.localdomain:36449 2023-02-12 03:52:58,204 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-12 03:52:58,205 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-12 03:52:59,296 WARN [Listener at localhost.localdomain/44635] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-12 03:52:59,417 WARN [Listener at localhost.localdomain/44635] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-12 03:52:59,436 WARN [Listener at localhost.localdomain/44635] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-12 03:52:59,441 INFO [Listener at localhost.localdomain/44635] log.Slf4jLog(67): jetty-6.1.26 2023-02-12 03:52:59,447 INFO [Listener at localhost.localdomain/44635] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3c8cff1a-3314-a11f-82b4-27989886696f/java.io.tmpdir/Jetty_localhost_40329_datanode____rjjlph/webapp 2023-02-12 03:52:59,528 INFO [Listener at localhost.localdomain/44635] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:40329 2023-02-12 03:52:59,892 WARN [Listener at localhost.localdomain/41049] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-12 03:53:00,406 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x5fbcaefc6d8e2dc5: Processing first storage report for DS-2f2b7ee4-00d9-477d-9ba8-81f493e94385 from datanode 6d5619e5-9e10-46fd-8c6c-bb1351f6f414 2023-02-12 03:53:00,407 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x5fbcaefc6d8e2dc5: from storage DS-2f2b7ee4-00d9-477d-9ba8-81f493e94385 node DatanodeRegistration(127.0.0.1:40595, datanodeUuid=6d5619e5-9e10-46fd-8c6c-bb1351f6f414, infoPort=46829, infoSecurePort=0, ipcPort=41049, storageInfo=lv=-57;cid=testClusterID;nsid=1927248846;c=1676173977617), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-02-12 03:53:00,408 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x5fbcaefc6d8e2dc5: Processing first storage report for DS-8fb0c15c-4c68-40ec-84c0-06af02ad3930 from datanode 6d5619e5-9e10-46fd-8c6c-bb1351f6f414 2023-02-12 03:53:00,408 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x5fbcaefc6d8e2dc5: from storage DS-8fb0c15c-4c68-40ec-84c0-06af02ad3930 node DatanodeRegistration(127.0.0.1:40595, datanodeUuid=6d5619e5-9e10-46fd-8c6c-bb1351f6f414, infoPort=46829, infoSecurePort=0, ipcPort=41049, storageInfo=lv=-57;cid=testClusterID;nsid=1927248846;c=1676173977617), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-12 03:53:00,566 DEBUG [Listener at localhost.localdomain/41049] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3c8cff1a-3314-a11f-82b4-27989886696f 2023-02-12 03:53:00,619 INFO [Listener at localhost.localdomain/41049] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3c8cff1a-3314-a11f-82b4-27989886696f/cluster_8d46982c-f2f0-5a04-0a7b-ed62cf4de184/zookeeper_0, clientPort=59556, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3c8cff1a-3314-a11f-82b4-27989886696f/cluster_8d46982c-f2f0-5a04-0a7b-ed62cf4de184/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3c8cff1a-3314-a11f-82b4-27989886696f/cluster_8d46982c-f2f0-5a04-0a7b-ed62cf4de184/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-12 03:53:00,631 INFO [Listener at localhost.localdomain/41049] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=59556 2023-02-12 03:53:00,641 INFO [Listener at localhost.localdomain/41049] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 03:53:00,643 INFO [Listener at localhost.localdomain/41049] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 03:53:01,297 INFO [Listener at localhost.localdomain/41049] util.FSUtils(479): Created version file at hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de with version=8 2023-02-12 03:53:01,298 INFO [Listener at localhost.localdomain/41049] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/hbase-staging 2023-02-12 03:53:01,542 INFO [Listener at localhost.localdomain/41049] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-02-12 03:53:01,920 INFO [Listener at localhost.localdomain/41049] client.ConnectionUtils(127): master/jenkins-hbase20:0 server-side Connection retries=3 2023-02-12 03:53:01,947 INFO [Listener at localhost.localdomain/41049] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 03:53:01,948 INFO [Listener at localhost.localdomain/41049] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-12 03:53:01,948 INFO [Listener at localhost.localdomain/41049] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-12 03:53:01,948 INFO [Listener at localhost.localdomain/41049] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 03:53:01,948 INFO [Listener at localhost.localdomain/41049] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-12 03:53:02,102 INFO [Listener at localhost.localdomain/41049] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-12 03:53:02,160 DEBUG [Listener at localhost.localdomain/41049] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-02-12 03:53:02,241 INFO [Listener at localhost.localdomain/41049] ipc.NettyRpcServer(120): Bind to /148.251.75.209:40099 2023-02-12 03:53:02,249 INFO [Listener at localhost.localdomain/41049] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 03:53:02,251 INFO [Listener at localhost.localdomain/41049] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 03:53:02,268 INFO [Listener at localhost.localdomain/41049] zookeeper.RecoverableZooKeeper(93): Process identifier=master:40099 connecting to ZooKeeper ensemble=127.0.0.1:59556 2023-02-12 03:53:02,300 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:400990x0, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-12 03:53:02,303 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:40099-0x10154d0f56d0000 connected 2023-02-12 03:53:02,365 DEBUG [Listener at localhost.localdomain/41049] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-12 03:53:02,366 DEBUG [Listener at localhost.localdomain/41049] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 03:53:02,369 DEBUG [Listener at localhost.localdomain/41049] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-12 03:53:02,375 DEBUG [Listener at localhost.localdomain/41049] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=40099 2023-02-12 03:53:02,376 DEBUG [Listener at localhost.localdomain/41049] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=40099 2023-02-12 03:53:02,376 DEBUG [Listener at localhost.localdomain/41049] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=40099 2023-02-12 03:53:02,376 DEBUG [Listener at localhost.localdomain/41049] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=40099 2023-02-12 03:53:02,376 DEBUG [Listener at localhost.localdomain/41049] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=40099 2023-02-12 03:53:02,381 INFO [Listener at localhost.localdomain/41049] master.HMaster(439): hbase.rootdir=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de, hbase.cluster.distributed=false 2023-02-12 03:53:02,451 INFO [Listener at localhost.localdomain/41049] client.ConnectionUtils(127): regionserver/jenkins-hbase20:0 server-side Connection retries=3 2023-02-12 03:53:02,451 INFO [Listener at localhost.localdomain/41049] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 03:53:02,452 INFO [Listener at localhost.localdomain/41049] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-12 03:53:02,452 INFO [Listener at localhost.localdomain/41049] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-12 03:53:02,452 INFO [Listener at localhost.localdomain/41049] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-12 03:53:02,452 INFO [Listener at localhost.localdomain/41049] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-12 03:53:02,457 INFO [Listener at localhost.localdomain/41049] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-12 03:53:02,460 INFO [Listener at localhost.localdomain/41049] ipc.NettyRpcServer(120): Bind to /148.251.75.209:39639 2023-02-12 03:53:02,462 INFO [Listener at localhost.localdomain/41049] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-12 03:53:02,467 DEBUG [Listener at localhost.localdomain/41049] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-12 03:53:02,468 INFO [Listener at localhost.localdomain/41049] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 03:53:02,471 INFO [Listener at localhost.localdomain/41049] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 03:53:02,473 INFO [Listener at localhost.localdomain/41049] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:39639 connecting to ZooKeeper ensemble=127.0.0.1:59556 2023-02-12 03:53:02,476 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:396390x0, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-12 03:53:02,477 DEBUG [Listener at localhost.localdomain/41049] zookeeper.ZKUtil(164): regionserver:396390x0, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-12 03:53:02,477 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:39639-0x10154d0f56d0001 connected 2023-02-12 03:53:02,478 DEBUG [Listener at localhost.localdomain/41049] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 03:53:02,478 DEBUG [Listener at localhost.localdomain/41049] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-12 03:53:02,479 DEBUG [Listener at localhost.localdomain/41049] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=39639 2023-02-12 03:53:02,479 DEBUG [Listener at localhost.localdomain/41049] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=39639 2023-02-12 03:53:02,482 DEBUG [Listener at localhost.localdomain/41049] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=39639 2023-02-12 03:53:02,483 DEBUG [Listener at localhost.localdomain/41049] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=39639 2023-02-12 03:53:02,483 DEBUG [Listener at localhost.localdomain/41049] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=39639 2023-02-12 03:53:02,485 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase20.apache.org,40099,1676173981406 2023-02-12 03:53:02,497 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-12 03:53:02,498 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase20.apache.org,40099,1676173981406 2023-02-12 03:53:02,519 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-12 03:53:02,519 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-12 03:53:02,519 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 03:53:02,520 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-12 03:53:02,521 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase20.apache.org,40099,1676173981406 from backup master directory 2023-02-12 03:53:02,521 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-12 03:53:02,523 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase20.apache.org,40099,1676173981406 2023-02-12 03:53:02,524 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-12 03:53:02,524 WARN [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-12 03:53:02,525 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase20.apache.org,40099,1676173981406 2023-02-12 03:53:02,527 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-02-12 03:53:02,529 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-02-12 03:53:02,610 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/hbase.id with ID: a652b558-4694-4da9-8366-18a7dd2facc0 2023-02-12 03:53:02,655 INFO [master/jenkins-hbase20:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 03:53:02,670 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 03:53:02,708 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x29686ab0 to 127.0.0.1:59556 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 03:53:02,737 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@a49c3f4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 03:53:02,762 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-12 03:53:02,764 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-12 03:53:02,782 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-02-12 03:53:02,782 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-02-12 03:53:02,784 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:849) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2178) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:523) at java.lang.Thread.run(Thread.java:750) 2023-02-12 03:53:02,789 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:849) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2178) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:523) at java.lang.Thread.run(Thread.java:750) 2023-02-12 03:53:02,790 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-12 03:53:02,827 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/MasterData/data/master/store-tmp 2023-02-12 03:53:02,852 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:53:02,853 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-12 03:53:02,853 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 03:53:02,853 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 03:53:02,854 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 1 ms 2023-02-12 03:53:02,854 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 03:53:02,854 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 03:53:02,854 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676173982853Disabling compacts and flushes for region at 1676173982853Disabling writes for close at 1676173982854 (+1 ms)Writing region close event to WAL at 1676173982854Closed at 1676173982854 2023-02-12 03:53:02,856 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/MasterData/WALs/jenkins-hbase20.apache.org,40099,1676173981406 2023-02-12 03:53:02,878 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C40099%2C1676173981406, suffix=, logDir=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/MasterData/WALs/jenkins-hbase20.apache.org,40099,1676173981406, archiveDir=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/MasterData/oldWALs, maxLogs=10 2023-02-12 03:53:02,929 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40595,DS-2f2b7ee4-00d9-477d-9ba8-81f493e94385,DISK] 2023-02-12 03:53:02,936 DEBUG [RS-EventLoopGroup-3-2] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-02-12 03:53:02,991 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/MasterData/WALs/jenkins-hbase20.apache.org,40099,1676173981406/jenkins-hbase20.apache.org%2C40099%2C1676173981406.1676173982890 2023-02-12 03:53:02,992 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40595,DS-2f2b7ee4-00d9-477d-9ba8-81f493e94385,DISK]] 2023-02-12 03:53:02,993 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-12 03:53:02,993 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:53:02,996 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-12 03:53:02,997 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-12 03:53:03,059 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-12 03:53:03,066 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-12 03:53:03,094 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-12 03:53:03,108 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:53:03,115 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-12 03:53:03,118 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-12 03:53:03,137 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-12 03:53:03,141 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 03:53:03,143 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64158022, jitterRate=-0.043970972299575806}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-12 03:53:03,143 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1676173983021Initializing all the Stores at 1676173983023 (+2 ms)Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676173983024 (+1 ms)Cleaning up temporary data from old regions at 1676173983125 (+101 ms)Cleaning up detritus from prior splits at 1676173983126 (+1 ms)Region opened successfully at 1676173983143 (+17 ms) 2023-02-12 03:53:03,145 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-12 03:53:03,169 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-12 03:53:03,169 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-12 03:53:03,172 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-12 03:53:03,174 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-02-12 03:53:03,208 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 34 msec 2023-02-12 03:53:03,208 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-12 03:53:03,233 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-12 03:53:03,239 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-12 03:53:03,261 INFO [master/jenkins-hbase20:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-12 03:53:03,264 INFO [master/jenkins-hbase20:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-12 03:53:03,266 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-12 03:53:03,271 INFO [master/jenkins-hbase20:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-12 03:53:03,275 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-12 03:53:03,277 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 03:53:03,278 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-12 03:53:03,279 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-12 03:53:03,291 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-12 03:53:03,295 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-12 03:53:03,295 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-12 03:53:03,295 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 03:53:03,297 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase20.apache.org,40099,1676173981406, sessionid=0x10154d0f56d0000, setting cluster-up flag (Was=false) 2023-02-12 03:53:03,309 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 03:53:03,314 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-12 03:53:03,316 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase20.apache.org,40099,1676173981406 2023-02-12 03:53:03,321 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 03:53:03,328 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-12 03:53:03,329 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase20.apache.org,40099,1676173981406 2023-02-12 03:53:03,332 WARN [master/jenkins-hbase20:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/.hbase-snapshot/.tmp 2023-02-12 03:53:03,388 INFO [RS:0;jenkins-hbase20:39639] regionserver.HRegionServer(952): ClusterId : a652b558-4694-4da9-8366-18a7dd2facc0 2023-02-12 03:53:03,391 DEBUG [RS:0;jenkins-hbase20:39639] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-12 03:53:03,396 DEBUG [RS:0;jenkins-hbase20:39639] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-12 03:53:03,396 DEBUG [RS:0;jenkins-hbase20:39639] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-12 03:53:03,399 DEBUG [RS:0;jenkins-hbase20:39639] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-12 03:53:03,400 DEBUG [RS:0;jenkins-hbase20:39639] zookeeper.ReadOnlyZKClient(139): Connect 0x6d79c67c to 127.0.0.1:59556 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 03:53:03,407 DEBUG [RS:0;jenkins-hbase20:39639] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@63be25a3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 03:53:03,408 DEBUG [RS:0;jenkins-hbase20:39639] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6781ad0c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-02-12 03:53:03,430 DEBUG [RS:0;jenkins-hbase20:39639] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase20:39639 2023-02-12 03:53:03,433 INFO [RS:0;jenkins-hbase20:39639] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-12 03:53:03,433 INFO [RS:0;jenkins-hbase20:39639] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-12 03:53:03,433 DEBUG [RS:0;jenkins-hbase20:39639] regionserver.HRegionServer(1023): About to register with Master. 2023-02-12 03:53:03,436 INFO [RS:0;jenkins-hbase20:39639] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase20.apache.org,40099,1676173981406 with isa=jenkins-hbase20.apache.org/148.251.75.209:39639, startcode=1676173982450 2023-02-12 03:53:03,449 DEBUG [RS:0;jenkins-hbase20:39639] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-12 03:53:03,463 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-12 03:53:03,482 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-02-12 03:53:03,482 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-02-12 03:53:03,482 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-02-12 03:53:03,482 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-02-12 03:53:03,482 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase20:0, corePoolSize=10, maxPoolSize=10 2023-02-12 03:53:03,483 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-12 03:53:03,483 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-02-12 03:53:03,483 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-12 03:53:03,485 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1676174013485 2023-02-12 03:53:03,487 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-12 03:53:03,492 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-12 03:53:03,493 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-12 03:53:03,499 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-12 03:53:03,501 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-12 03:53:03,509 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-12 03:53:03,510 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-12 03:53:03,510 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-12 03:53:03,510 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-12 03:53:03,512 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:35411, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-02-12 03:53:03,515 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-12 03:53:03,517 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-12 03:53:03,519 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-12 03:53:03,519 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-12 03:53:03,525 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2815) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:577) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-02-12 03:53:03,527 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-12 03:53:03,528 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-12 03:53:03,531 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1676173983530,5,FailOnTimeoutGroup] 2023-02-12 03:53:03,535 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1676173983531,5,FailOnTimeoutGroup] 2023-02-12 03:53:03,535 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-12 03:53:03,536 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-12 03:53:03,537 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-12 03:53:03,538 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-12 03:53:03,552 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-12 03:53:03,553 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-12 03:53:03,553 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de 2023-02-12 03:53:03,562 DEBUG [RS:0;jenkins-hbase20:39639] regionserver.HRegionServer(2829): Master is not running yet 2023-02-12 03:53:03,562 WARN [RS:0;jenkins-hbase20:39639] regionserver.HRegionServer(1031): reportForDuty failed; sleeping 100 ms and then retrying. 2023-02-12 03:53:03,663 INFO [RS:0;jenkins-hbase20:39639] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase20.apache.org,40099,1676173981406 with isa=jenkins-hbase20.apache.org/148.251.75.209:39639, startcode=1676173982450 2023-02-12 03:53:03,668 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.ServerManager(394): Registering regionserver=jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:03,675 DEBUG [RS:0;jenkins-hbase20:39639] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de 2023-02-12 03:53:03,675 DEBUG [RS:0;jenkins-hbase20:39639] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost.localdomain:44635 2023-02-12 03:53:03,675 DEBUG [RS:0;jenkins-hbase20:39639] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-12 03:53:03,680 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 03:53:03,680 DEBUG [RS:0;jenkins-hbase20:39639] zookeeper.ZKUtil(162): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:03,681 WARN [RS:0;jenkins-hbase20:39639] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-12 03:53:03,681 INFO [RS:0;jenkins-hbase20:39639] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-12 03:53:03,682 DEBUG [RS:0;jenkins-hbase20:39639] regionserver.HRegionServer(1947): logDir=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/WALs/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:03,682 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase20.apache.org,39639,1676173982450] 2023-02-12 03:53:03,691 DEBUG [RS:0;jenkins-hbase20:39639] zookeeper.ZKUtil(162): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:03,704 DEBUG [RS:0;jenkins-hbase20:39639] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-12 03:53:03,713 INFO [RS:0;jenkins-hbase20:39639] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-12 03:53:03,735 INFO [RS:0;jenkins-hbase20:39639] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-12 03:53:03,740 INFO [RS:0;jenkins-hbase20:39639] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-12 03:53:03,740 INFO [RS:0;jenkins-hbase20:39639] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 03:53:03,741 INFO [RS:0;jenkins-hbase20:39639] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-12 03:53:03,749 INFO [RS:0;jenkins-hbase20:39639] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=100, unit=MILLISECONDS is enabled. 2023-02-12 03:53:03,750 DEBUG [RS:0;jenkins-hbase20:39639] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-12 03:53:03,750 DEBUG [RS:0;jenkins-hbase20:39639] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-12 03:53:03,750 DEBUG [RS:0;jenkins-hbase20:39639] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-12 03:53:03,750 DEBUG [RS:0;jenkins-hbase20:39639] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-12 03:53:03,751 DEBUG [RS:0;jenkins-hbase20:39639] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-12 03:53:03,751 DEBUG [RS:0;jenkins-hbase20:39639] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-02-12 03:53:03,751 DEBUG [RS:0;jenkins-hbase20:39639] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-12 03:53:03,751 DEBUG [RS:0;jenkins-hbase20:39639] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-12 03:53:03,751 DEBUG [RS:0;jenkins-hbase20:39639] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-12 03:53:03,751 DEBUG [RS:0;jenkins-hbase20:39639] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-02-12 03:53:03,755 INFO [RS:0;jenkins-hbase20:39639] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-12 03:53:03,755 INFO [RS:0;jenkins-hbase20:39639] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-12 03:53:03,755 INFO [RS:0;jenkins-hbase20:39639] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-12 03:53:03,775 INFO [RS:0;jenkins-hbase20:39639] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-12 03:53:03,778 INFO [RS:0;jenkins-hbase20:39639] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,39639,1676173982450-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 03:53:03,794 INFO [RS:0;jenkins-hbase20:39639] regionserver.Replication(203): jenkins-hbase20.apache.org,39639,1676173982450 started 2023-02-12 03:53:03,795 INFO [RS:0;jenkins-hbase20:39639] regionserver.HRegionServer(1638): Serving as jenkins-hbase20.apache.org,39639,1676173982450, RpcServer on jenkins-hbase20.apache.org/148.251.75.209:39639, sessionid=0x10154d0f56d0001 2023-02-12 03:53:03,795 DEBUG [RS:0;jenkins-hbase20:39639] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-12 03:53:03,795 DEBUG [RS:0;jenkins-hbase20:39639] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:03,795 DEBUG [RS:0;jenkins-hbase20:39639] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,39639,1676173982450' 2023-02-12 03:53:03,795 DEBUG [RS:0;jenkins-hbase20:39639] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:53:03,796 DEBUG [RS:0;jenkins-hbase20:39639] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:53:03,796 DEBUG [RS:0;jenkins-hbase20:39639] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-12 03:53:03,796 DEBUG [RS:0;jenkins-hbase20:39639] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-12 03:53:03,796 DEBUG [RS:0;jenkins-hbase20:39639] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:03,796 DEBUG [RS:0;jenkins-hbase20:39639] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,39639,1676173982450' 2023-02-12 03:53:03,796 DEBUG [RS:0;jenkins-hbase20:39639] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 03:53:03,797 DEBUG [RS:0;jenkins-hbase20:39639] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 03:53:03,797 DEBUG [RS:0;jenkins-hbase20:39639] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-12 03:53:03,797 INFO [RS:0;jenkins-hbase20:39639] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-12 03:53:03,797 INFO [RS:0;jenkins-hbase20:39639] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-12 03:53:03,910 INFO [RS:0;jenkins-hbase20:39639] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C39639%2C1676173982450, suffix=, logDir=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/WALs/jenkins-hbase20.apache.org,39639,1676173982450, archiveDir=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/oldWALs, maxLogs=32 2023-02-12 03:53:03,929 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40595,DS-2f2b7ee4-00d9-477d-9ba8-81f493e94385,DISK] 2023-02-12 03:53:03,937 INFO [RS:0;jenkins-hbase20:39639] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/WALs/jenkins-hbase20.apache.org,39639,1676173982450/jenkins-hbase20.apache.org%2C39639%2C1676173982450.1676173983912 2023-02-12 03:53:03,937 DEBUG [RS:0;jenkins-hbase20:39639] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40595,DS-2f2b7ee4-00d9-477d-9ba8-81f493e94385,DISK]] 2023-02-12 03:53:03,974 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:53:03,976 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-12 03:53:03,978 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/hbase/meta/1588230740/info 2023-02-12 03:53:03,980 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-12 03:53:03,981 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:53:03,981 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-12 03:53:03,984 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/hbase/meta/1588230740/rep_barrier 2023-02-12 03:53:03,985 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-12 03:53:03,986 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:53:03,987 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-12 03:53:03,989 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/hbase/meta/1588230740/table 2023-02-12 03:53:03,990 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-12 03:53:03,992 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:53:03,994 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/hbase/meta/1588230740 2023-02-12 03:53:03,995 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/hbase/meta/1588230740 2023-02-12 03:53:04,005 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-12 03:53:04,007 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-12 03:53:04,011 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 03:53:04,013 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63293709, jitterRate=-0.056850239634513855}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-12 03:53:04,013 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1676173983974Initializing all the Stores at 1676173983975 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676173983975Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676173983976 (+1 ms)Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676173983976Cleaning up temporary data from old regions at 1676173984002 (+26 ms)Cleaning up detritus from prior splits at 1676173984003 (+1 ms)Region opened successfully at 1676173984013 (+10 ms) 2023-02-12 03:53:04,013 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-12 03:53:04,014 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-12 03:53:04,014 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-12 03:53:04,014 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-12 03:53:04,014 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-12 03:53:04,015 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-12 03:53:04,015 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676173984013Disabling compacts and flushes for region at 1676173984013Disabling writes for close at 1676173984014 (+1 ms)Writing region close event to WAL at 1676173984015 (+1 ms)Closed at 1676173984015 2023-02-12 03:53:04,021 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-12 03:53:04,021 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-12 03:53:04,030 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-12 03:53:04,041 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-12 03:53:04,043 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-12 03:53:04,195 DEBUG [jenkins-hbase20:40099] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=1, allServersCount=1 2023-02-12 03:53:04,198 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase20.apache.org,39639,1676173982450, state=OPENING 2023-02-12 03:53:04,205 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-12 03:53:04,206 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 03:53:04,207 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-12 03:53:04,209 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase20.apache.org,39639,1676173982450}] 2023-02-12 03:53:04,389 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:04,392 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-12 03:53:04,396 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:58612, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-12 03:53:04,407 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-12 03:53:04,408 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-12 03:53:04,413 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C39639%2C1676173982450.meta, suffix=.meta, logDir=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/WALs/jenkins-hbase20.apache.org,39639,1676173982450, archiveDir=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/oldWALs, maxLogs=32 2023-02-12 03:53:04,430 DEBUG [RS-EventLoopGroup-3-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40595,DS-2f2b7ee4-00d9-477d-9ba8-81f493e94385,DISK] 2023-02-12 03:53:04,434 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/WALs/jenkins-hbase20.apache.org,39639,1676173982450/jenkins-hbase20.apache.org%2C39639%2C1676173982450.meta.1676173984415.meta 2023-02-12 03:53:04,435 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40595,DS-2f2b7ee4-00d9-477d-9ba8-81f493e94385,DISK]] 2023-02-12 03:53:04,435 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-12 03:53:04,437 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-12 03:53:04,455 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-12 03:53:04,460 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-12 03:53:04,464 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-12 03:53:04,464 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:53:04,465 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-12 03:53:04,465 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-12 03:53:04,467 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-12 03:53:04,468 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/hbase/meta/1588230740/info 2023-02-12 03:53:04,468 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/hbase/meta/1588230740/info 2023-02-12 03:53:04,469 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-12 03:53:04,470 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:53:04,470 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-12 03:53:04,472 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/hbase/meta/1588230740/rep_barrier 2023-02-12 03:53:04,472 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/hbase/meta/1588230740/rep_barrier 2023-02-12 03:53:04,472 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-12 03:53:04,473 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:53:04,474 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-12 03:53:04,476 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/hbase/meta/1588230740/table 2023-02-12 03:53:04,476 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/hbase/meta/1588230740/table 2023-02-12 03:53:04,477 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-12 03:53:04,478 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:53:04,480 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/hbase/meta/1588230740 2023-02-12 03:53:04,483 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/hbase/meta/1588230740 2023-02-12 03:53:04,487 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-12 03:53:04,489 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-12 03:53:04,490 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69069611, jitterRate=0.02921740710735321}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-12 03:53:04,490 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1676173984465Writing region info on filesystem at 1676173984465Initializing all the Stores at 1676173984466 (+1 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676173984467 (+1 ms)Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1676173984467Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676173984467Cleaning up temporary data from old regions at 1676173984485 (+18 ms)Cleaning up detritus from prior splits at 1676173984485Running coprocessor post-open hooks at 1676173984490 (+5 ms)Region opened successfully at 1676173984490 2023-02-12 03:53:04,499 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1676173984383 2023-02-12 03:53:04,516 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-12 03:53:04,517 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-12 03:53:04,517 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase20.apache.org,39639,1676173982450, state=OPEN 2023-02-12 03:53:04,520 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-12 03:53:04,520 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-12 03:53:04,524 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-12 03:53:04,525 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase20.apache.org,39639,1676173982450 in 311 msec 2023-02-12 03:53:04,530 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-12 03:53:04,530 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 497 msec 2023-02-12 03:53:04,535 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.1470 sec 2023-02-12 03:53:04,535 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1676173982515, completionTime=-1 2023-02-12 03:53:04,535 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=1; waited=0ms, expected min=1 server(s), max=1 server(s), master is running 2023-02-12 03:53:04,536 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-12 03:53:04,595 DEBUG [hconnection-0x5ca80d90-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-12 03:53:04,598 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:58620, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-12 03:53:04,617 INFO [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=1 2023-02-12 03:53:04,617 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1676174044617 2023-02-12 03:53:04,617 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1676174104617 2023-02-12 03:53:04,617 INFO [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 81 msec 2023-02-12 03:53:04,641 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,40099,1676173981406-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 03:53:04,641 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,40099,1676173981406-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-12 03:53:04,641 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,40099,1676173981406-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-12 03:53:04,643 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase20:40099, period=300000, unit=MILLISECONDS is enabled. 2023-02-12 03:53:04,644 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-12 03:53:04,650 DEBUG [master/jenkins-hbase20:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-12 03:53:04,658 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-12 03:53:04,659 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-12 03:53:04,669 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-12 03:53:04,672 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-12 03:53:04,675 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-12 03:53:04,696 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/.tmp/data/hbase/namespace/d12646a520864c41bc260dbfbe486d5f 2023-02-12 03:53:04,698 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/.tmp/data/hbase/namespace/d12646a520864c41bc260dbfbe486d5f empty. 2023-02-12 03:53:04,699 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/.tmp/data/hbase/namespace/d12646a520864c41bc260dbfbe486d5f 2023-02-12 03:53:04,699 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-12 03:53:05,122 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-12 03:53:05,125 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => d12646a520864c41bc260dbfbe486d5f, NAME => 'hbase:namespace,,1676173984659.d12646a520864c41bc260dbfbe486d5f.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/.tmp 2023-02-12 03:53:05,139 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676173984659.d12646a520864c41bc260dbfbe486d5f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:53:05,139 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing d12646a520864c41bc260dbfbe486d5f, disabling compactions & flushes 2023-02-12 03:53:05,139 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676173984659.d12646a520864c41bc260dbfbe486d5f. 2023-02-12 03:53:05,140 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676173984659.d12646a520864c41bc260dbfbe486d5f. 2023-02-12 03:53:05,140 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676173984659.d12646a520864c41bc260dbfbe486d5f. after waiting 0 ms 2023-02-12 03:53:05,140 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676173984659.d12646a520864c41bc260dbfbe486d5f. 2023-02-12 03:53:05,140 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676173984659.d12646a520864c41bc260dbfbe486d5f. 2023-02-12 03:53:05,140 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for d12646a520864c41bc260dbfbe486d5f: Waiting for close lock at 1676173985139Disabling compacts and flushes for region at 1676173985139Disabling writes for close at 1676173985140 (+1 ms)Writing region close event to WAL at 1676173985140Closed at 1676173985140 2023-02-12 03:53:05,145 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-12 03:53:05,158 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1676173984659.d12646a520864c41bc260dbfbe486d5f.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676173985148"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676173985148"}]},"ts":"1676173985148"} 2023-02-12 03:53:05,180 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-12 03:53:05,183 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-12 03:53:05,188 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676173985183"}]},"ts":"1676173985183"} 2023-02-12 03:53:05,192 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-12 03:53:05,200 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=d12646a520864c41bc260dbfbe486d5f, ASSIGN}] 2023-02-12 03:53:05,203 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=d12646a520864c41bc260dbfbe486d5f, ASSIGN 2023-02-12 03:53:05,205 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=d12646a520864c41bc260dbfbe486d5f, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,39639,1676173982450; forceNewPlan=false, retain=false 2023-02-12 03:53:05,357 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=d12646a520864c41bc260dbfbe486d5f, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:05,358 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1676173984659.d12646a520864c41bc260dbfbe486d5f.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676173985356"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676173985356"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676173985356"}]},"ts":"1676173985356"} 2023-02-12 03:53:05,366 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure d12646a520864c41bc260dbfbe486d5f, server=jenkins-hbase20.apache.org,39639,1676173982450}] 2023-02-12 03:53:05,530 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1676173984659.d12646a520864c41bc260dbfbe486d5f. 2023-02-12 03:53:05,531 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => d12646a520864c41bc260dbfbe486d5f, NAME => 'hbase:namespace,,1676173984659.d12646a520864c41bc260dbfbe486d5f.', STARTKEY => '', ENDKEY => ''} 2023-02-12 03:53:05,532 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace d12646a520864c41bc260dbfbe486d5f 2023-02-12 03:53:05,533 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1676173984659.d12646a520864c41bc260dbfbe486d5f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:53:05,533 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for d12646a520864c41bc260dbfbe486d5f 2023-02-12 03:53:05,533 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for d12646a520864c41bc260dbfbe486d5f 2023-02-12 03:53:05,535 INFO [StoreOpener-d12646a520864c41bc260dbfbe486d5f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region d12646a520864c41bc260dbfbe486d5f 2023-02-12 03:53:05,538 DEBUG [StoreOpener-d12646a520864c41bc260dbfbe486d5f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/hbase/namespace/d12646a520864c41bc260dbfbe486d5f/info 2023-02-12 03:53:05,538 DEBUG [StoreOpener-d12646a520864c41bc260dbfbe486d5f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/hbase/namespace/d12646a520864c41bc260dbfbe486d5f/info 2023-02-12 03:53:05,539 INFO [StoreOpener-d12646a520864c41bc260dbfbe486d5f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d12646a520864c41bc260dbfbe486d5f columnFamilyName info 2023-02-12 03:53:05,541 INFO [StoreOpener-d12646a520864c41bc260dbfbe486d5f-1] regionserver.HStore(310): Store=d12646a520864c41bc260dbfbe486d5f/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:53:05,544 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/hbase/namespace/d12646a520864c41bc260dbfbe486d5f 2023-02-12 03:53:05,546 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/hbase/namespace/d12646a520864c41bc260dbfbe486d5f 2023-02-12 03:53:05,554 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for d12646a520864c41bc260dbfbe486d5f 2023-02-12 03:53:05,561 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/hbase/namespace/d12646a520864c41bc260dbfbe486d5f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 03:53:05,562 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened d12646a520864c41bc260dbfbe486d5f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68242178, jitterRate=0.016887694597244263}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-12 03:53:05,562 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for d12646a520864c41bc260dbfbe486d5f: Running coprocessor pre-open hook at 1676173985533Writing region info on filesystem at 1676173985533Initializing all the Stores at 1676173985535 (+2 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1676173985535Cleaning up temporary data from old regions at 1676173985546 (+11 ms)Cleaning up detritus from prior splits at 1676173985547 (+1 ms)Running coprocessor post-open hooks at 1676173985562 (+15 ms)Region opened successfully at 1676173985562 2023-02-12 03:53:05,564 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1676173984659.d12646a520864c41bc260dbfbe486d5f., pid=6, masterSystemTime=1676173985521 2023-02-12 03:53:05,569 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1676173984659.d12646a520864c41bc260dbfbe486d5f. 2023-02-12 03:53:05,569 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1676173984659.d12646a520864c41bc260dbfbe486d5f. 2023-02-12 03:53:05,571 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=d12646a520864c41bc260dbfbe486d5f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:05,571 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1676173984659.d12646a520864c41bc260dbfbe486d5f.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1676173985570"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676173985570"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676173985570"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676173985570"}]},"ts":"1676173985570"} 2023-02-12 03:53:05,580 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-12 03:53:05,580 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure d12646a520864c41bc260dbfbe486d5f, server=jenkins-hbase20.apache.org,39639,1676173982450 in 210 msec 2023-02-12 03:53:05,583 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-12 03:53:05,584 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=d12646a520864c41bc260dbfbe486d5f, ASSIGN in 381 msec 2023-02-12 03:53:05,585 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-12 03:53:05,586 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676173985586"}]},"ts":"1676173985586"} 2023-02-12 03:53:05,589 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-12 03:53:05,593 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-12 03:53:05,595 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 933 msec 2023-02-12 03:53:05,673 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-12 03:53:05,674 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-12 03:53:05,674 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 03:53:05,730 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-12 03:53:05,753 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-12 03:53:05,762 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 37 msec 2023-02-12 03:53:05,776 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-12 03:53:05,792 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-12 03:53:05,798 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 21 msec 2023-02-12 03:53:05,811 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-12 03:53:05,812 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-12 03:53:05,814 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 3.289sec 2023-02-12 03:53:05,815 INFO [master/jenkins-hbase20:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-12 03:53:05,816 INFO [master/jenkins-hbase20:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-12 03:53:05,816 INFO [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-12 03:53:05,817 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,40099,1676173981406-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-12 03:53:05,818 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,40099,1676173981406-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-12 03:53:05,828 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-12 03:53:05,905 DEBUG [Listener at localhost.localdomain/41049] zookeeper.ReadOnlyZKClient(139): Connect 0x11ea4006 to 127.0.0.1:59556 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 03:53:05,911 DEBUG [Listener at localhost.localdomain/41049] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4e84ba3d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 03:53:05,922 DEBUG [hconnection-0x131f5260-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-12 03:53:05,932 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:58634, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-12 03:53:05,940 INFO [Listener at localhost.localdomain/41049] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase20.apache.org,40099,1676173981406 2023-02-12 03:53:05,941 DEBUG [Listener at localhost.localdomain/41049] zookeeper.ReadOnlyZKClient(139): Connect 0x1f820396 to 127.0.0.1:59556 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 03:53:05,945 DEBUG [Listener at localhost.localdomain/41049] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@10204f91, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 03:53:05,945 INFO [Listener at localhost.localdomain/41049] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 03:53:05,974 INFO [Listener at localhost.localdomain/41049] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthly Thread=211, OpenFileDescriptor=475, MaxFileDescriptor=60000, SystemLoadAverage=416, ProcessCount=164, AvailableMemoryMB=4635 2023-02-12 03:53:05,985 DEBUG [Listener at localhost.localdomain/41049] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-12 03:53:05,995 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:45510, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-12 03:53:06,009 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.HMaster$4(2102): Client=jenkins//148.251.75.209 create 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-02-12 03:53:06,012 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:06,014 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_PRE_OPERATION 2023-02-12 03:53:06,038 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-12 03:53:06,043 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(697): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthly" procId is: 9 2023-02-12 03:53:06,044 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/347ac77f0d77b4a83b4ec30d49737288 2023-02-12 03:53:06,045 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/347ac77f0d77b4a83b4ec30d49737288 empty. 2023-02-12 03:53:06,049 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/347ac77f0d77b4a83b4ec30d49737288 2023-02-12 03:53:06,049 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthly regions 2023-02-12 03:53:06,055 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(1227): Checking to see if procedure is done pid=9 2023-02-12 03:53:06,164 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(1227): Checking to see if procedure is done pid=9 2023-02-12 03:53:06,367 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(1227): Checking to see if procedure is done pid=9 2023-02-12 03:53:06,465 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000001 2023-02-12 03:53:06,468 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(7671): creating {ENCODED => 347ac77f0d77b4a83b4ec30d49737288, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1676173986005.347ac77f0d77b4a83b4ec30d49737288.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/.tmp 2023-02-12 03:53:06,668 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(1227): Checking to see if procedure is done pid=9 2023-02-12 03:53:06,883 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1676173986005.347ac77f0d77b4a83b4ec30d49737288.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:53:06,884 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1603): Closing 347ac77f0d77b4a83b4ec30d49737288, disabling compactions & flushes 2023-02-12 03:53:06,884 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1676173986005.347ac77f0d77b4a83b4ec30d49737288. 2023-02-12 03:53:06,884 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1676173986005.347ac77f0d77b4a83b4ec30d49737288. 2023-02-12 03:53:06,884 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1676173986005.347ac77f0d77b4a83b4ec30d49737288. after waiting 0 ms 2023-02-12 03:53:06,884 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1676173986005.347ac77f0d77b4a83b4ec30d49737288. 2023-02-12 03:53:06,884 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1676173986005.347ac77f0d77b4a83b4ec30d49737288. 2023-02-12 03:53:06,884 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1557): Region close journal for 347ac77f0d77b4a83b4ec30d49737288: Waiting for close lock at 1676173986884Disabling compacts and flushes for region at 1676173986884Disabling writes for close at 1676173986884Writing region close event to WAL at 1676173986884Closed at 1676173986884 2023-02-12 03:53:06,889 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_ADD_TO_META 2023-02-12 03:53:06,891 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1676173986005.347ac77f0d77b4a83b4ec30d49737288.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1676173986890"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676173986890"}]},"ts":"1676173986890"} 2023-02-12 03:53:06,893 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-12 03:53:06,895 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-12 03:53:06,895 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676173986895"}]},"ts":"1676173986895"} 2023-02-12 03:53:06,897 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthly, state=ENABLING in hbase:meta 2023-02-12 03:53:06,900 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=347ac77f0d77b4a83b4ec30d49737288, ASSIGN}] 2023-02-12 03:53:06,903 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=347ac77f0d77b4a83b4ec30d49737288, ASSIGN 2023-02-12 03:53:06,905 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=347ac77f0d77b4a83b4ec30d49737288, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,39639,1676173982450; forceNewPlan=false, retain=false 2023-02-12 03:53:07,056 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=347ac77f0d77b4a83b4ec30d49737288, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:07,057 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1676173986005.347ac77f0d77b4a83b4ec30d49737288.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1676173987056"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676173987056"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676173987056"}]},"ts":"1676173987056"} 2023-02-12 03:53:07,060 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 347ac77f0d77b4a83b4ec30d49737288, server=jenkins-hbase20.apache.org,39639,1676173982450}] 2023-02-12 03:53:07,170 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(1227): Checking to see if procedure is done pid=9 2023-02-12 03:53:07,218 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthly,,1676173986005.347ac77f0d77b4a83b4ec30d49737288. 2023-02-12 03:53:07,218 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 347ac77f0d77b4a83b4ec30d49737288, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1676173986005.347ac77f0d77b4a83b4ec30d49737288.', STARTKEY => '', ENDKEY => ''} 2023-02-12 03:53:07,219 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthly 347ac77f0d77b4a83b4ec30d49737288 2023-02-12 03:53:07,219 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1676173986005.347ac77f0d77b4a83b4ec30d49737288.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:53:07,219 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 347ac77f0d77b4a83b4ec30d49737288 2023-02-12 03:53:07,219 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 347ac77f0d77b4a83b4ec30d49737288 2023-02-12 03:53:07,222 INFO [StoreOpener-347ac77f0d77b4a83b4ec30d49737288-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 347ac77f0d77b4a83b4ec30d49737288 2023-02-12 03:53:07,224 DEBUG [StoreOpener-347ac77f0d77b4a83b4ec30d49737288-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/347ac77f0d77b4a83b4ec30d49737288/family1 2023-02-12 03:53:07,224 DEBUG [StoreOpener-347ac77f0d77b4a83b4ec30d49737288-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/347ac77f0d77b4a83b4ec30d49737288/family1 2023-02-12 03:53:07,227 INFO [StoreOpener-347ac77f0d77b4a83b4ec30d49737288-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 347ac77f0d77b4a83b4ec30d49737288 columnFamilyName family1 2023-02-12 03:53:07,230 INFO [StoreOpener-347ac77f0d77b4a83b4ec30d49737288-1] regionserver.HStore(310): Store=347ac77f0d77b4a83b4ec30d49737288/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:53:07,233 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/347ac77f0d77b4a83b4ec30d49737288 2023-02-12 03:53:07,234 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/347ac77f0d77b4a83b4ec30d49737288 2023-02-12 03:53:07,238 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 347ac77f0d77b4a83b4ec30d49737288 2023-02-12 03:53:07,241 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/347ac77f0d77b4a83b4ec30d49737288/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 03:53:07,242 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 347ac77f0d77b4a83b4ec30d49737288; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74609092, jitterRate=0.11176210641860962}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-12 03:53:07,243 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 347ac77f0d77b4a83b4ec30d49737288: Running coprocessor pre-open hook at 1676173987219Writing region info on filesystem at 1676173987219Initializing all the Stores at 1676173987220 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} at 1676173987221 (+1 ms)Cleaning up temporary data from old regions at 1676173987234 (+13 ms)Cleaning up detritus from prior splits at 1676173987235 (+1 ms)Running coprocessor post-open hooks at 1676173987242 (+7 ms)Region opened successfully at 1676173987243 (+1 ms) 2023-02-12 03:53:07,244 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthly,,1676173986005.347ac77f0d77b4a83b4ec30d49737288., pid=11, masterSystemTime=1676173987213 2023-02-12 03:53:07,247 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthly,,1676173986005.347ac77f0d77b4a83b4ec30d49737288. 2023-02-12 03:53:07,247 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthly,,1676173986005.347ac77f0d77b4a83b4ec30d49737288. 2023-02-12 03:53:07,247 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=347ac77f0d77b4a83b4ec30d49737288, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:07,249 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1676173986005.347ac77f0d77b4a83b4ec30d49737288.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1676173987247"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676173987247"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676173987247"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676173987247"}]},"ts":"1676173987247"} 2023-02-12 03:53:07,255 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-12 03:53:07,256 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 347ac77f0d77b4a83b4ec30d49737288, server=jenkins-hbase20.apache.org,39639,1676173982450 in 192 msec 2023-02-12 03:53:07,259 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-02-12 03:53:07,259 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=347ac77f0d77b4a83b4ec30d49737288, ASSIGN in 355 msec 2023-02-12 03:53:07,261 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-12 03:53:07,261 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676173987261"}]},"ts":"1676173987261"} 2023-02-12 03:53:07,264 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthly, state=ENABLED in hbase:meta 2023-02-12 03:53:07,267 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_POST_OPERATION 2023-02-12 03:53:07,269 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 1.2570 sec 2023-02-12 03:53:08,172 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(1227): Checking to see if procedure is done pid=9 2023-02-12 03:53:08,173 INFO [Listener at localhost.localdomain/41049] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthly, procId: 9 completed 2023-02-12 03:53:08,189 DEBUG [hconnection-0x4b85fd86-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-12 03:53:08,192 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:58638, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-12 03:53:08,347 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-12 03:53:08,355 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:08,355 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-12 03:53:08,356 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:53:08,356 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-02-12 03:53:08,356 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-02-12 03:53:08,357 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:08,357 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:08,358 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:53:08,358 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:08,358 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:53:08,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:53:08,358 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:08,358 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-12 03:53:08,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:08,359 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:08,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-12 03:53:08,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:08,360 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:08,362 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:08,362 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-02-12 03:53:08,362 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:53:08,363 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-02-12 03:53:08,364 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-12 03:53:08,364 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676173986005.347ac77f0d77b4a83b4ec30d49737288. 2023-02-12 03:53:08,364 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-12 03:53:08,365 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1676173986005.347ac77f0d77b4a83b4ec30d49737288. started... 2023-02-12 03:53:08,366 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 347ac77f0d77b4a83b4ec30d49737288 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-02-12 03:53:08,919 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511302309c0e2ffc742f8b37fe45033b36086 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511302309c0e2ffc742f8b37fe45033b36086 2023-02-12 03:53:09,339 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/347ac77f0d77b4a83b4ec30d49737288/.tmp/family1/a9c0bfa1e0a9496f95f4fec81256c56c 2023-02-12 03:53:09,350 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/347ac77f0d77b4a83b4ec30d49737288/.tmp/family1/a9c0bfa1e0a9496f95f4fec81256c56c as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/347ac77f0d77b4a83b4ec30d49737288/family1/a9c0bfa1e0a9496f95f4fec81256c56c 2023-02-12 03:53:09,359 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/347ac77f0d77b4a83b4ec30d49737288/family1/a9c0bfa1e0a9496f95f4fec81256c56c, entries=1000, sequenceid=5, filesize=175.8 K 2023-02-12 03:53:09,362 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 347ac77f0d77b4a83b4ec30d49737288 in 996ms, sequenceid=5, compaction requested=false 2023-02-12 03:53:09,364 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-12 03:53:09,367 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 347ac77f0d77b4a83b4ec30d49737288: 2023-02-12 03:53:09,367 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676173986005.347ac77f0d77b4a83b4ec30d49737288. 2023-02-12 03:53:09,367 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-12 03:53:09,368 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-12 03:53:09,368 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:09,368 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-02-12 03:53:09,368 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-02-12 03:53:09,370 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:09,370 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:09,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:09,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:53:09,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:53:09,370 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:09,370 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 03:53:09,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:53:09,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:53:09,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:09,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:09,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:53:09,372 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-02-12 03:53:09,372 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5103153[Count = 0] remaining members to acquire global barrier 2023-02-12 03:53:09,372 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-02-12 03:53:09,372 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:09,374 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:09,374 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:09,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:09,374 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-02-12 03:53:09,374 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-02-12 03:53:09,374 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase20.apache.org,39639,1676173982450' in zk 2023-02-12 03:53:09,374 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:09,374 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-12 03:53:09,376 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:09,376 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-02-12 03:53:09,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:09,376 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:53:09,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:53:09,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:53:09,376 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-02-12 03:53:09,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:53:09,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:53:09,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:09,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:09,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:53:09,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:09,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:09,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase20.apache.org,39639,1676173982450': 2023-02-12 03:53:09,379 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-02-12 03:53:09,379 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-02-12 03:53:09,379 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-12 03:53:09,380 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-12 03:53:09,380 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:09,380 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-12 03:53:09,389 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:09,389 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:09,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:09,389 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:53:09,389 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:09,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:53:09,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:53:09,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:09,390 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:09,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:53:09,390 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:53:09,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:53:09,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:09,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:09,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:53:09,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:09,392 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:09,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:09,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:53:09,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:09,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:09,400 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:09,400 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:53:09,400 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:09,400 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:53:09,400 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:53:09,400 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:53:09,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:53:09,400 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:09,400 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-12 03:53:09,401 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:09,401 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-12 03:53:09,401 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:09,401 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:09,401 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:09,401 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:53:09,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:53:09,403 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-02-12 03:53:09,403 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-12 03:53:09,503 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-12 03:53:09,509 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-12 03:53:09,523 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-12 03:53:09,526 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-02-12 03:53:09,527 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:09,527 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-12 03:53:09,527 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:53:09,528 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-02-12 03:53:09,528 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-02-12 03:53:09,529 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:09,529 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:09,530 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:53:09,530 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:09,530 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:53:09,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:53:09,531 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:09,531 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-12 03:53:09,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:09,531 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:09,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-12 03:53:09,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:09,532 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:09,532 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-02-12 03:53:09,532 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:09,532 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-02-12 03:53:09,532 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:53:09,533 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-02-12 03:53:09,533 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-12 03:53:09,533 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-12 03:53:09,533 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676173986005.347ac77f0d77b4a83b4ec30d49737288. 2023-02-12 03:53:09,533 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1676173986005.347ac77f0d77b4a83b4ec30d49737288. started... 2023-02-12 03:53:09,533 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 347ac77f0d77b4a83b4ec30d49737288 1/1 column families, dataSize=74 B heapSize=408 B 2023-02-12 03:53:09,963 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511287de89ad25965490d8ed9d4feb2310222 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511287de89ad25965490d8ed9d4feb2310222 2023-02-12 03:53:09,990 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-12 03:53:10,061 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-02-12 03:53:10,062 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-02-12 03:53:10,379 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/347ac77f0d77b4a83b4ec30d49737288/.tmp/family1/06dc1ab5dcfd4a9e9736c234ab0afed5 2023-02-12 03:53:10,391 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/347ac77f0d77b4a83b4ec30d49737288/.tmp/family1/06dc1ab5dcfd4a9e9736c234ab0afed5 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/347ac77f0d77b4a83b4ec30d49737288/family1/06dc1ab5dcfd4a9e9736c234ab0afed5 2023-02-12 03:53:10,402 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/347ac77f0d77b4a83b4ec30d49737288/family1/06dc1ab5dcfd4a9e9736c234ab0afed5, entries=1, sequenceid=9, filesize=5.0 K 2023-02-12 03:53:10,403 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 347ac77f0d77b4a83b4ec30d49737288 in 870ms, sequenceid=9, compaction requested=false 2023-02-12 03:53:10,403 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 347ac77f0d77b4a83b4ec30d49737288: 2023-02-12 03:53:10,403 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676173986005.347ac77f0d77b4a83b4ec30d49737288. 2023-02-12 03:53:10,403 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-12 03:53:10,404 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-12 03:53:10,404 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:10,404 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-02-12 03:53:10,404 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-02-12 03:53:10,406 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:10,406 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:10,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:10,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:53:10,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:53:10,406 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:10,406 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 03:53:10,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:53:10,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:53:10,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:10,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:10,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:53:10,408 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-02-12 03:53:10,408 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@65988a2f[Count = 0] remaining members to acquire global barrier 2023-02-12 03:53:10,408 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-02-12 03:53:10,408 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:10,409 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:10,409 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:10,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:10,409 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-02-12 03:53:10,409 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-02-12 03:53:10,409 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase20.apache.org,39639,1676173982450' in zk 2023-02-12 03:53:10,409 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:10,409 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-12 03:53:10,412 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-02-12 03:53:10,412 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:10,412 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:53:10,412 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-02-12 03:53:10,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:10,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:53:10,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:53:10,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:53:10,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:53:10,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:10,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:10,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:53:10,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:10,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:10,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase20.apache.org,39639,1676173982450': 2023-02-12 03:53:10,416 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-02-12 03:53:10,416 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-02-12 03:53:10,416 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-12 03:53:10,416 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-12 03:53:10,416 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:10,416 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-12 03:53:10,422 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:10,422 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:10,422 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:10,422 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:53:10,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:10,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:10,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:53:10,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:53:10,423 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:53:10,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:53:10,423 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:10,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:53:10,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:10,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:10,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:53:10,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:10,424 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:10,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:10,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:53:10,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:10,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:10,431 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:10,431 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:53:10,431 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:10,431 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:53:10,431 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-02-12 03:53:10,431 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:53:10,431 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:53:10,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:53:10,431 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-12 03:53:10,432 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-12 03:53:10,431 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:10,432 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:10,432 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:10,432 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:10,432 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:10,432 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:53:10,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:53:10,432 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-02-12 03:53:10,432 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-12 03:53:10,533 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-12 03:53:10,534 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-12 03:53:10,543 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-12 03:53:10,546 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-02-12 03:53:10,546 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:10,546 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-12 03:53:10,546 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:53:10,547 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-02-12 03:53:10,547 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-02-12 03:53:10,548 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:10,548 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:10,548 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:53:10,549 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:53:10,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:53:10,549 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:10,549 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:10,549 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-12 03:53:10,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:10,549 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:10,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-12 03:53:10,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:10,550 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:10,551 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-02-12 03:53:10,551 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:10,551 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-02-12 03:53:10,551 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:53:10,551 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-02-12 03:53:10,551 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-12 03:53:10,551 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-12 03:53:10,551 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676173986005.347ac77f0d77b4a83b4ec30d49737288. 2023-02-12 03:53:10,552 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1676173986005.347ac77f0d77b4a83b4ec30d49737288. started... 2023-02-12 03:53:10,552 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 347ac77f0d77b4a83b4ec30d49737288 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-12 03:53:10,579 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201a55a5ebeaff24f01b9711e7b00c8fb44 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151201a55a5ebeaff24f01b9711e7b00c8fb44 2023-02-12 03:53:10,591 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/347ac77f0d77b4a83b4ec30d49737288/.tmp/family1/1dd40832753f4a7a82ea0c0a7a723234 2023-02-12 03:53:10,600 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/347ac77f0d77b4a83b4ec30d49737288/.tmp/family1/1dd40832753f4a7a82ea0c0a7a723234 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/347ac77f0d77b4a83b4ec30d49737288/family1/1dd40832753f4a7a82ea0c0a7a723234 2023-02-12 03:53:10,607 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/347ac77f0d77b4a83b4ec30d49737288/family1/1dd40832753f4a7a82ea0c0a7a723234, entries=1, sequenceid=13, filesize=5.0 K 2023-02-12 03:53:10,608 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 347ac77f0d77b4a83b4ec30d49737288 in 56ms, sequenceid=13, compaction requested=true 2023-02-12 03:53:10,609 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 347ac77f0d77b4a83b4ec30d49737288: 2023-02-12 03:53:10,609 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676173986005.347ac77f0d77b4a83b4ec30d49737288. 2023-02-12 03:53:10,609 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-12 03:53:10,609 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-12 03:53:10,609 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:10,609 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-02-12 03:53:10,609 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-02-12 03:53:10,611 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:10,611 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:10,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:10,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:53:10,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:53:10,611 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:10,611 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 03:53:10,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:53:10,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:53:10,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:10,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:10,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:53:10,613 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-02-12 03:53:10,613 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3c91ce9b[Count = 0] remaining members to acquire global barrier 2023-02-12 03:53:10,613 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-02-12 03:53:10,613 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:10,614 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:10,614 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:10,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:10,614 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-02-12 03:53:10,614 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-02-12 03:53:10,614 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase20.apache.org,39639,1676173982450' in zk 2023-02-12 03:53:10,614 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:10,614 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-12 03:53:10,615 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-02-12 03:53:10,615 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:10,615 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:53:10,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:10,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:53:10,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:53:10,615 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-02-12 03:53:10,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:53:10,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:53:10,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:10,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:10,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:53:10,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:10,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:10,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase20.apache.org,39639,1676173982450': 2023-02-12 03:53:10,618 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-02-12 03:53:10,618 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-02-12 03:53:10,618 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-12 03:53:10,618 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-12 03:53:10,618 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:10,618 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-12 03:53:10,622 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:10,622 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:10,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:10,622 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:10,622 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:53:10,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:10,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:53:10,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:53:10,623 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:53:10,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:53:10,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:53:10,623 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:10,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:10,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:10,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:53:10,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:10,625 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:10,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:10,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:53:10,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:10,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:10,630 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:10,630 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:53:10,630 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:10,630 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:53:10,630 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:53:10,631 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-12 03:53:10,631 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-12 03:53:10,631 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-02-12 03:53:10,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:53:10,631 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:53:10,630 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:10,631 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:10,631 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:10,632 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:10,632 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-02-12 03:53:10,632 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:53:10,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:53:10,632 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:10,632 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-12 03:53:10,732 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-12 03:53:10,735 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-12 03:53:10,749 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-12 03:53:10,751 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-02-12 03:53:10,751 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:10,751 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-12 03:53:10,751 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:53:10,752 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-02-12 03:53:10,752 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-02-12 03:53:10,753 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:10,753 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:10,753 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:53:10,754 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:53:10,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:53:10,754 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:10,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:10,754 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:10,754 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-12 03:53:10,754 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:10,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-12 03:53:10,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:10,755 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:10,755 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-02-12 03:53:10,755 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:10,755 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-02-12 03:53:10,755 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:53:10,755 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-02-12 03:53:10,755 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-12 03:53:10,755 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-12 03:53:10,755 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676173986005.347ac77f0d77b4a83b4ec30d49737288. 2023-02-12 03:53:10,756 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1676173986005.347ac77f0d77b4a83b4ec30d49737288. started... 2023-02-12 03:53:10,756 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 347ac77f0d77b4a83b4ec30d49737288 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-12 03:53:11,184 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205c4ed9968f6124de0bf731004b2609fa4 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151205c4ed9968f6124de0bf731004b2609fa4 2023-02-12 03:53:11,219 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/347ac77f0d77b4a83b4ec30d49737288/.tmp/family1/2a640634b5e44e1986cb4b2b9325e6de 2023-02-12 03:53:11,228 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/347ac77f0d77b4a83b4ec30d49737288/.tmp/family1/2a640634b5e44e1986cb4b2b9325e6de as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/347ac77f0d77b4a83b4ec30d49737288/family1/2a640634b5e44e1986cb4b2b9325e6de 2023-02-12 03:53:11,238 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/347ac77f0d77b4a83b4ec30d49737288/family1/2a640634b5e44e1986cb4b2b9325e6de, entries=1, sequenceid=17, filesize=5.0 K 2023-02-12 03:53:11,240 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 347ac77f0d77b4a83b4ec30d49737288 in 484ms, sequenceid=17, compaction requested=true 2023-02-12 03:53:11,240 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 347ac77f0d77b4a83b4ec30d49737288: 2023-02-12 03:53:11,240 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676173986005.347ac77f0d77b4a83b4ec30d49737288. 2023-02-12 03:53:11,240 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-12 03:53:11,241 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-12 03:53:11,241 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:11,241 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-02-12 03:53:11,241 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-02-12 03:53:11,242 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:11,242 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:11,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:11,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:53:11,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:53:11,243 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:11,243 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 03:53:11,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:53:11,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:53:11,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:11,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:11,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:53:11,245 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-02-12 03:53:11,245 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@968f97e[Count = 0] remaining members to acquire global barrier 2023-02-12 03:53:11,245 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-02-12 03:53:11,245 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:11,246 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:11,246 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:11,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:11,246 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-02-12 03:53:11,246 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-02-12 03:53:11,246 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase20.apache.org,39639,1676173982450' in zk 2023-02-12 03:53:11,246 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:11,246 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-12 03:53:11,247 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-02-12 03:53:11,247 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:11,247 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:53:11,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:11,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:53:11,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:53:11,247 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-02-12 03:53:11,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:53:11,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:53:11,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:11,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:11,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:53:11,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:11,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:11,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase20.apache.org,39639,1676173982450': 2023-02-12 03:53:11,251 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-02-12 03:53:11,251 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-02-12 03:53:11,251 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-12 03:53:11,251 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-12 03:53:11,251 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:11,252 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-12 03:53:11,253 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:11,253 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:53:11,253 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:11,253 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:11,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:11,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:53:11,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:53:11,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:11,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:53:11,254 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:53:11,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:53:11,254 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:11,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:11,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:11,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:53:11,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:11,256 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:11,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:11,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:53:11,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:11,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:11,262 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:53:11,262 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:11,262 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:53:11,262 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-02-12 03:53:11,262 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-12 03:53:11,263 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-12 03:53:11,262 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:11,262 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:53:11,262 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:53:11,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:53:11,263 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:11,263 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:11,263 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:11,263 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:11,263 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:11,263 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-02-12 03:53:11,264 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-12 03:53:11,264 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:53:11,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:53:11,364 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-12 03:53:11,366 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-12 03:53:11,379 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-12 03:53:11,382 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-02-12 03:53:11,382 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:11,382 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-12 03:53:11,382 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:53:11,382 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-02-12 03:53:11,382 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-02-12 03:53:11,383 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:11,383 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:11,384 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:53:11,384 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:11,384 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:53:11,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:53:11,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:11,385 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:11,385 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-12 03:53:11,385 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:11,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-12 03:53:11,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:11,385 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:11,386 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-02-12 03:53:11,386 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:11,386 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-02-12 03:53:11,386 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:53:11,386 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-02-12 03:53:11,386 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-12 03:53:11,386 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-12 03:53:11,386 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676173986005.347ac77f0d77b4a83b4ec30d49737288. 2023-02-12 03:53:11,387 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1676173986005.347ac77f0d77b4a83b4ec30d49737288. started... 2023-02-12 03:53:11,387 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 347ac77f0d77b4a83b4ec30d49737288 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-12 03:53:11,537 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-12 03:53:11,537 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-02-12 03:53:11,808 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512282dcbe5fcc4174f4d86fbab2d1a3e0353 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512282dcbe5fcc4174f4d86fbab2d1a3e0353 2023-02-12 03:53:12,221 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/347ac77f0d77b4a83b4ec30d49737288/.tmp/family1/b2f3ad0300e84c81969eb81131825ead 2023-02-12 03:53:12,230 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/347ac77f0d77b4a83b4ec30d49737288/.tmp/family1/b2f3ad0300e84c81969eb81131825ead as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/347ac77f0d77b4a83b4ec30d49737288/family1/b2f3ad0300e84c81969eb81131825ead 2023-02-12 03:53:12,239 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/347ac77f0d77b4a83b4ec30d49737288/family1/b2f3ad0300e84c81969eb81131825ead, entries=1, sequenceid=21, filesize=5.0 K 2023-02-12 03:53:12,240 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 347ac77f0d77b4a83b4ec30d49737288 in 853ms, sequenceid=21, compaction requested=true 2023-02-12 03:53:12,240 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 347ac77f0d77b4a83b4ec30d49737288: 2023-02-12 03:53:12,240 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676173986005.347ac77f0d77b4a83b4ec30d49737288. 2023-02-12 03:53:12,240 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-12 03:53:12,241 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-12 03:53:12,241 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:12,241 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-02-12 03:53:12,241 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-02-12 03:53:12,243 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:12,243 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:12,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:12,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:53:12,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:53:12,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:53:12,244 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:12,244 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 03:53:12,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:53:12,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:12,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:12,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:53:12,246 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-02-12 03:53:12,247 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@d76dba9[Count = 0] remaining members to acquire global barrier 2023-02-12 03:53:12,247 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-02-12 03:53:12,247 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:12,247 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:12,248 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:12,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:12,248 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-02-12 03:53:12,248 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-02-12 03:53:12,248 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase20.apache.org,39639,1676173982450' in zk 2023-02-12 03:53:12,248 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:12,248 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-12 03:53:12,249 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-02-12 03:53:12,249 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:53:12,249 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-02-12 03:53:12,250 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:12,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:12,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:53:12,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:53:12,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:53:12,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:53:12,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:12,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:12,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:53:12,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:12,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:12,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase20.apache.org,39639,1676173982450': 2023-02-12 03:53:12,254 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-02-12 03:53:12,254 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-02-12 03:53:12,254 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-12 03:53:12,254 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-12 03:53:12,254 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:12,254 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-12 03:53:12,272 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:12,272 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:12,272 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:12,272 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:53:12,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:12,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:12,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:53:12,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:53:12,273 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:53:12,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:53:12,273 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:12,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:53:12,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:12,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:12,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:53:12,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:12,274 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:12,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:12,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:53:12,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:12,280 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:53:12,280 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:53:12,280 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:53:12,281 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:12,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:53:12,281 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:12,281 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:12,281 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:12,281 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:12,281 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:12,281 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:12,281 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:53:12,282 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:53:12,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:53:12,282 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-02-12 03:53:12,284 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-12 03:53:12,284 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-12 03:53:12,285 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-02-12 03:53:12,285 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-12 03:53:12,385 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-12 03:53:12,387 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-12 03:53:12,399 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-12 03:53:12,402 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-02-12 03:53:12,402 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:12,402 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-12 03:53:12,402 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:53:12,403 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-02-12 03:53:12,403 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-02-12 03:53:12,403 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:12,404 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:12,404 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:53:12,404 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:12,405 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:53:12,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:53:12,405 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:12,405 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-12 03:53:12,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:12,411 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:12,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-12 03:53:12,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:12,412 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:12,419 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-02-12 03:53:12,419 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:12,419 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-02-12 03:53:12,419 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:53:12,420 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-02-12 03:53:12,420 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-12 03:53:12,420 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-12 03:53:12,420 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676173986005.347ac77f0d77b4a83b4ec30d49737288. 2023-02-12 03:53:12,420 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1676173986005.347ac77f0d77b4a83b4ec30d49737288. started... 2023-02-12 03:53:12,421 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 347ac77f0d77b4a83b4ec30d49737288 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-12 03:53:12,459 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231284e7091142f45549d743e7338a99064 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151231284e7091142f45549d743e7338a99064 2023-02-12 03:53:12,879 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/347ac77f0d77b4a83b4ec30d49737288/.tmp/family1/90e12e571c074cee8b4afa0b27d10121 2023-02-12 03:53:12,893 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/347ac77f0d77b4a83b4ec30d49737288/.tmp/family1/90e12e571c074cee8b4afa0b27d10121 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/347ac77f0d77b4a83b4ec30d49737288/family1/90e12e571c074cee8b4afa0b27d10121 2023-02-12 03:53:12,904 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/347ac77f0d77b4a83b4ec30d49737288/family1/90e12e571c074cee8b4afa0b27d10121, entries=1, sequenceid=25, filesize=5.0 K 2023-02-12 03:53:12,906 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 347ac77f0d77b4a83b4ec30d49737288 in 485ms, sequenceid=25, compaction requested=true 2023-02-12 03:53:12,906 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 347ac77f0d77b4a83b4ec30d49737288: 2023-02-12 03:53:12,907 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676173986005.347ac77f0d77b4a83b4ec30d49737288. 2023-02-12 03:53:12,907 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-12 03:53:12,907 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-12 03:53:12,907 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:12,907 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-02-12 03:53:12,907 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-02-12 03:53:12,909 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:12,909 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:12,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:12,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:53:12,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:53:12,909 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:12,909 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 03:53:12,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:53:12,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:53:12,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:12,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:12,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:53:12,910 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-02-12 03:53:12,911 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2c1ee1da[Count = 0] remaining members to acquire global barrier 2023-02-12 03:53:12,911 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-02-12 03:53:12,911 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:12,911 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:12,911 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:12,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:12,912 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-02-12 03:53:12,912 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:12,912 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-12 03:53:12,912 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-02-12 03:53:12,912 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase20.apache.org,39639,1676173982450' in zk 2023-02-12 03:53:12,913 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:12,913 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-02-12 03:53:12,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:12,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:53:12,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:53:12,913 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:53:12,913 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-02-12 03:53:12,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:53:12,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:53:12,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:12,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:12,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:53:12,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:12,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:12,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase20.apache.org,39639,1676173982450': 2023-02-12 03:53:12,916 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-02-12 03:53:12,916 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-02-12 03:53:12,916 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-12 03:53:12,916 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-12 03:53:12,916 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:12,916 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-12 03:53:12,923 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:12,923 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:12,923 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:12,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:12,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:12,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:53:12,923 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:53:12,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:53:12,923 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:53:12,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:53:12,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:53:12,924 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:12,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:12,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:12,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:53:12,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:12,925 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:12,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:12,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:53:12,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:12,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:12,928 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:12,928 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:53:12,928 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:12,928 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:53:12,928 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:12,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:53:12,929 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:53:12,929 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-12 03:53:12,929 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-12 03:53:12,928 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:53:12,929 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-02-12 03:53:12,929 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:12,929 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:53:12,929 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:12,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:53:12,930 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:12,930 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:12,930 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-02-12 03:53:12,930 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-12 03:53:13,030 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-12 03:53:13,032 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-12 03:53:13,042 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-12 03:53:13,046 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-02-12 03:53:13,046 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:13,046 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-12 03:53:13,046 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:53:13,047 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-02-12 03:53:13,047 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-02-12 03:53:13,048 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:13,048 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:13,049 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:53:13,049 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:13,049 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:53:13,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:53:13,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:13,049 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:13,049 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-12 03:53:13,050 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:13,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-12 03:53:13,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:13,051 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:13,051 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-02-12 03:53:13,051 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:13,051 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-02-12 03:53:13,051 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:53:13,052 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-02-12 03:53:13,052 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-12 03:53:13,052 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-12 03:53:13,052 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676173986005.347ac77f0d77b4a83b4ec30d49737288. 2023-02-12 03:53:13,052 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1676173986005.347ac77f0d77b4a83b4ec30d49737288. started... 2023-02-12 03:53:13,052 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 347ac77f0d77b4a83b4ec30d49737288 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-12 03:53:13,486 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101db0b7f282216473eba06b91020a8675b to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160101db0b7f282216473eba06b91020a8675b 2023-02-12 03:53:13,895 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/347ac77f0d77b4a83b4ec30d49737288/.tmp/family1/4ee83e1e5bbf42d5aec5c98d03d345d2 2023-02-12 03:53:13,905 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/347ac77f0d77b4a83b4ec30d49737288/.tmp/family1/4ee83e1e5bbf42d5aec5c98d03d345d2 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/347ac77f0d77b4a83b4ec30d49737288/family1/4ee83e1e5bbf42d5aec5c98d03d345d2 2023-02-12 03:53:13,918 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/347ac77f0d77b4a83b4ec30d49737288/family1/4ee83e1e5bbf42d5aec5c98d03d345d2, entries=1, sequenceid=29, filesize=5.0 K 2023-02-12 03:53:13,920 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 347ac77f0d77b4a83b4ec30d49737288 in 868ms, sequenceid=29, compaction requested=true 2023-02-12 03:53:13,921 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 347ac77f0d77b4a83b4ec30d49737288: 2023-02-12 03:53:13,921 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676173986005.347ac77f0d77b4a83b4ec30d49737288. 2023-02-12 03:53:13,921 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-12 03:53:13,922 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-12 03:53:13,922 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:13,922 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-02-12 03:53:13,922 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-02-12 03:53:13,924 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:13,924 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:13,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:13,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:53:13,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:53:13,924 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:13,924 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 03:53:13,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:53:13,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:53:13,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:13,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:13,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:53:13,925 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-02-12 03:53:13,926 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1e4907d4[Count = 0] remaining members to acquire global barrier 2023-02-12 03:53:13,926 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-02-12 03:53:13,926 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:13,926 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:13,926 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:13,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:13,927 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-02-12 03:53:13,927 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-02-12 03:53:13,927 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase20.apache.org,39639,1676173982450' in zk 2023-02-12 03:53:13,927 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:13,927 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-12 03:53:13,927 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-02-12 03:53:13,927 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:13,928 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:53:13,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:13,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:53:13,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:53:13,928 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-02-12 03:53:13,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:53:13,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:53:13,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:13,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:13,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:53:13,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:13,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:13,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase20.apache.org,39639,1676173982450': 2023-02-12 03:53:13,930 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-02-12 03:53:13,930 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-02-12 03:53:13,930 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-12 03:53:13,930 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-12 03:53:13,930 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:13,930 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-12 03:53:13,932 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:13,932 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:13,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:13,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:53:13,932 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:13,932 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:53:13,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:13,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:53:13,932 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:13,932 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:53:13,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:53:13,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:53:13,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:13,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:13,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:53:13,933 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:13,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:13,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:13,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:53:13,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:13,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:13,936 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:13,936 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:13,936 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:53:13,936 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:13,936 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:53:13,936 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:13,936 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-12 03:53:13,937 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-12 03:53:13,936 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:53:13,937 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-02-12 03:53:13,936 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:53:13,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:53:13,936 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:13,937 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:13,937 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:13,937 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-02-12 03:53:13,937 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-12 03:53:13,937 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:53:13,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:53:14,037 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-12 03:53:14,039 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-12 03:53:14,049 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-12 03:53:14,053 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-02-12 03:53:14,053 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:14,053 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-12 03:53:14,054 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:53:14,054 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-02-12 03:53:14,054 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-02-12 03:53:14,055 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:14,055 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:14,056 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:14,056 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:53:14,056 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:53:14,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:53:14,056 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:14,056 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-12 03:53:14,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:14,057 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:14,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-12 03:53:14,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:14,058 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:14,058 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-02-12 03:53:14,058 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:14,058 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-02-12 03:53:14,058 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:53:14,059 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-02-12 03:53:14,059 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-12 03:53:14,059 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-12 03:53:14,059 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676173986005.347ac77f0d77b4a83b4ec30d49737288. 2023-02-12 03:53:14,059 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1676173986005.347ac77f0d77b4a83b4ec30d49737288. started... 2023-02-12 03:53:14,059 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 347ac77f0d77b4a83b4ec30d49737288 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-12 03:53:14,483 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010324f7458cee004b9e8502c94a3ee8e62f to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2016010324f7458cee004b9e8502c94a3ee8e62f 2023-02-12 03:53:14,492 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/347ac77f0d77b4a83b4ec30d49737288/.tmp/family1/41214efaf17946ccbe76e612554f82e2 2023-02-12 03:53:14,501 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/347ac77f0d77b4a83b4ec30d49737288/.tmp/family1/41214efaf17946ccbe76e612554f82e2 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/347ac77f0d77b4a83b4ec30d49737288/family1/41214efaf17946ccbe76e612554f82e2 2023-02-12 03:53:14,507 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/347ac77f0d77b4a83b4ec30d49737288/family1/41214efaf17946ccbe76e612554f82e2, entries=1, sequenceid=33, filesize=5.0 K 2023-02-12 03:53:14,508 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 347ac77f0d77b4a83b4ec30d49737288 in 449ms, sequenceid=33, compaction requested=true 2023-02-12 03:53:14,509 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 347ac77f0d77b4a83b4ec30d49737288: 2023-02-12 03:53:14,509 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676173986005.347ac77f0d77b4a83b4ec30d49737288. 2023-02-12 03:53:14,509 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-12 03:53:14,509 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-12 03:53:14,509 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:14,509 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-02-12 03:53:14,509 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-02-12 03:53:14,510 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:14,510 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:14,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:14,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:53:14,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:53:14,511 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:14,511 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 03:53:14,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:53:14,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:53:14,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:14,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:14,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:53:14,512 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-02-12 03:53:14,512 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5024ae6a[Count = 0] remaining members to acquire global barrier 2023-02-12 03:53:14,512 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-02-12 03:53:14,512 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:14,513 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:14,513 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:14,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:14,513 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-02-12 03:53:14,513 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-02-12 03:53:14,513 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase20.apache.org,39639,1676173982450' in zk 2023-02-12 03:53:14,513 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:14,513 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-12 03:53:14,514 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-02-12 03:53:14,514 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:14,514 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:53:14,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:14,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:53:14,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:53:14,514 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-02-12 03:53:14,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:53:14,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:53:14,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:14,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:14,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:53:14,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:14,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:14,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase20.apache.org,39639,1676173982450': 2023-02-12 03:53:14,517 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-02-12 03:53:14,517 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-02-12 03:53:14,517 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-12 03:53:14,517 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-12 03:53:14,517 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:14,517 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-12 03:53:14,520 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:14,520 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:53:14,520 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:14,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:14,520 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:14,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:14,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:53:14,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:53:14,520 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:53:14,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:53:14,520 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:14,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:53:14,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:14,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:14,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:53:14,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:14,522 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:14,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:14,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:53:14,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:14,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:14,524 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:14,524 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:14,524 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:14,524 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:53:14,524 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:14,524 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:53:14,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:53:14,524 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-12 03:53:14,524 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-12 03:53:14,524 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:53:14,524 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-02-12 03:53:14,524 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:53:14,524 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:14,525 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:14,525 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:14,525 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-02-12 03:53:14,526 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-12 03:53:14,526 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:53:14,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:53:14,626 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-12 03:53:14,628 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-12 03:53:14,640 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-12 03:53:14,644 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-02-12 03:53:14,644 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:14,644 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-12 03:53:14,644 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:53:14,645 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-02-12 03:53:14,645 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-02-12 03:53:14,646 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:14,646 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:14,647 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:14,647 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:53:14,647 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:53:14,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:53:14,647 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:14,647 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-12 03:53:14,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:14,648 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:14,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-12 03:53:14,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:14,648 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:14,649 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-02-12 03:53:14,649 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:14,650 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-02-12 03:53:14,650 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:53:14,650 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-02-12 03:53:14,650 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-12 03:53:14,650 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-12 03:53:14,650 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676173986005.347ac77f0d77b4a83b4ec30d49737288. 2023-02-12 03:53:14,650 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1676173986005.347ac77f0d77b4a83b4ec30d49737288. started... 2023-02-12 03:53:14,650 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 347ac77f0d77b4a83b4ec30d49737288 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-12 03:53:15,076 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015090751d2a16009ce4565a32760db48cc72d0 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015090751d2a16009ce4565a32760db48cc72d0 2023-02-12 03:53:15,488 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/347ac77f0d77b4a83b4ec30d49737288/.tmp/family1/ada21dca7828436ebcca355883fdb7ce 2023-02-12 03:53:15,499 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/347ac77f0d77b4a83b4ec30d49737288/.tmp/family1/ada21dca7828436ebcca355883fdb7ce as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/347ac77f0d77b4a83b4ec30d49737288/family1/ada21dca7828436ebcca355883fdb7ce 2023-02-12 03:53:15,505 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/347ac77f0d77b4a83b4ec30d49737288/family1/ada21dca7828436ebcca355883fdb7ce, entries=1, sequenceid=37, filesize=5.0 K 2023-02-12 03:53:15,506 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 347ac77f0d77b4a83b4ec30d49737288 in 856ms, sequenceid=37, compaction requested=true 2023-02-12 03:53:15,507 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 347ac77f0d77b4a83b4ec30d49737288: 2023-02-12 03:53:15,507 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676173986005.347ac77f0d77b4a83b4ec30d49737288. 2023-02-12 03:53:15,507 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-12 03:53:15,507 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-12 03:53:15,507 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:15,507 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-02-12 03:53:15,507 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-02-12 03:53:15,509 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:15,509 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:15,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:15,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:53:15,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:53:15,509 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:15,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:53:15,509 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 03:53:15,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:53:15,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:15,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:15,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:53:15,511 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-02-12 03:53:15,511 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6b348c54[Count = 0] remaining members to acquire global barrier 2023-02-12 03:53:15,511 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-02-12 03:53:15,511 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:15,512 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:15,512 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:15,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:15,512 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-02-12 03:53:15,512 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-02-12 03:53:15,512 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase20.apache.org,39639,1676173982450' in zk 2023-02-12 03:53:15,512 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:15,512 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-12 03:53:15,513 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:15,513 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-02-12 03:53:15,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:15,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:53:15,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:53:15,513 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:53:15,513 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-02-12 03:53:15,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:53:15,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:53:15,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:15,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:15,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:53:15,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:15,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:15,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase20.apache.org,39639,1676173982450': 2023-02-12 03:53:15,516 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-02-12 03:53:15,516 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-02-12 03:53:15,516 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-12 03:53:15,516 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-12 03:53:15,516 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:15,516 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-12 03:53:15,517 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:15,517 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:15,517 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:15,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:15,517 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:53:15,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:15,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:53:15,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:53:15,517 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:53:15,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:53:15,517 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:15,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:53:15,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:15,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:15,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:53:15,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:15,518 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:15,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:15,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:53:15,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:15,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:15,520 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:15,520 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:53:15,520 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:15,520 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:53:15,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:53:15,520 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:53:15,520 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:15,520 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-02-12 03:53:15,520 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-12 03:53:15,520 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-12 03:53:15,520 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:53:15,520 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:53:15,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:53:15,520 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:15,521 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:15,521 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:15,521 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:15,521 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-02-12 03:53:15,521 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-12 03:53:15,621 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-12 03:53:15,623 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-12 03:53:15,633 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-12 03:53:15,635 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-02-12 03:53:15,636 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:15,636 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-12 03:53:15,636 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:53:15,636 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-02-12 03:53:15,636 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-02-12 03:53:15,637 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:15,637 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:15,638 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:15,638 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:53:15,638 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:53:15,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:53:15,638 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:15,638 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-12 03:53:15,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:15,638 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:15,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-12 03:53:15,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:15,639 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:15,639 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-02-12 03:53:15,639 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:15,639 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-02-12 03:53:15,639 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:53:15,640 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-02-12 03:53:15,641 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-12 03:53:15,641 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-12 03:53:15,641 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676173986005.347ac77f0d77b4a83b4ec30d49737288. 2023-02-12 03:53:15,641 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1676173986005.347ac77f0d77b4a83b4ec30d49737288. started... 2023-02-12 03:53:15,641 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 347ac77f0d77b4a83b4ec30d49737288 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-12 03:53:15,668 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120b8dbada875f64851833d6d81e905cbaa to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151120b8dbada875f64851833d6d81e905cbaa 2023-02-12 03:53:16,096 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/347ac77f0d77b4a83b4ec30d49737288/.tmp/family1/fde4f01dd1914b8cb58e6403ca07b90d 2023-02-12 03:53:16,109 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/347ac77f0d77b4a83b4ec30d49737288/.tmp/family1/fde4f01dd1914b8cb58e6403ca07b90d as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/347ac77f0d77b4a83b4ec30d49737288/family1/fde4f01dd1914b8cb58e6403ca07b90d 2023-02-12 03:53:16,116 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/347ac77f0d77b4a83b4ec30d49737288/family1/fde4f01dd1914b8cb58e6403ca07b90d, entries=1, sequenceid=41, filesize=5.0 K 2023-02-12 03:53:16,117 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 347ac77f0d77b4a83b4ec30d49737288 in 476ms, sequenceid=41, compaction requested=true 2023-02-12 03:53:16,117 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 347ac77f0d77b4a83b4ec30d49737288: 2023-02-12 03:53:16,117 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1676173986005.347ac77f0d77b4a83b4ec30d49737288. 2023-02-12 03:53:16,117 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-12 03:53:16,118 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-12 03:53:16,118 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:16,118 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-02-12 03:53:16,118 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-02-12 03:53:16,119 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:16,119 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:16,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:16,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:53:16,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:53:16,119 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:16,119 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 03:53:16,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:53:16,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:53:16,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:16,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:16,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:53:16,121 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-02-12 03:53:16,121 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@307fa0d9[Count = 0] remaining members to acquire global barrier 2023-02-12 03:53:16,121 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-02-12 03:53:16,121 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:16,123 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:16,123 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:16,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:16,123 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-02-12 03:53:16,123 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-02-12 03:53:16,123 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase20.apache.org,39639,1676173982450' in zk 2023-02-12 03:53:16,123 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:16,123 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-12 03:53:16,124 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:16,124 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-02-12 03:53:16,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:16,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:53:16,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:53:16,124 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:53:16,125 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-02-12 03:53:16,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:53:16,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:53:16,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:16,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:16,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:53:16,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:16,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:16,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase20.apache.org,39639,1676173982450': 2023-02-12 03:53:16,128 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-02-12 03:53:16,128 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-02-12 03:53:16,128 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-12 03:53:16,128 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-12 03:53:16,128 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:16,128 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-12 03:53:16,129 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:16,129 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:16,129 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:53:16,129 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:16,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:16,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:53:16,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:53:16,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:16,131 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:16,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:53:16,133 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:53:16,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:53:16,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:16,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:16,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:53:16,134 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:16,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:16,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:16,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:53:16,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:16,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:16,136 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:16,136 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:53:16,136 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:16,136 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:53:16,136 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:53:16,136 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:53:16,136 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-12 03:53:16,136 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-12 03:53:16,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:53:16,136 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:16,136 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:16,136 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:16,136 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:16,136 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:16,136 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-02-12 03:53:16,137 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:53:16,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:53:16,137 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-02-12 03:53:16,137 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-12 03:53:16,237 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-12 03:53:16,239 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-12 03:53:16,248 DEBUG [Listener at localhost.localdomain/41049] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-12 03:53:16,251 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:57502, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-12 03:53:16,252 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=40099] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:16,264 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676173985818] procedure2.ProcedureExecutor(1029): Stored pid=12, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-02-12 03:53:16,264 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=12, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-02-12 03:53:16,266 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676173985818] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-12 03:53:16,266 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=12, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1676174596266 2023-02-12 03:53:16,267 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676173985818] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-12 03:53:16,271 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676173985818] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthly' and column 'family1' 2023-02-12 03:53:16,271 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676173985818] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-02-12 03:53:16,272 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676173985818] zookeeper.ReadOnlyZKClient(139): Connect 0x67ee259c to 127.0.0.1:59556 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 03:53:16,277 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676173985818] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1c612155, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 03:53:16,278 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-12 03:53:17,149 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103b0aae59222bd4983996a7e2bfca0e095 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160103b0aae59222bd4983996a7e2bfca0e095 2023-02-12 03:53:17,150 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-02-12 03:53:17,167 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-12 03:53:17,169 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:57146, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-12 03:53:17,179 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-12 03:53:17,181 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:57514, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-12 03:53:17,218 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/1e2d8f1409ec4b32a44085b14567e484 first=Optional[r3] last=Optional[r6] 2023-02-12 03:53:17,229 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1676173986005.347ac77f0d77b4a83b4ec30d49737288., hostname=jenkins-hbase20.apache.org,39639,1676173982450, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/1e2d8f1409ec4b32a44085b14567e484}] 2023-02-12 03:53:17,242 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/1e2d8f1409ec4b32a44085b14567e484 for inclusion in 347ac77f0d77b4a83b4ec30d49737288/family1 2023-02-12 03:53:17,249 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-02-12 03:53:17,249 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HStore(777): Region bounds: first= last= 2023-02-12 03:53:17,249 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HRegion(2445): Flush status journal for 347ac77f0d77b4a83b4ec30d49737288: 2023-02-12 03:53:17,250 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/1e2d8f1409ec4b32a44085b14567e484 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__5lhmbdndvd54qhgrtjsmf7hp4jf9ingnafcn0slmudmcqjnd9qsoq46vnlrq74f2/family1/1e2d8f1409ec4b32a44085b14567e484 2023-02-12 03:53:17,253 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__5lhmbdndvd54qhgrtjsmf7hp4jf9ingnafcn0slmudmcqjnd9qsoq46vnlrq74f2/family1/1e2d8f1409ec4b32a44085b14567e484 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/347ac77f0d77b4a83b4ec30d49737288/family1/4a7e217b78854fd4bfa7eacec393bc98_SeqId_44_ 2023-02-12 03:53:17,254 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__5lhmbdndvd54qhgrtjsmf7hp4jf9ingnafcn0slmudmcqjnd9qsoq46vnlrq74f2/family1/1e2d8f1409ec4b32a44085b14567e484 into 347ac77f0d77b4a83b4ec30d49737288/family1 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/347ac77f0d77b4a83b4ec30d49737288/family1/4a7e217b78854fd4bfa7eacec393bc98_SeqId_44_ - updating store file list. 2023-02-12 03:53:17,261 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/347ac77f0d77b4a83b4ec30d49737288/family1/4a7e217b78854fd4bfa7eacec393bc98_SeqId_44_ into 347ac77f0d77b4a83b4ec30d49737288/family1 2023-02-12 03:53:17,261 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__5lhmbdndvd54qhgrtjsmf7hp4jf9ingnafcn0slmudmcqjnd9qsoq46vnlrq74f2/family1/1e2d8f1409ec4b32a44085b14567e484 into 347ac77f0d77b4a83b4ec30d49737288/family1 (new location: hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/347ac77f0d77b4a83b4ec30d49737288/family1/4a7e217b78854fd4bfa7eacec393bc98_SeqId_44_) 2023-02-12 03:53:17,262 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__5lhmbdndvd54qhgrtjsmf7hp4jf9ingnafcn0slmudmcqjnd9qsoq46vnlrq74f2/family1/1e2d8f1409ec4b32a44085b14567e484 2023-02-12 03:53:17,264 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-02-12 03:53:17,269 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51357 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-02-12 03:53:17,270 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HStore(1912): 347ac77f0d77b4a83b4ec30d49737288/family1 is initiating minor compaction 2023-02-12 03:53:17,271 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@6c46bdd5; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-12 03:53:17,271 INFO [RS:0;jenkins-hbase20:39639-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 347ac77f0d77b4a83b4ec30d49737288/family1 in testMajorCompactionWithWeeklyFollowedByMonthly,,1676173986005.347ac77f0d77b4a83b4ec30d49737288. 2023-02-12 03:53:17,272 INFO [RS:0;jenkins-hbase20:39639-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/347ac77f0d77b4a83b4ec30d49737288/family1/06dc1ab5dcfd4a9e9736c234ab0afed5, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/347ac77f0d77b4a83b4ec30d49737288/family1/1dd40832753f4a7a82ea0c0a7a723234, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/347ac77f0d77b4a83b4ec30d49737288/family1/2a640634b5e44e1986cb4b2b9325e6de, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/347ac77f0d77b4a83b4ec30d49737288/family1/b2f3ad0300e84c81969eb81131825ead, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/347ac77f0d77b4a83b4ec30d49737288/family1/90e12e571c074cee8b4afa0b27d10121, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/347ac77f0d77b4a83b4ec30d49737288/family1/4ee83e1e5bbf42d5aec5c98d03d345d2, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/347ac77f0d77b4a83b4ec30d49737288/family1/41214efaf17946ccbe76e612554f82e2, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/347ac77f0d77b4a83b4ec30d49737288/family1/ada21dca7828436ebcca355883fdb7ce, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/347ac77f0d77b4a83b4ec30d49737288/family1/fde4f01dd1914b8cb58e6403ca07b90d, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/347ac77f0d77b4a83b4ec30d49737288/family1/4a7e217b78854fd4bfa7eacec393bc98_SeqId_44_] into tmpdir=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/347ac77f0d77b4a83b4ec30d49737288/.tmp, totalSize=50.2 K 2023-02-12 03:53:17,273 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] compactions.Compactor(207): Compacting 06dc1ab5dcfd4a9e9736c234ab0afed5, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-02-12 03:53:17,273 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] compactions.Compactor(207): Compacting 1dd40832753f4a7a82ea0c0a7a723234, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-02-12 03:53:17,273 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] compactions.Compactor(207): Compacting 2a640634b5e44e1986cb4b2b9325e6de, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-02-12 03:53:17,273 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] compactions.Compactor(207): Compacting b2f3ad0300e84c81969eb81131825ead, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-02-12 03:53:17,273 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] compactions.Compactor(207): Compacting 90e12e571c074cee8b4afa0b27d10121, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-02-12 03:53:17,273 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] compactions.Compactor(207): Compacting 4ee83e1e5bbf42d5aec5c98d03d345d2, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-02-12 03:53:17,273 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] compactions.Compactor(207): Compacting 41214efaf17946ccbe76e612554f82e2, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-02-12 03:53:17,273 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] compactions.Compactor(207): Compacting ada21dca7828436ebcca355883fdb7ce, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-02-12 03:53:17,274 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] compactions.Compactor(207): Compacting fde4f01dd1914b8cb58e6403ca07b90d, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-02-12 03:53:17,274 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] compactions.Compactor(207): Compacting 4a7e217b78854fd4bfa7eacec393bc98_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-02-12 03:53:17,287 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-02-12 03:53:17,290 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-12 03:53:17,297 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512282dcbe5fcc4174f4d86fbab2d1a3e0353 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512282dcbe5fcc4174f4d86fbab2d1a3e0353 2023-02-12 03:53:17,300 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151231284e7091142f45549d743e7338a99064 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151231284e7091142f45549d743e7338a99064 2023-02-12 03:53:17,304 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160101db0b7f282216473eba06b91020a8675b to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160101db0b7f282216473eba06b91020a8675b 2023-02-12 03:53:17,306 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2016010324f7458cee004b9e8502c94a3ee8e62f to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2016010324f7458cee004b9e8502c94a3ee8e62f 2023-02-12 03:53:17,306 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 4 expired mob files are deleted 2023-02-12 03:53:17,306 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-02-12 03:53:17,307 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-12 03:53:17,307 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-12 03:53:17,307 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-12 03:53:17,307 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-12 03:53:17,307 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-12 03:53:17,307 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-12 03:53:17,307 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-12 03:53:17,307 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-12 03:53:17,390 INFO [RS:0;jenkins-hbase20:39639-shortCompactions-0] throttle.PressureAwareThroughputController(145): 347ac77f0d77b4a83b4ec30d49737288#family1#compaction#10 average throughput is 0.21 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-12 03:53:17,491 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205fbe29adeb3bf414ebb5c28705f522cb9 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151205fbe29adeb3bf414ebb5c28705f522cb9 2023-02-12 03:53:17,493 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-02-12 03:53:17,530 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/d9b5591e125f4e9a8d8c761840488284 first=Optional[r00] last=Optional[r2] 2023-02-12 03:53:17,531 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1676173986005.347ac77f0d77b4a83b4ec30d49737288., hostname=jenkins-hbase20.apache.org,39639,1676173982450, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/d9b5591e125f4e9a8d8c761840488284}] 2023-02-12 03:53:17,534 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/d9b5591e125f4e9a8d8c761840488284 for inclusion in 347ac77f0d77b4a83b4ec30d49737288/family1 2023-02-12 03:53:17,537 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-02-12 03:53:17,537 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HStore(777): Region bounds: first= last= 2023-02-12 03:53:17,537 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HRegion(2445): Flush status journal for 347ac77f0d77b4a83b4ec30d49737288: 2023-02-12 03:53:17,539 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/d9b5591e125f4e9a8d8c761840488284 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__o22ba8q0lk5pbghg37ok0jivaq0s171nesvl2822qo1ff8bnnb13evtkjk509rt4/family1/d9b5591e125f4e9a8d8c761840488284 2023-02-12 03:53:17,542 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__o22ba8q0lk5pbghg37ok0jivaq0s171nesvl2822qo1ff8bnnb13evtkjk509rt4/family1/d9b5591e125f4e9a8d8c761840488284 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/347ac77f0d77b4a83b4ec30d49737288/family1/405fd09a6eb6439d8914c54bee2f508a_SeqId_46_ 2023-02-12 03:53:17,543 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__o22ba8q0lk5pbghg37ok0jivaq0s171nesvl2822qo1ff8bnnb13evtkjk509rt4/family1/d9b5591e125f4e9a8d8c761840488284 into 347ac77f0d77b4a83b4ec30d49737288/family1 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/347ac77f0d77b4a83b4ec30d49737288/family1/405fd09a6eb6439d8914c54bee2f508a_SeqId_46_ - updating store file list. 2023-02-12 03:53:17,549 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/347ac77f0d77b4a83b4ec30d49737288/family1/405fd09a6eb6439d8914c54bee2f508a_SeqId_46_ into 347ac77f0d77b4a83b4ec30d49737288/family1 2023-02-12 03:53:17,549 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__o22ba8q0lk5pbghg37ok0jivaq0s171nesvl2822qo1ff8bnnb13evtkjk509rt4/family1/d9b5591e125f4e9a8d8c761840488284 into 347ac77f0d77b4a83b4ec30d49737288/family1 (new location: hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/347ac77f0d77b4a83b4ec30d49737288/family1/405fd09a6eb6439d8914c54bee2f508a_SeqId_46_) 2023-02-12 03:53:17,550 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__o22ba8q0lk5pbghg37ok0jivaq0s171nesvl2822qo1ff8bnnb13evtkjk509rt4/family1/d9b5591e125f4e9a8d8c761840488284 2023-02-12 03:53:17,553 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-02-12 03:53:17,554 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-12 03:53:17,556 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511302309c0e2ffc742f8b37fe45033b36086 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511302309c0e2ffc742f8b37fe45033b36086 2023-02-12 03:53:17,558 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151201a55a5ebeaff24f01b9711e7b00c8fb44 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151201a55a5ebeaff24f01b9711e7b00c8fb44 2023-02-12 03:53:17,560 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151205c4ed9968f6124de0bf731004b2609fa4 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151205c4ed9968f6124de0bf731004b2609fa4 2023-02-12 03:53:17,560 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 3 expired mob files are deleted 2023-02-12 03:53:17,560 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-02-12 03:53:17,561 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-12 03:53:17,561 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676173985818] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-02-12 03:53:17,562 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676173985818] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-12 03:53:17,562 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=12, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-02-12 03:53:17,564 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=12, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE in 1.3050 sec 2023-02-12 03:53:17,727 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.HMaster$12(2441): Client=jenkins//148.251.75.209 modify table testMajorCompactionWithWeeklyFollowedByMonthly from 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-02-12 03:53:17,735 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:18,149 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000002 2023-02-12 03:53:18,150 DEBUG [PEWorker-1] util.FSTableDescriptors(519): Deleted hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000001 2023-02-12 03:53:18,150 INFO [PEWorker-1] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000002 2023-02-12 03:53:18,155 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=14, ppid=13, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly}] 2023-02-12 03:53:18,171 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=347ac77f0d77b4a83b4ec30d49737288, REOPEN/MOVE}] 2023-02-12 03:53:18,173 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=347ac77f0d77b4a83b4ec30d49737288, REOPEN/MOVE 2023-02-12 03:53:18,174 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=347ac77f0d77b4a83b4ec30d49737288, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:18,175 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1676173986005.347ac77f0d77b4a83b4ec30d49737288.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1676173998174"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676173998174"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676173998174"}]},"ts":"1676173998174"} 2023-02-12 03:53:18,178 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE; CloseRegionProcedure 347ac77f0d77b4a83b4ec30d49737288, server=jenkins-hbase20.apache.org,39639,1676173982450}] 2023-02-12 03:53:18,231 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/347ac77f0d77b4a83b4ec30d49737288/.tmp/family1/605f28d0e22a462aa1d2275bdbe81919 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/347ac77f0d77b4a83b4ec30d49737288/family1/605f28d0e22a462aa1d2275bdbe81919 2023-02-12 03:53:18,244 INFO [RS:0;jenkins-hbase20:39639-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 347ac77f0d77b4a83b4ec30d49737288/family1 of 347ac77f0d77b4a83b4ec30d49737288 into 605f28d0e22a462aa1d2275bdbe81919(size=6.6 K), total size for store is 358.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-12 03:53:18,244 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 347ac77f0d77b4a83b4ec30d49737288: 2023-02-12 03:53:18,245 INFO [RS:0;jenkins-hbase20:39639-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthly,,1676173986005.347ac77f0d77b4a83b4ec30d49737288., storeName=family1, fileCount=10, fileSize=50.2 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.5 K), priority=2, time=1676173997269; duration=0sec 2023-02-12 03:53:18,246 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-12 03:53:18,258 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/347ac77f0d77b4a83b4ec30d49737288/family1/06dc1ab5dcfd4a9e9736c234ab0afed5, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/347ac77f0d77b4a83b4ec30d49737288/family1/1dd40832753f4a7a82ea0c0a7a723234, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/347ac77f0d77b4a83b4ec30d49737288/family1/2a640634b5e44e1986cb4b2b9325e6de, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/347ac77f0d77b4a83b4ec30d49737288/family1/b2f3ad0300e84c81969eb81131825ead, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/347ac77f0d77b4a83b4ec30d49737288/family1/90e12e571c074cee8b4afa0b27d10121, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/347ac77f0d77b4a83b4ec30d49737288/family1/4ee83e1e5bbf42d5aec5c98d03d345d2, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/347ac77f0d77b4a83b4ec30d49737288/family1/41214efaf17946ccbe76e612554f82e2, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/347ac77f0d77b4a83b4ec30d49737288/family1/ada21dca7828436ebcca355883fdb7ce, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/347ac77f0d77b4a83b4ec30d49737288/family1/fde4f01dd1914b8cb58e6403ca07b90d, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/347ac77f0d77b4a83b4ec30d49737288/family1/4a7e217b78854fd4bfa7eacec393bc98_SeqId_44_] to archive 2023-02-12 03:53:18,259 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-12 03:53:18,262 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/347ac77f0d77b4a83b4ec30d49737288/family1/06dc1ab5dcfd4a9e9736c234ab0afed5 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/347ac77f0d77b4a83b4ec30d49737288/family1/06dc1ab5dcfd4a9e9736c234ab0afed5 2023-02-12 03:53:18,264 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/347ac77f0d77b4a83b4ec30d49737288/family1/1dd40832753f4a7a82ea0c0a7a723234 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/347ac77f0d77b4a83b4ec30d49737288/family1/1dd40832753f4a7a82ea0c0a7a723234 2023-02-12 03:53:18,265 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/347ac77f0d77b4a83b4ec30d49737288/family1/2a640634b5e44e1986cb4b2b9325e6de to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/347ac77f0d77b4a83b4ec30d49737288/family1/2a640634b5e44e1986cb4b2b9325e6de 2023-02-12 03:53:18,267 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/347ac77f0d77b4a83b4ec30d49737288/family1/b2f3ad0300e84c81969eb81131825ead to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/347ac77f0d77b4a83b4ec30d49737288/family1/b2f3ad0300e84c81969eb81131825ead 2023-02-12 03:53:18,269 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/347ac77f0d77b4a83b4ec30d49737288/family1/90e12e571c074cee8b4afa0b27d10121 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/347ac77f0d77b4a83b4ec30d49737288/family1/90e12e571c074cee8b4afa0b27d10121 2023-02-12 03:53:18,270 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/347ac77f0d77b4a83b4ec30d49737288/family1/4ee83e1e5bbf42d5aec5c98d03d345d2 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/347ac77f0d77b4a83b4ec30d49737288/family1/4ee83e1e5bbf42d5aec5c98d03d345d2 2023-02-12 03:53:18,271 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/347ac77f0d77b4a83b4ec30d49737288/family1/41214efaf17946ccbe76e612554f82e2 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/347ac77f0d77b4a83b4ec30d49737288/family1/41214efaf17946ccbe76e612554f82e2 2023-02-12 03:53:18,273 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/347ac77f0d77b4a83b4ec30d49737288/family1/ada21dca7828436ebcca355883fdb7ce to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/347ac77f0d77b4a83b4ec30d49737288/family1/ada21dca7828436ebcca355883fdb7ce 2023-02-12 03:53:18,275 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/347ac77f0d77b4a83b4ec30d49737288/family1/fde4f01dd1914b8cb58e6403ca07b90d to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/347ac77f0d77b4a83b4ec30d49737288/family1/fde4f01dd1914b8cb58e6403ca07b90d 2023-02-12 03:53:18,276 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/347ac77f0d77b4a83b4ec30d49737288/family1/4a7e217b78854fd4bfa7eacec393bc98_SeqId_44_ to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/347ac77f0d77b4a83b4ec30d49737288/family1/4a7e217b78854fd4bfa7eacec393bc98_SeqId_44_ 2023-02-12 03:53:18,339 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(109): Close 347ac77f0d77b4a83b4ec30d49737288 2023-02-12 03:53:18,339 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 347ac77f0d77b4a83b4ec30d49737288, disabling compactions & flushes 2023-02-12 03:53:18,339 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1676173986005.347ac77f0d77b4a83b4ec30d49737288. 2023-02-12 03:53:18,339 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1676173986005.347ac77f0d77b4a83b4ec30d49737288. 2023-02-12 03:53:18,339 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1676173986005.347ac77f0d77b4a83b4ec30d49737288. after waiting 0 ms 2023-02-12 03:53:18,339 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1676173986005.347ac77f0d77b4a83b4ec30d49737288. 2023-02-12 03:53:18,352 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/347ac77f0d77b4a83b4ec30d49737288/recovered.edits/49.seqid, newMaxSeqId=49, maxSeqId=1 2023-02-12 03:53:18,354 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1676173986005.347ac77f0d77b4a83b4ec30d49737288. 2023-02-12 03:53:18,354 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 347ac77f0d77b4a83b4ec30d49737288: Waiting for close lock at 1676173998339Running coprocessor pre-close hooks at 1676173998339Disabling compacts and flushes for region at 1676173998339Disabling writes for close at 1676173998339Writing region close event to WAL at 1676173998347 (+8 ms)Running coprocessor post-close hooks at 1676173998353 (+6 ms)Closed at 1676173998354 (+1 ms) 2023-02-12 03:53:18,354 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(3509): Not adding moved region record: 347ac77f0d77b4a83b4ec30d49737288 to self. 2023-02-12 03:53:18,357 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(147): Closed 347ac77f0d77b4a83b4ec30d49737288 2023-02-12 03:53:18,357 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=347ac77f0d77b4a83b4ec30d49737288, regionState=CLOSED 2023-02-12 03:53:18,358 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1676173986005.347ac77f0d77b4a83b4ec30d49737288.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1676173998357"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676173998357"}]},"ts":"1676173998357"} 2023-02-12 03:53:18,363 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-12 03:53:18,363 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; CloseRegionProcedure 347ac77f0d77b4a83b4ec30d49737288, server=jenkins-hbase20.apache.org,39639,1676173982450 in 182 msec 2023-02-12 03:53:18,364 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=347ac77f0d77b4a83b4ec30d49737288, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase20.apache.org,39639,1676173982450; forceNewPlan=false, retain=true 2023-02-12 03:53:18,515 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=347ac77f0d77b4a83b4ec30d49737288, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:18,516 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1676173986005.347ac77f0d77b4a83b4ec30d49737288.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1676173998515"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676173998515"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676173998515"}]},"ts":"1676173998515"} 2023-02-12 03:53:18,520 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=15, state=RUNNABLE; OpenRegionProcedure 347ac77f0d77b4a83b4ec30d49737288, server=jenkins-hbase20.apache.org,39639,1676173982450}] 2023-02-12 03:53:18,678 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthly,,1676173986005.347ac77f0d77b4a83b4ec30d49737288. 2023-02-12 03:53:18,678 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 347ac77f0d77b4a83b4ec30d49737288, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1676173986005.347ac77f0d77b4a83b4ec30d49737288.', STARTKEY => '', ENDKEY => ''} 2023-02-12 03:53:18,678 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthly 347ac77f0d77b4a83b4ec30d49737288 2023-02-12 03:53:18,678 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1676173986005.347ac77f0d77b4a83b4ec30d49737288.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:53:18,678 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 347ac77f0d77b4a83b4ec30d49737288 2023-02-12 03:53:18,678 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 347ac77f0d77b4a83b4ec30d49737288 2023-02-12 03:53:18,680 INFO [StoreOpener-347ac77f0d77b4a83b4ec30d49737288-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 347ac77f0d77b4a83b4ec30d49737288 2023-02-12 03:53:18,682 DEBUG [StoreOpener-347ac77f0d77b4a83b4ec30d49737288-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/347ac77f0d77b4a83b4ec30d49737288/family1 2023-02-12 03:53:18,682 DEBUG [StoreOpener-347ac77f0d77b4a83b4ec30d49737288-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/347ac77f0d77b4a83b4ec30d49737288/family1 2023-02-12 03:53:18,683 INFO [StoreOpener-347ac77f0d77b4a83b4ec30d49737288-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 347ac77f0d77b4a83b4ec30d49737288 columnFamilyName family1 2023-02-12 03:53:18,691 DEBUG [StoreOpener-347ac77f0d77b4a83b4ec30d49737288-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/347ac77f0d77b4a83b4ec30d49737288/family1/405fd09a6eb6439d8914c54bee2f508a_SeqId_46_ 2023-02-12 03:53:18,697 DEBUG [StoreOpener-347ac77f0d77b4a83b4ec30d49737288-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/347ac77f0d77b4a83b4ec30d49737288/family1/605f28d0e22a462aa1d2275bdbe81919 2023-02-12 03:53:18,701 DEBUG [StoreOpener-347ac77f0d77b4a83b4ec30d49737288-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/347ac77f0d77b4a83b4ec30d49737288/family1/a9c0bfa1e0a9496f95f4fec81256c56c 2023-02-12 03:53:18,701 INFO [StoreOpener-347ac77f0d77b4a83b4ec30d49737288-1] regionserver.HStore(310): Store=347ac77f0d77b4a83b4ec30d49737288/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:53:18,702 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/347ac77f0d77b4a83b4ec30d49737288 2023-02-12 03:53:18,703 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/347ac77f0d77b4a83b4ec30d49737288 2023-02-12 03:53:18,706 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 347ac77f0d77b4a83b4ec30d49737288 2023-02-12 03:53:18,707 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 347ac77f0d77b4a83b4ec30d49737288; next sequenceid=50; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70737928, jitterRate=0.05407726764678955}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-12 03:53:18,707 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 347ac77f0d77b4a83b4ec30d49737288: Running coprocessor pre-open hook at 1676173998679Writing region info on filesystem at 1676173998679Initializing all the Stores at 1676173998680 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} at 1676173998680Cleaning up temporary data from old regions at 1676173998704 (+24 ms)Cleaning up detritus from prior splits at 1676173998704Running coprocessor post-open hooks at 1676173998707 (+3 ms)Region opened successfully at 1676173998707 2023-02-12 03:53:18,708 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthly,,1676173986005.347ac77f0d77b4a83b4ec30d49737288., pid=17, masterSystemTime=1676173998673 2023-02-12 03:53:18,708 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-12 03:53:18,709 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-02-12 03:53:18,711 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 367249 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-02-12 03:53:18,711 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] regionserver.HStore(1912): 347ac77f0d77b4a83b4ec30d49737288/family1 is initiating minor compaction (all files) 2023-02-12 03:53:18,711 INFO [RS:0;jenkins-hbase20:39639-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 347ac77f0d77b4a83b4ec30d49737288/family1 in testMajorCompactionWithWeeklyFollowedByMonthly,,1676173986005.347ac77f0d77b4a83b4ec30d49737288. 2023-02-12 03:53:18,711 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthly,,1676173986005.347ac77f0d77b4a83b4ec30d49737288. 2023-02-12 03:53:18,711 INFO [RS:0;jenkins-hbase20:39639-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/347ac77f0d77b4a83b4ec30d49737288/family1/a9c0bfa1e0a9496f95f4fec81256c56c, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/347ac77f0d77b4a83b4ec30d49737288/family1/605f28d0e22a462aa1d2275bdbe81919, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/347ac77f0d77b4a83b4ec30d49737288/family1/405fd09a6eb6439d8914c54bee2f508a_SeqId_46_] into tmpdir=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/347ac77f0d77b4a83b4ec30d49737288/.tmp, totalSize=358.6 K 2023-02-12 03:53:18,711 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthly,,1676173986005.347ac77f0d77b4a83b4ec30d49737288. 2023-02-12 03:53:18,712 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=347ac77f0d77b4a83b4ec30d49737288, regionState=OPEN, openSeqNum=50, regionLocation=jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:18,712 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] compactions.Compactor(207): Compacting a9c0bfa1e0a9496f95f4fec81256c56c, keycount=1000, bloomtype=ROW, size=175.8 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878805947 2023-02-12 03:53:18,712 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1676173986005.347ac77f0d77b4a83b4ec30d49737288.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1676173998711"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676173998711"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676173998711"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676173998711"}]},"ts":"1676173998711"} 2023-02-12 03:53:18,712 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] compactions.Compactor(207): Compacting 605f28d0e22a462aa1d2275bdbe81919, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621205947 2023-02-12 03:53:18,713 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] compactions.Compactor(207): Compacting 405fd09a6eb6439d8914c54bee2f508a_SeqId_46_, keycount=1002, bloomtype=ROW, size=176.2 K, encoding=NONE, compression=NONE, seqNum=47, earliestPutTs=1448878805947 2023-02-12 03:53:18,718 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=15 2023-02-12 03:53:18,718 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=15, state=SUCCESS; OpenRegionProcedure 347ac77f0d77b4a83b4ec30d49737288, server=jenkins-hbase20.apache.org,39639,1676173982450 in 194 msec 2023-02-12 03:53:18,721 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=15, resume processing ppid=14 2023-02-12 03:53:18,722 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=14, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=347ac77f0d77b4a83b4ec30d49737288, REOPEN/MOVE in 547 msec 2023-02-12 03:53:18,726 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=14, resume processing ppid=13 2023-02-12 03:53:18,726 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=13, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 569 msec 2023-02-12 03:53:18,729 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 997 msec 2023-02-12 03:53:18,732 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(1227): Checking to see if procedure is done pid=13 2023-02-12 03:53:18,742 INFO [Listener at localhost.localdomain/41049] compactions.TestMobCompactor(278): alter status finished 2023-02-12 03:53:18,743 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=40099] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-12 03:53:18,745 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676173985818] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-02-12 03:53:18,752 INFO [RS:0;jenkins-hbase20:39639-shortCompactions-0] throttle.PressureAwareThroughputController(145): 347ac77f0d77b4a83b4ec30d49737288#family1#compaction#11 average throughput is 5.90 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-12 03:53:18,756 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-02-12 03:53:18,758 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676173985818] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-12 03:53:18,758 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1676174598758 2023-02-12 03:53:18,759 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676173985818] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-12 03:53:18,760 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676173985818] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthly' and column 'family1' 2023-02-12 03:53:18,760 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676173985818] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-02-12 03:53:18,760 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676173985818] zookeeper.ReadOnlyZKClient(139): Connect 0x7ed7ad0b to 127.0.0.1:59556 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 03:53:18,770 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676173985818] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@560b0d3c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 03:53:18,771 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-12 03:53:18,771 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-12 03:53:18,771 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-12 03:53:18,771 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-12 03:53:18,771 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-12 03:53:18,796 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/347ac77f0d77b4a83b4ec30d49737288/.tmp/family1/1ac51d64b9344c78b237aba92cb1fad1 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/347ac77f0d77b4a83b4ec30d49737288/family1/1ac51d64b9344c78b237aba92cb1fad1 2023-02-12 03:53:18,804 INFO [RS:0;jenkins-hbase20:39639-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 347ac77f0d77b4a83b4ec30d49737288/family1 of 347ac77f0d77b4a83b4ec30d49737288 into 1ac51d64b9344c78b237aba92cb1fad1(size=177.2 K), total size for store is 177.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-12 03:53:18,804 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 347ac77f0d77b4a83b4ec30d49737288: 2023-02-12 03:53:18,804 INFO [RS:0;jenkins-hbase20:39639-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testMajorCompactionWithWeeklyFollowedByMonthly,,1676173986005.347ac77f0d77b4a83b4ec30d49737288., storeName=347ac77f0d77b4a83b4ec30d49737288/family1, priority=13, startTime=1676173998708; duration=0sec 2023-02-12 03:53:18,805 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-12 03:53:18,860 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/347ac77f0d77b4a83b4ec30d49737288/family1/a9c0bfa1e0a9496f95f4fec81256c56c, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/347ac77f0d77b4a83b4ec30d49737288/family1/605f28d0e22a462aa1d2275bdbe81919, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/347ac77f0d77b4a83b4ec30d49737288/family1/405fd09a6eb6439d8914c54bee2f508a_SeqId_46_] to archive 2023-02-12 03:53:18,861 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-12 03:53:18,863 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/347ac77f0d77b4a83b4ec30d49737288/family1/a9c0bfa1e0a9496f95f4fec81256c56c to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/347ac77f0d77b4a83b4ec30d49737288/family1/a9c0bfa1e0a9496f95f4fec81256c56c 2023-02-12 03:53:18,865 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/347ac77f0d77b4a83b4ec30d49737288/family1/605f28d0e22a462aa1d2275bdbe81919 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/347ac77f0d77b4a83b4ec30d49737288/family1/605f28d0e22a462aa1d2275bdbe81919 2023-02-12 03:53:18,867 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/347ac77f0d77b4a83b4ec30d49737288/family1/405fd09a6eb6439d8914c54bee2f508a_SeqId_46_ to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/347ac77f0d77b4a83b4ec30d49737288/family1/405fd09a6eb6439d8914c54bee2f508a_SeqId_46_ 2023-02-12 03:53:19,619 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128fcc2367dade3498a85a31d4aee2733c2 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151128fcc2367dade3498a85a31d4aee2733c2 2023-02-12 03:53:19,620 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-02-12 03:53:19,632 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-12 03:53:19,633 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:57158, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-12 03:53:19,641 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-12 03:53:19,643 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:57524, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-12 03:53:19,659 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/fc74eb3f8ac64eddb74b95e6f6bcfb8f first=Optional[r05] last=Optional[r8] 2023-02-12 03:53:19,659 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1676173986005.347ac77f0d77b4a83b4ec30d49737288., hostname=jenkins-hbase20.apache.org,39639,1676173982450, seqNum=50 for row with hfile group [{family1,hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/fc74eb3f8ac64eddb74b95e6f6bcfb8f}] 2023-02-12 03:53:19,666 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/fc74eb3f8ac64eddb74b95e6f6bcfb8f for inclusion in 347ac77f0d77b4a83b4ec30d49737288/family1 2023-02-12 03:53:19,669 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-02-12 03:53:19,669 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HStore(777): Region bounds: first= last= 2023-02-12 03:53:19,669 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HRegion(2445): Flush status journal for 347ac77f0d77b4a83b4ec30d49737288: 2023-02-12 03:53:19,670 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/fc74eb3f8ac64eddb74b95e6f6bcfb8f to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__29f6vq6mb2b8r4f02cqj73h7euss7j3hptgnoc1qrcfmqp9qvsthmenbmt7tb6o7/family1/fc74eb3f8ac64eddb74b95e6f6bcfb8f 2023-02-12 03:53:19,673 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__29f6vq6mb2b8r4f02cqj73h7euss7j3hptgnoc1qrcfmqp9qvsthmenbmt7tb6o7/family1/fc74eb3f8ac64eddb74b95e6f6bcfb8f as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/347ac77f0d77b4a83b4ec30d49737288/family1/91d85af7e29f4d37b26fc85b4e886cf4_SeqId_53_ 2023-02-12 03:53:19,674 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__29f6vq6mb2b8r4f02cqj73h7euss7j3hptgnoc1qrcfmqp9qvsthmenbmt7tb6o7/family1/fc74eb3f8ac64eddb74b95e6f6bcfb8f into 347ac77f0d77b4a83b4ec30d49737288/family1 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/347ac77f0d77b4a83b4ec30d49737288/family1/91d85af7e29f4d37b26fc85b4e886cf4_SeqId_53_ - updating store file list. 2023-02-12 03:53:19,679 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/347ac77f0d77b4a83b4ec30d49737288/family1/91d85af7e29f4d37b26fc85b4e886cf4_SeqId_53_ into 347ac77f0d77b4a83b4ec30d49737288/family1 2023-02-12 03:53:19,680 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__29f6vq6mb2b8r4f02cqj73h7euss7j3hptgnoc1qrcfmqp9qvsthmenbmt7tb6o7/family1/fc74eb3f8ac64eddb74b95e6f6bcfb8f into 347ac77f0d77b4a83b4ec30d49737288/family1 (new location: hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/347ac77f0d77b4a83b4ec30d49737288/family1/91d85af7e29f4d37b26fc85b4e886cf4_SeqId_53_) 2023-02-12 03:53:19,680 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__29f6vq6mb2b8r4f02cqj73h7euss7j3hptgnoc1qrcfmqp9qvsthmenbmt7tb6o7/family1/fc74eb3f8ac64eddb74b95e6f6bcfb8f 2023-02-12 03:53:19,682 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-02-12 03:53:19,684 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-12 03:53:19,685 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151120b8dbada875f64851833d6d81e905cbaa to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151120b8dbada875f64851833d6d81e905cbaa 2023-02-12 03:53:19,686 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511287de89ad25965490d8ed9d4feb2310222 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511287de89ad25965490d8ed9d4feb2310222 2023-02-12 03:53:19,686 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 2 expired mob files are deleted 2023-02-12 03:53:19,686 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-02-12 03:53:19,687 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-12 03:53:19,687 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-12 03:53:19,687 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-12 03:53:19,687 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676173985818] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-02-12 03:53:19,687 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676173985818] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-12 03:53:19,688 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-02-12 03:53:19,690 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE in 944 msec 2023-02-12 03:53:19,781 INFO [Listener at localhost.localdomain/41049] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthly Thread=248 (was 211) Potentially hanging thread: RS:0;jenkins-hbase20:39639-shortCompactions-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.PriorityBlockingQueue.take(PriorityBlockingQueue.java:549) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1030629287_15 at /127.0.0.1:42114 [Waiting for operation #19] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1030629287_15 at /127.0.0.1:42040 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7716798d-metaLookup-shared--pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x159559dc-shared-pool-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1030629287_15 at /127.0.0.1:42026 [Waiting for operation #10] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7716798d-shared-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'HBase' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1030629287_15 at /127.0.0.1:42092 [Waiting for operation #38] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x159559dc-shared-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7716798d-shared-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x159559dc-metaLookup-shared--pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1030629287_15 at /127.0.0.1:42152 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1030629287_15 at /127.0.0.1:42058 [Waiting for operation #25] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:59556@0x67ee259c-SendThread(127.0.0.1:59556) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:345) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1223) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1030629287_15 at /127.0.0.1:42016 [Waiting for operation #10] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:59556@0x67ee259c-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: hconnection-0x159559dc-shared-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1030629287_15 at /127.0.0.1:41974 [Waiting for operation #15] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-186694101_15 at /127.0.0.1:42210 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1030629287_15 at /127.0.0.1:42202 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1030629287_15 at /127.0.0.1:42242 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hfile_cleaner-dir-scan-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobCompactor-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676173985818 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RSProcedureDispatcher-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1030629287_15 at /127.0.0.1:41996 [Waiting for operation #12] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:59556@0x7ed7ad0b-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:59556@0x7ed7ad0b-SendThread(127.0.0.1:59556) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:345) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1223) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:59556@0x7ed7ad0b sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$45/1090090368.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x159559dc-shared-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1030629287_15 at /127.0.0.1:42238 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1030629287_15 at /127.0.0.1:42174 [Waiting for operation #24] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hfile_cleaner-dir-scan-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:59556@0x67ee259c sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$45/1090090368.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=589 (was 475) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=408 (was 416), ProcessCount=164 (was 164), AvailableMemoryMB=4289 (was 4635) 2023-02-12 03:53:19,791 INFO [Listener at localhost.localdomain/41049] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithMonthlyPolicy Thread=248, OpenFileDescriptor=589, MaxFileDescriptor=60000, SystemLoadAverage=408, ProcessCount=164, AvailableMemoryMB=4288 2023-02-12 03:53:19,794 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.HMaster$4(2102): Client=jenkins//148.251.75.209 create 'testMajorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-02-12 03:53:19,795 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] procedure2.ProcedureExecutor(1029): Stored pid=19, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:19,797 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-02-12 03:53:19,797 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(697): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithMonthlyPolicy" procId is: 19 2023-02-12 03:53:19,798 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-12 03:53:19,798 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(1227): Checking to see if procedure is done pid=19 2023-02-12 03:53:19,800 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/7219c41156bc54a262cb892cb04282fe 2023-02-12 03:53:19,801 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/7219c41156bc54a262cb892cb04282fe empty. 2023-02-12 03:53:19,801 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/7219c41156bc54a262cb892cb04282fe 2023-02-12 03:53:19,801 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithMonthlyPolicy regions 2023-02-12 03:53:19,900 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(1227): Checking to see if procedure is done pid=19 2023-02-12 03:53:20,102 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(1227): Checking to see if procedure is done pid=19 2023-02-12 03:53:20,213 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/.tabledesc/.tableinfo.0000000001 2023-02-12 03:53:20,215 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(7671): creating {ENCODED => 7219c41156bc54a262cb892cb04282fe, NAME => 'testMajorCompactionWithMonthlyPolicy,,1676173999793.7219c41156bc54a262cb892cb04282fe.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}, regionDir=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/.tmp 2023-02-12 03:53:20,404 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(1227): Checking to see if procedure is done pid=19 2023-02-12 03:53:20,624 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithMonthlyPolicy,,1676173999793.7219c41156bc54a262cb892cb04282fe.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:53:20,624 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1603): Closing 7219c41156bc54a262cb892cb04282fe, disabling compactions & flushes 2023-02-12 03:53:20,624 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithMonthlyPolicy,,1676173999793.7219c41156bc54a262cb892cb04282fe. 2023-02-12 03:53:20,624 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithMonthlyPolicy,,1676173999793.7219c41156bc54a262cb892cb04282fe. 2023-02-12 03:53:20,625 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithMonthlyPolicy,,1676173999793.7219c41156bc54a262cb892cb04282fe. after waiting 0 ms 2023-02-12 03:53:20,625 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithMonthlyPolicy,,1676173999793.7219c41156bc54a262cb892cb04282fe. 2023-02-12 03:53:20,625 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1837): Closed testMajorCompactionWithMonthlyPolicy,,1676173999793.7219c41156bc54a262cb892cb04282fe. 2023-02-12 03:53:20,625 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1557): Region close journal for 7219c41156bc54a262cb892cb04282fe: Waiting for close lock at 1676174000624Disabling compacts and flushes for region at 1676174000624Disabling writes for close at 1676174000625 (+1 ms)Writing region close event to WAL at 1676174000625Closed at 1676174000625 2023-02-12 03:53:20,629 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-02-12 03:53:20,632 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithMonthlyPolicy,,1676173999793.7219c41156bc54a262cb892cb04282fe.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676174000631"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676174000631"}]},"ts":"1676174000631"} 2023-02-12 03:53:20,635 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-12 03:53:20,636 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-12 03:53:20,636 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676174000636"}]},"ts":"1676174000636"} 2023-02-12 03:53:20,638 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithMonthlyPolicy, state=ENABLING in hbase:meta 2023-02-12 03:53:20,640 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=7219c41156bc54a262cb892cb04282fe, ASSIGN}] 2023-02-12 03:53:20,641 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=7219c41156bc54a262cb892cb04282fe, ASSIGN 2023-02-12 03:53:20,642 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=7219c41156bc54a262cb892cb04282fe, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,39639,1676173982450; forceNewPlan=false, retain=false 2023-02-12 03:53:20,794 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=7219c41156bc54a262cb892cb04282fe, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:20,795 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithMonthlyPolicy,,1676173999793.7219c41156bc54a262cb892cb04282fe.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676174000794"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676174000794"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676174000794"}]},"ts":"1676174000794"} 2023-02-12 03:53:20,799 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=21, ppid=20, state=RUNNABLE; OpenRegionProcedure 7219c41156bc54a262cb892cb04282fe, server=jenkins-hbase20.apache.org,39639,1676173982450}] 2023-02-12 03:53:20,906 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(1227): Checking to see if procedure is done pid=19 2023-02-12 03:53:20,958 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithMonthlyPolicy,,1676173999793.7219c41156bc54a262cb892cb04282fe. 2023-02-12 03:53:20,958 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 7219c41156bc54a262cb892cb04282fe, NAME => 'testMajorCompactionWithMonthlyPolicy,,1676173999793.7219c41156bc54a262cb892cb04282fe.', STARTKEY => '', ENDKEY => ''} 2023-02-12 03:53:20,958 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithMonthlyPolicy 7219c41156bc54a262cb892cb04282fe 2023-02-12 03:53:20,958 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithMonthlyPolicy,,1676173999793.7219c41156bc54a262cb892cb04282fe.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:53:20,958 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 7219c41156bc54a262cb892cb04282fe 2023-02-12 03:53:20,958 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 7219c41156bc54a262cb892cb04282fe 2023-02-12 03:53:20,960 INFO [StoreOpener-7219c41156bc54a262cb892cb04282fe-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 7219c41156bc54a262cb892cb04282fe 2023-02-12 03:53:20,962 DEBUG [StoreOpener-7219c41156bc54a262cb892cb04282fe-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithMonthlyPolicy/7219c41156bc54a262cb892cb04282fe/family1 2023-02-12 03:53:20,963 DEBUG [StoreOpener-7219c41156bc54a262cb892cb04282fe-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithMonthlyPolicy/7219c41156bc54a262cb892cb04282fe/family1 2023-02-12 03:53:20,963 INFO [StoreOpener-7219c41156bc54a262cb892cb04282fe-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7219c41156bc54a262cb892cb04282fe columnFamilyName family1 2023-02-12 03:53:20,966 INFO [StoreOpener-7219c41156bc54a262cb892cb04282fe-1] regionserver.HStore(310): Store=7219c41156bc54a262cb892cb04282fe/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:53:20,968 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithMonthlyPolicy/7219c41156bc54a262cb892cb04282fe 2023-02-12 03:53:20,969 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithMonthlyPolicy/7219c41156bc54a262cb892cb04282fe 2023-02-12 03:53:20,972 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 7219c41156bc54a262cb892cb04282fe 2023-02-12 03:53:20,974 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithMonthlyPolicy/7219c41156bc54a262cb892cb04282fe/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 03:53:20,975 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 7219c41156bc54a262cb892cb04282fe; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59285589, jitterRate=-0.11657588183879852}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-12 03:53:20,975 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 7219c41156bc54a262cb892cb04282fe: Running coprocessor pre-open hook at 1676174000959Writing region info on filesystem at 1676174000959Initializing all the Stores at 1676174000960 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} at 1676174000960Cleaning up temporary data from old regions at 1676174000970 (+10 ms)Cleaning up detritus from prior splits at 1676174000970Running coprocessor post-open hooks at 1676174000975 (+5 ms)Region opened successfully at 1676174000975 2023-02-12 03:53:20,976 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithMonthlyPolicy,,1676173999793.7219c41156bc54a262cb892cb04282fe., pid=21, masterSystemTime=1676174000954 2023-02-12 03:53:20,977 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithMonthlyPolicy,,1676173999793.7219c41156bc54a262cb892cb04282fe. 2023-02-12 03:53:20,977 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithMonthlyPolicy,,1676173999793.7219c41156bc54a262cb892cb04282fe. 2023-02-12 03:53:20,978 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=7219c41156bc54a262cb892cb04282fe, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:20,978 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithMonthlyPolicy,,1676173999793.7219c41156bc54a262cb892cb04282fe.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676174000978"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676174000978"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676174000978"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676174000978"}]},"ts":"1676174000978"} 2023-02-12 03:53:20,982 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=21, resume processing ppid=20 2023-02-12 03:53:20,982 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=20, state=SUCCESS; OpenRegionProcedure 7219c41156bc54a262cb892cb04282fe, server=jenkins-hbase20.apache.org,39639,1676173982450 in 181 msec 2023-02-12 03:53:20,985 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=20, resume processing ppid=19 2023-02-12 03:53:20,985 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=19, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=7219c41156bc54a262cb892cb04282fe, ASSIGN in 342 msec 2023-02-12 03:53:20,986 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-12 03:53:20,987 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676174000987"}]},"ts":"1676174000987"} 2023-02-12 03:53:20,989 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithMonthlyPolicy, state=ENABLED in hbase:meta 2023-02-12 03:53:20,993 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-02-12 03:53:20,997 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=19, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy in 1.1990 sec 2023-02-12 03:53:21,907 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(1227): Checking to see if procedure is done pid=19 2023-02-12 03:53:21,907 INFO [Listener at localhost.localdomain/41049] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithMonthlyPolicy, procId: 19 completed 2023-02-12 03:53:21,938 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-12 03:53:21,940 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:21,940 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-02-12 03:53:21,940 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:53:21,940 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-12 03:53:21,940 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-12 03:53:21,941 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:21,941 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:21,942 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:21,942 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:53:21,942 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:53:21,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:53:21,942 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:21,942 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-12 03:53:21,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:21,942 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:21,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-12 03:53:21,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:21,943 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:21,943 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:21,943 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-12 03:53:21,943 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:53:21,943 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-12 03:53:21,943 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-12 03:53:21,943 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-12 03:53:21,943 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1676173999793.7219c41156bc54a262cb892cb04282fe. 2023-02-12 03:53:21,944 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1676173999793.7219c41156bc54a262cb892cb04282fe. started... 2023-02-12 03:53:21,944 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 7219c41156bc54a262cb892cb04282fe 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-02-12 03:53:21,965 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130f4509bb5ccd74a94ab07fa2688db2dbc to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151130f4509bb5ccd74a94ab07fa2688db2dbc 2023-02-12 03:53:22,064 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithMonthlyPolicy' 2023-02-12 03:53:22,371 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithMonthlyPolicy/7219c41156bc54a262cb892cb04282fe/.tmp/family1/5f422c8ef0db416a8a51c2b318c18c1f 2023-02-12 03:53:22,384 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithMonthlyPolicy/7219c41156bc54a262cb892cb04282fe/.tmp/family1/5f422c8ef0db416a8a51c2b318c18c1f as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithMonthlyPolicy/7219c41156bc54a262cb892cb04282fe/family1/5f422c8ef0db416a8a51c2b318c18c1f 2023-02-12 03:53:22,390 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithMonthlyPolicy/7219c41156bc54a262cb892cb04282fe/family1/5f422c8ef0db416a8a51c2b318c18c1f, entries=1000, sequenceid=5, filesize=166.0 K 2023-02-12 03:53:22,391 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 7219c41156bc54a262cb892cb04282fe in 447ms, sequenceid=5, compaction requested=false 2023-02-12 03:53:22,391 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 7219c41156bc54a262cb892cb04282fe: 2023-02-12 03:53:22,391 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1676173999793.7219c41156bc54a262cb892cb04282fe. 2023-02-12 03:53:22,392 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-12 03:53:22,392 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-12 03:53:22,392 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:22,392 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-02-12 03:53:22,392 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-02-12 03:53:22,393 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:22,393 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:22,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:22,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:53:22,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:53:22,393 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:22,393 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 03:53:22,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:53:22,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:53:22,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:22,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:22,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:53:22,394 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-02-12 03:53:22,394 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@665e76a5[Count = 0] remaining members to acquire global barrier 2023-02-12 03:53:22,394 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-12 03:53:22,394 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:22,395 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:22,395 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:22,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:22,395 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-12 03:53:22,395 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-02-12 03:53:22,395 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:22,395 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-12 03:53:22,395 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,39639,1676173982450' in zk 2023-02-12 03:53:22,396 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:22,396 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-12 03:53:22,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:22,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:53:22,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:53:22,396 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:53:22,396 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-02-12 03:53:22,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:53:22,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:53:22,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:22,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:22,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:53:22,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:22,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:22,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,39639,1676173982450': 2023-02-12 03:53:22,399 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-12 03:53:22,399 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-02-12 03:53:22,399 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-12 03:53:22,399 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-12 03:53:22,399 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:22,399 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-12 03:53:22,400 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:22,400 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:22,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:22,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:53:22,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:53:22,400 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:53:22,400 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:22,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:22,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:53:22,400 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:22,400 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:53:22,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:53:22,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:22,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:22,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:53:22,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:22,401 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:22,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:22,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:53:22,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:22,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:22,403 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:22,403 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:22,403 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:53:22,403 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:53:22,403 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:22,403 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:53:22,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:53:22,403 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:53:22,403 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-02-12 03:53:22,404 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-12 03:53:22,403 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:22,404 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:22,404 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:22,404 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:22,404 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:53:22,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:53:22,404 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-12 03:53:22,404 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-12 03:53:22,404 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-12 03:53:22,504 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-12 03:53:22,505 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-12 03:53:22,514 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-12 03:53:22,517 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-12 03:53:22,517 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:22,517 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-02-12 03:53:22,517 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:53:22,518 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-12 03:53:22,518 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-12 03:53:22,518 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:22,519 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:22,519 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:53:22,519 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:22,519 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:53:22,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:53:22,520 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:22,520 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-12 03:53:22,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:22,520 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:22,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-12 03:53:22,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:22,520 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:22,522 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-02-12 03:53:22,522 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:22,522 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-12 03:53:22,522 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:53:22,523 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-12 03:53:22,525 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-12 03:53:22,525 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-12 03:53:22,525 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1676173999793.7219c41156bc54a262cb892cb04282fe. 2023-02-12 03:53:22,525 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1676173999793.7219c41156bc54a262cb892cb04282fe. started... 2023-02-12 03:53:22,525 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 7219c41156bc54a262cb892cb04282fe 1/1 column families, dataSize=74 B heapSize=408 B 2023-02-12 03:53:22,940 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112853c423ecdeb843c8a817d92f4ad63278 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015112853c423ecdeb843c8a817d92f4ad63278 2023-02-12 03:53:23,347 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithMonthlyPolicy/7219c41156bc54a262cb892cb04282fe/.tmp/family1/66b5c3f517074f1a96554f8f051fc201 2023-02-12 03:53:23,354 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithMonthlyPolicy/7219c41156bc54a262cb892cb04282fe/.tmp/family1/66b5c3f517074f1a96554f8f051fc201 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithMonthlyPolicy/7219c41156bc54a262cb892cb04282fe/family1/66b5c3f517074f1a96554f8f051fc201 2023-02-12 03:53:23,363 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithMonthlyPolicy/7219c41156bc54a262cb892cb04282fe/family1/66b5c3f517074f1a96554f8f051fc201, entries=1, sequenceid=9, filesize=5.0 K 2023-02-12 03:53:23,364 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 7219c41156bc54a262cb892cb04282fe in 839ms, sequenceid=9, compaction requested=false 2023-02-12 03:53:23,364 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 7219c41156bc54a262cb892cb04282fe: 2023-02-12 03:53:23,364 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1676173999793.7219c41156bc54a262cb892cb04282fe. 2023-02-12 03:53:23,364 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-12 03:53:23,364 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-12 03:53:23,364 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:23,364 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-02-12 03:53:23,364 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-02-12 03:53:23,365 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:23,365 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:23,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:23,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:53:23,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:53:23,366 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:23,366 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 03:53:23,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:53:23,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:53:23,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:23,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:23,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:53:23,367 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-02-12 03:53:23,367 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@13fcd3fa[Count = 0] remaining members to acquire global barrier 2023-02-12 03:53:23,367 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-12 03:53:23,367 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:23,368 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:23,368 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:23,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:23,368 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-12 03:53:23,368 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-02-12 03:53:23,368 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,39639,1676173982450' in zk 2023-02-12 03:53:23,368 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:23,368 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-12 03:53:23,369 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:23,369 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-12 03:53:23,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:23,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:53:23,369 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:53:23,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:53:23,369 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-02-12 03:53:23,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:53:23,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:53:23,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:23,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:23,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:53:23,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:23,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:23,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,39639,1676173982450': 2023-02-12 03:53:23,372 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-12 03:53:23,372 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-02-12 03:53:23,372 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-12 03:53:23,372 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-12 03:53:23,372 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:23,372 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-12 03:53:23,373 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:23,373 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:23,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:23,373 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:23,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:53:23,373 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:53:23,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:53:23,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:23,374 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:53:23,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:53:23,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:53:23,374 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:23,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:23,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:23,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:53:23,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:23,376 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:23,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:23,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:53:23,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:23,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:23,380 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:53:23,380 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:53:23,380 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:53:23,380 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-02-12 03:53:23,381 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-12 03:53:23,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:53:23,380 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-12 03:53:23,380 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:53:23,380 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:23,383 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:23,383 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:23,383 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:23,383 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:53:23,383 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-12 03:53:23,383 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:23,383 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-12 03:53:23,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:53:23,383 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:23,383 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:23,483 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-12 03:53:23,485 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-12 03:53:23,492 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-12 03:53:23,497 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-12 03:53:23,497 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:23,497 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-02-12 03:53:23,497 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:53:23,498 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-12 03:53:23,498 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-12 03:53:23,498 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:23,498 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:23,499 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:53:23,499 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:53:23,499 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:23,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:53:23,500 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:23,500 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-12 03:53:23,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:23,500 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:23,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-12 03:53:23,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:23,501 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:23,501 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-02-12 03:53:23,501 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:23,501 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-12 03:53:23,501 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:53:23,502 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-12 03:53:23,502 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-12 03:53:23,502 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-12 03:53:23,502 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1676173999793.7219c41156bc54a262cb892cb04282fe. 2023-02-12 03:53:23,502 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1676173999793.7219c41156bc54a262cb892cb04282fe. started... 2023-02-12 03:53:23,502 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 7219c41156bc54a262cb892cb04282fe 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-12 03:53:23,891 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-12 03:53:23,923 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512018ef5216041464366b009bf65bdc97357 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512018ef5216041464366b009bf65bdc97357 2023-02-12 03:53:24,330 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithMonthlyPolicy/7219c41156bc54a262cb892cb04282fe/.tmp/family1/53c7aab95448468e9728f3790e8440dd 2023-02-12 03:53:24,342 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithMonthlyPolicy/7219c41156bc54a262cb892cb04282fe/.tmp/family1/53c7aab95448468e9728f3790e8440dd as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithMonthlyPolicy/7219c41156bc54a262cb892cb04282fe/family1/53c7aab95448468e9728f3790e8440dd 2023-02-12 03:53:24,350 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithMonthlyPolicy/7219c41156bc54a262cb892cb04282fe/family1/53c7aab95448468e9728f3790e8440dd, entries=1, sequenceid=13, filesize=4.9 K 2023-02-12 03:53:24,351 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 7219c41156bc54a262cb892cb04282fe in 849ms, sequenceid=13, compaction requested=true 2023-02-12 03:53:24,351 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 7219c41156bc54a262cb892cb04282fe: 2023-02-12 03:53:24,351 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1676173999793.7219c41156bc54a262cb892cb04282fe. 2023-02-12 03:53:24,351 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-12 03:53:24,352 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-12 03:53:24,352 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:24,352 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-02-12 03:53:24,352 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-02-12 03:53:24,353 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:24,353 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:24,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:24,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:53:24,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:53:24,354 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:24,354 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 03:53:24,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:53:24,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:53:24,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:24,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:24,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:53:24,356 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-02-12 03:53:24,356 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5c65bbfd[Count = 0] remaining members to acquire global barrier 2023-02-12 03:53:24,356 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-12 03:53:24,356 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:24,357 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:24,357 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:24,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:24,357 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-12 03:53:24,357 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-02-12 03:53:24,357 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,39639,1676173982450' in zk 2023-02-12 03:53:24,357 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:24,357 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-12 03:53:24,358 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:24,358 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-12 03:53:24,359 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:53:24,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:24,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:53:24,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:53:24,359 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-02-12 03:53:24,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:53:24,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:53:24,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:24,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:24,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:53:24,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:24,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:24,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,39639,1676173982450': 2023-02-12 03:53:24,367 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-12 03:53:24,367 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-02-12 03:53:24,367 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-12 03:53:24,367 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-12 03:53:24,367 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:24,367 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-12 03:53:24,371 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:24,371 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:24,372 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:24,372 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:53:24,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:24,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:24,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:53:24,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:53:24,372 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:24,372 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:53:24,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:53:24,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:53:24,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:24,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:24,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:53:24,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:24,373 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:24,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:24,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:53:24,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:24,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:24,378 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:24,378 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:53:24,378 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:24,378 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:53:24,378 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:53:24,378 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-02-12 03:53:24,379 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-12 03:53:24,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:53:24,378 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:24,378 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:53:24,379 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:24,379 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-12 03:53:24,379 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:24,379 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-12 03:53:24,379 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:53:24,379 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:24,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:53:24,380 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-12 03:53:24,380 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:24,480 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-12 03:53:24,481 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-12 03:53:24,486 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-12 03:53:24,488 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-12 03:53:24,488 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:24,488 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-02-12 03:53:24,488 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:53:24,488 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-12 03:53:24,488 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-12 03:53:24,489 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:24,489 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:24,509 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:24,509 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:53:24,509 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:53:24,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:53:24,510 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:24,510 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-12 03:53:24,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:24,510 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:24,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-12 03:53:24,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:24,511 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:24,511 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-02-12 03:53:24,511 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:24,512 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-12 03:53:24,512 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:53:24,512 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-12 03:53:24,512 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-12 03:53:24,512 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-12 03:53:24,512 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1676173999793.7219c41156bc54a262cb892cb04282fe. 2023-02-12 03:53:24,513 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1676173999793.7219c41156bc54a262cb892cb04282fe. started... 2023-02-12 03:53:24,513 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 7219c41156bc54a262cb892cb04282fe 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-12 03:53:24,941 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120525f89d6b38044747acf2317a9c145a10 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015120525f89d6b38044747acf2317a9c145a10 2023-02-12 03:53:24,950 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithMonthlyPolicy/7219c41156bc54a262cb892cb04282fe/.tmp/family1/248eb1f871ee4172b7737ae17dbd3c99 2023-02-12 03:53:24,957 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithMonthlyPolicy/7219c41156bc54a262cb892cb04282fe/.tmp/family1/248eb1f871ee4172b7737ae17dbd3c99 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithMonthlyPolicy/7219c41156bc54a262cb892cb04282fe/family1/248eb1f871ee4172b7737ae17dbd3c99 2023-02-12 03:53:24,964 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithMonthlyPolicy/7219c41156bc54a262cb892cb04282fe/family1/248eb1f871ee4172b7737ae17dbd3c99, entries=1, sequenceid=17, filesize=4.9 K 2023-02-12 03:53:24,965 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 7219c41156bc54a262cb892cb04282fe in 452ms, sequenceid=17, compaction requested=true 2023-02-12 03:53:24,965 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 7219c41156bc54a262cb892cb04282fe: 2023-02-12 03:53:24,965 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1676173999793.7219c41156bc54a262cb892cb04282fe. 2023-02-12 03:53:24,965 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-12 03:53:24,965 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-12 03:53:24,965 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:24,965 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-02-12 03:53:24,965 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-02-12 03:53:24,966 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:24,966 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:24,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:24,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:53:24,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:53:24,967 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:24,967 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 03:53:24,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:53:24,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:53:24,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:24,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:24,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:53:24,969 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-02-12 03:53:24,969 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@11d1a1c0[Count = 0] remaining members to acquire global barrier 2023-02-12 03:53:24,969 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-12 03:53:24,969 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:24,970 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:24,970 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:24,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:24,970 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-12 03:53:24,971 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-02-12 03:53:24,971 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:24,971 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-12 03:53:24,971 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,39639,1676173982450' in zk 2023-02-12 03:53:24,972 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-12 03:53:24,972 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:24,972 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:53:24,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:24,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:53:24,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:53:24,972 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-02-12 03:53:24,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:53:24,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:53:24,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:24,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:24,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:53:24,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:24,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:24,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,39639,1676173982450': 2023-02-12 03:53:24,977 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-12 03:53:24,977 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-02-12 03:53:24,977 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-12 03:53:24,977 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-12 03:53:24,977 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:24,977 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-12 03:53:24,986 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:24,986 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:24,987 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:24,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:24,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:53:24,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:53:24,986 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:53:24,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:24,987 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:24,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:53:24,987 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:53:24,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:53:24,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:24,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:24,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:53:24,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:24,988 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:24,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:24,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:53:24,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:24,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:24,990 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:24,990 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:24,990 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:24,990 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:53:24,990 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:24,990 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:53:24,990 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:24,990 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-02-12 03:53:24,990 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-12 03:53:24,990 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:53:24,990 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:53:24,990 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:24,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:53:24,991 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:24,991 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-12 03:53:24,991 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-12 03:53:24,991 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-12 03:53:24,991 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:53:24,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:53:25,091 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-12 03:53:25,092 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-12 03:53:25,097 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-12 03:53:25,099 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-12 03:53:25,099 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:25,099 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-02-12 03:53:25,099 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:53:25,099 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-12 03:53:25,099 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-12 03:53:25,100 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:25,100 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:25,101 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:25,101 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:53:25,101 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:53:25,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:53:25,101 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:25,101 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-12 03:53:25,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:25,102 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:25,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-12 03:53:25,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:25,102 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:25,102 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-02-12 03:53:25,102 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:25,102 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-12 03:53:25,102 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:53:25,103 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-12 03:53:25,103 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-12 03:53:25,103 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-12 03:53:25,103 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1676173999793.7219c41156bc54a262cb892cb04282fe. 2023-02-12 03:53:25,103 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1676173999793.7219c41156bc54a262cb892cb04282fe. started... 2023-02-12 03:53:25,103 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 7219c41156bc54a262cb892cb04282fe 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-12 03:53:25,518 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512289687592762a94719a19c5d42f1ad5780 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512289687592762a94719a19c5d42f1ad5780 2023-02-12 03:53:25,924 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithMonthlyPolicy/7219c41156bc54a262cb892cb04282fe/.tmp/family1/cff0997067ce4e4dad2ec96523af9e49 2023-02-12 03:53:25,931 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithMonthlyPolicy/7219c41156bc54a262cb892cb04282fe/.tmp/family1/cff0997067ce4e4dad2ec96523af9e49 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithMonthlyPolicy/7219c41156bc54a262cb892cb04282fe/family1/cff0997067ce4e4dad2ec96523af9e49 2023-02-12 03:53:25,937 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithMonthlyPolicy/7219c41156bc54a262cb892cb04282fe/family1/cff0997067ce4e4dad2ec96523af9e49, entries=1, sequenceid=21, filesize=4.9 K 2023-02-12 03:53:25,938 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 7219c41156bc54a262cb892cb04282fe in 835ms, sequenceid=21, compaction requested=true 2023-02-12 03:53:25,938 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 7219c41156bc54a262cb892cb04282fe: 2023-02-12 03:53:25,938 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1676173999793.7219c41156bc54a262cb892cb04282fe. 2023-02-12 03:53:25,938 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-12 03:53:25,938 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-12 03:53:25,938 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:25,938 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-02-12 03:53:25,938 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-02-12 03:53:25,940 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:25,940 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:25,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:25,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:53:25,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:53:25,940 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:25,940 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 03:53:25,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:53:25,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:53:25,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:25,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:25,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:53:25,941 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-02-12 03:53:25,941 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4af0601[Count = 0] remaining members to acquire global barrier 2023-02-12 03:53:25,941 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-12 03:53:25,941 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:25,942 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:25,942 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:25,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:25,942 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-12 03:53:25,942 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-02-12 03:53:25,942 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,39639,1676173982450' in zk 2023-02-12 03:53:25,942 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:25,942 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-12 03:53:25,943 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-12 03:53:25,943 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:25,943 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:53:25,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:25,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:53:25,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:53:25,943 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-02-12 03:53:25,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:53:25,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:53:25,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:25,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:25,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:53:25,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:25,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:25,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,39639,1676173982450': 2023-02-12 03:53:25,946 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-12 03:53:25,946 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-02-12 03:53:25,946 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-12 03:53:25,946 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-12 03:53:25,946 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:25,946 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-12 03:53:25,951 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:25,951 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:25,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:25,951 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:25,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:25,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:53:25,951 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:53:25,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:53:25,952 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:53:25,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:53:25,952 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:25,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:53:25,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:25,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:25,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:53:25,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:25,953 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:25,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:25,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:53:25,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:25,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:25,963 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:53:25,963 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:25,963 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:53:25,963 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:25,963 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:53:25,963 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-12 03:53:25,963 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:25,963 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-02-12 03:53:25,963 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-12 03:53:25,963 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:53:25,963 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:25,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:53:25,964 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:25,964 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:25,964 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-12 03:53:25,964 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:25,964 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-12 03:53:25,964 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:53:25,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:53:26,064 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-12 03:53:26,065 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-12 03:53:26,071 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-12 03:53:26,073 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-12 03:53:26,073 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:26,073 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-02-12 03:53:26,073 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:53:26,074 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-12 03:53:26,074 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-12 03:53:26,074 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:26,074 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:26,075 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:26,075 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:53:26,075 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:53:26,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:53:26,075 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:26,075 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-12 03:53:26,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:26,076 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:26,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-12 03:53:26,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:26,076 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:26,076 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-02-12 03:53:26,077 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:26,077 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-12 03:53:26,077 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:53:26,077 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-12 03:53:26,077 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-12 03:53:26,078 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-12 03:53:26,078 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1676173999793.7219c41156bc54a262cb892cb04282fe. 2023-02-12 03:53:26,078 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1676173999793.7219c41156bc54a262cb892cb04282fe. started... 2023-02-12 03:53:26,078 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 7219c41156bc54a262cb892cb04282fe 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-12 03:53:26,498 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231d487895838734b53a63b9e8ee8dfddbf to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151231d487895838734b53a63b9e8ee8dfddbf 2023-02-12 03:53:26,905 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithMonthlyPolicy/7219c41156bc54a262cb892cb04282fe/.tmp/family1/8c3e072a828f42c4a606edf7ac9abcb6 2023-02-12 03:53:26,911 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithMonthlyPolicy/7219c41156bc54a262cb892cb04282fe/.tmp/family1/8c3e072a828f42c4a606edf7ac9abcb6 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithMonthlyPolicy/7219c41156bc54a262cb892cb04282fe/family1/8c3e072a828f42c4a606edf7ac9abcb6 2023-02-12 03:53:26,916 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithMonthlyPolicy/7219c41156bc54a262cb892cb04282fe/family1/8c3e072a828f42c4a606edf7ac9abcb6, entries=1, sequenceid=25, filesize=4.9 K 2023-02-12 03:53:26,916 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 7219c41156bc54a262cb892cb04282fe in 838ms, sequenceid=25, compaction requested=true 2023-02-12 03:53:26,917 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 7219c41156bc54a262cb892cb04282fe: 2023-02-12 03:53:26,917 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1676173999793.7219c41156bc54a262cb892cb04282fe. 2023-02-12 03:53:26,917 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-12 03:53:26,917 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-12 03:53:26,917 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:26,917 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-02-12 03:53:26,917 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-02-12 03:53:26,918 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:26,918 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:26,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:26,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:53:26,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:53:26,918 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:26,918 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 03:53:26,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:53:26,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:53:26,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:26,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:26,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:53:26,920 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-02-12 03:53:26,920 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@71b9666d[Count = 0] remaining members to acquire global barrier 2023-02-12 03:53:26,920 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-12 03:53:26,920 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:26,921 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:26,921 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:26,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:26,921 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-12 03:53:26,921 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-02-12 03:53:26,921 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,39639,1676173982450' in zk 2023-02-12 03:53:26,921 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:26,921 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-12 03:53:26,922 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:26,922 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-12 03:53:26,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:26,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:53:26,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:53:26,922 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:53:26,922 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-02-12 03:53:26,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:53:26,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:53:26,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:26,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:26,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:53:26,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:26,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:26,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,39639,1676173982450': 2023-02-12 03:53:26,925 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-12 03:53:26,925 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-02-12 03:53:26,925 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-12 03:53:26,925 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-12 03:53:26,925 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:26,925 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-12 03:53:26,926 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:26,926 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:26,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:26,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:53:26,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:53:26,926 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:26,926 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:53:26,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:26,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:53:26,926 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:26,927 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:53:26,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:53:26,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:26,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:26,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:53:26,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:26,928 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:26,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:26,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:53:26,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:26,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:26,930 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:26,930 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:26,930 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:53:26,930 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:26,930 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:26,930 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:53:26,930 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-12 03:53:26,930 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:53:26,930 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:26,930 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:53:26,931 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:26,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:53:26,930 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-02-12 03:53:26,931 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-12 03:53:26,931 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:26,931 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:53:26,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:53:26,931 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-12 03:53:26,931 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-12 03:53:27,031 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-12 03:53:27,033 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-12 03:53:27,043 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-12 03:53:27,046 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-12 03:53:27,047 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:27,047 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-02-12 03:53:27,047 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:53:27,048 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-12 03:53:27,048 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-12 03:53:27,049 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:27,049 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:27,051 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:53:27,051 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:27,051 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:53:27,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:53:27,052 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:27,052 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-12 03:53:27,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:27,053 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:27,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-12 03:53:27,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:27,054 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:27,054 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-02-12 03:53:27,055 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:27,055 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-12 03:53:27,055 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:53:27,055 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-12 03:53:27,056 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-12 03:53:27,056 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-12 03:53:27,056 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1676173999793.7219c41156bc54a262cb892cb04282fe. 2023-02-12 03:53:27,056 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1676173999793.7219c41156bc54a262cb892cb04282fe. started... 2023-02-12 03:53:27,056 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 7219c41156bc54a262cb892cb04282fe 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-12 03:53:27,484 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101a20f07cc93704d0cbb1fd90527bc50f0 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160101a20f07cc93704d0cbb1fd90527bc50f0 2023-02-12 03:53:27,891 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithMonthlyPolicy/7219c41156bc54a262cb892cb04282fe/.tmp/family1/202dac0bac464e6fba0878c89f02c286 2023-02-12 03:53:27,897 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithMonthlyPolicy/7219c41156bc54a262cb892cb04282fe/.tmp/family1/202dac0bac464e6fba0878c89f02c286 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithMonthlyPolicy/7219c41156bc54a262cb892cb04282fe/family1/202dac0bac464e6fba0878c89f02c286 2023-02-12 03:53:27,903 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithMonthlyPolicy/7219c41156bc54a262cb892cb04282fe/family1/202dac0bac464e6fba0878c89f02c286, entries=1, sequenceid=29, filesize=4.9 K 2023-02-12 03:53:27,904 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 7219c41156bc54a262cb892cb04282fe in 848ms, sequenceid=29, compaction requested=true 2023-02-12 03:53:27,904 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 7219c41156bc54a262cb892cb04282fe: 2023-02-12 03:53:27,904 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1676173999793.7219c41156bc54a262cb892cb04282fe. 2023-02-12 03:53:27,905 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-12 03:53:27,905 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-12 03:53:27,905 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:27,905 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-02-12 03:53:27,905 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-02-12 03:53:27,906 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:27,906 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:27,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:27,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:53:27,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:53:27,906 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:27,906 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 03:53:27,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:53:27,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:53:27,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:27,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:27,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:53:27,907 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-02-12 03:53:27,907 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7281f4[Count = 0] remaining members to acquire global barrier 2023-02-12 03:53:27,907 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-12 03:53:27,907 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:27,908 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:27,908 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:27,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:27,908 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:27,908 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-12 03:53:27,908 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-12 03:53:27,908 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-02-12 03:53:27,908 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,39639,1676173982450' in zk 2023-02-12 03:53:27,909 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:27,909 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-12 03:53:27,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:27,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:53:27,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:53:27,909 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:53:27,909 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-02-12 03:53:27,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:53:27,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:53:27,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:27,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:27,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:53:27,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:27,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:27,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,39639,1676173982450': 2023-02-12 03:53:27,912 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-12 03:53:27,912 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-02-12 03:53:27,912 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-12 03:53:27,912 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-12 03:53:27,912 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:27,912 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-12 03:53:27,913 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:27,913 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:27,913 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:27,913 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:53:27,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:27,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:27,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:53:27,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:53:27,919 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:27,919 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:53:27,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:53:27,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:53:27,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:27,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:27,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:53:27,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:27,920 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:27,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:27,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:53:27,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:27,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:27,928 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:27,928 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:53:27,928 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-12 03:53:27,928 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-02-12 03:53:27,928 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-12 03:53:27,928 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:27,928 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:53:27,928 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:27,928 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:53:27,928 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:53:27,929 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-12 03:53:27,929 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-12 03:53:27,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:53:27,929 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:27,929 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:27,929 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:27,929 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:27,930 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:53:27,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:53:28,029 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-12 03:53:28,031 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-12 03:53:28,037 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-12 03:53:28,039 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-12 03:53:28,039 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:28,040 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-02-12 03:53:28,040 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:53:28,040 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-12 03:53:28,040 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-12 03:53:28,041 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:28,041 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:28,042 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:28,042 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:53:28,042 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:53:28,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:53:28,042 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:28,042 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-12 03:53:28,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:28,043 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:28,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-12 03:53:28,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:28,043 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:28,043 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-02-12 03:53:28,043 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:28,043 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-12 03:53:28,043 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:53:28,044 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-12 03:53:28,044 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-12 03:53:28,044 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-12 03:53:28,044 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1676173999793.7219c41156bc54a262cb892cb04282fe. 2023-02-12 03:53:28,044 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1676173999793.7219c41156bc54a262cb892cb04282fe. started... 2023-02-12 03:53:28,044 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 7219c41156bc54a262cb892cb04282fe 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-12 03:53:28,461 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010303266eeadd0c4e54be7526d012135480 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2016010303266eeadd0c4e54be7526d012135480 2023-02-12 03:53:28,868 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithMonthlyPolicy/7219c41156bc54a262cb892cb04282fe/.tmp/family1/604660a5d80346b58243549a35b5ec06 2023-02-12 03:53:28,875 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithMonthlyPolicy/7219c41156bc54a262cb892cb04282fe/.tmp/family1/604660a5d80346b58243549a35b5ec06 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithMonthlyPolicy/7219c41156bc54a262cb892cb04282fe/family1/604660a5d80346b58243549a35b5ec06 2023-02-12 03:53:28,882 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithMonthlyPolicy/7219c41156bc54a262cb892cb04282fe/family1/604660a5d80346b58243549a35b5ec06, entries=1, sequenceid=33, filesize=4.9 K 2023-02-12 03:53:28,884 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 7219c41156bc54a262cb892cb04282fe in 840ms, sequenceid=33, compaction requested=true 2023-02-12 03:53:28,884 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 7219c41156bc54a262cb892cb04282fe: 2023-02-12 03:53:28,884 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1676173999793.7219c41156bc54a262cb892cb04282fe. 2023-02-12 03:53:28,884 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-12 03:53:28,884 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-12 03:53:28,884 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:28,884 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-02-12 03:53:28,884 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-02-12 03:53:28,886 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:28,886 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:28,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:28,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:53:28,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:53:28,886 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:28,886 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 03:53:28,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:53:28,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:53:28,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:28,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:28,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:53:28,889 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-02-12 03:53:28,889 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1cb1ff9b[Count = 0] remaining members to acquire global barrier 2023-02-12 03:53:28,889 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-12 03:53:28,889 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:28,891 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:28,891 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:28,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:28,892 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-12 03:53:28,892 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-02-12 03:53:28,892 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,39639,1676173982450' in zk 2023-02-12 03:53:28,892 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:28,892 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-12 03:53:28,893 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-12 03:53:28,893 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:28,893 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:53:28,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:28,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:53:28,893 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-02-12 03:53:28,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:53:28,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:53:28,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:53:28,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:28,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:28,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:53:28,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:28,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:28,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,39639,1676173982450': 2023-02-12 03:53:28,899 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-12 03:53:28,899 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-02-12 03:53:28,900 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-12 03:53:28,900 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-12 03:53:28,900 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:28,900 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-12 03:53:28,912 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:28,912 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:28,912 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:28,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:28,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:53:28,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:53:28,912 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:53:28,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:28,912 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:28,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:53:28,912 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:53:28,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:53:28,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:28,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:28,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:53:28,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:28,914 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:28,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:28,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:53:28,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:28,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:28,916 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:28,916 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:28,916 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:53:28,916 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-02-12 03:53:28,916 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-12 03:53:28,916 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:53:28,916 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:53:28,916 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-12 03:53:28,916 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:53:28,916 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:28,917 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-12 03:53:28,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:53:28,917 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-12 03:53:28,917 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:28,917 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:28,917 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:28,917 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:28,917 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:53:28,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:53:29,017 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-12 03:53:29,019 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-12 03:53:29,024 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-12 03:53:29,027 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-12 03:53:29,027 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:29,027 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-02-12 03:53:29,028 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:53:29,029 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-12 03:53:29,029 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-12 03:53:29,029 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:29,029 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:29,030 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:29,030 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:53:29,030 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:53:29,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:53:29,030 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:29,030 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-12 03:53:29,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:29,031 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:29,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-12 03:53:29,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:29,031 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:29,031 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-02-12 03:53:29,031 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:29,031 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-12 03:53:29,031 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:53:29,032 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-12 03:53:29,032 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-12 03:53:29,032 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-12 03:53:29,032 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1676173999793.7219c41156bc54a262cb892cb04282fe. 2023-02-12 03:53:29,032 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1676173999793.7219c41156bc54a262cb892cb04282fe. started... 2023-02-12 03:53:29,032 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 7219c41156bc54a262cb892cb04282fe 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-12 03:53:29,463 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015090747a41a965946402bab346678a03cc07a to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015090747a41a965946402bab346678a03cc07a 2023-02-12 03:53:29,868 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithMonthlyPolicy/7219c41156bc54a262cb892cb04282fe/.tmp/family1/a9cacf14248048f9953309224abcabd7 2023-02-12 03:53:29,875 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithMonthlyPolicy/7219c41156bc54a262cb892cb04282fe/.tmp/family1/a9cacf14248048f9953309224abcabd7 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithMonthlyPolicy/7219c41156bc54a262cb892cb04282fe/family1/a9cacf14248048f9953309224abcabd7 2023-02-12 03:53:29,880 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithMonthlyPolicy/7219c41156bc54a262cb892cb04282fe/family1/a9cacf14248048f9953309224abcabd7, entries=1, sequenceid=37, filesize=4.9 K 2023-02-12 03:53:29,881 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 7219c41156bc54a262cb892cb04282fe in 849ms, sequenceid=37, compaction requested=true 2023-02-12 03:53:29,882 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 7219c41156bc54a262cb892cb04282fe: 2023-02-12 03:53:29,882 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1676173999793.7219c41156bc54a262cb892cb04282fe. 2023-02-12 03:53:29,882 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-12 03:53:29,882 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-12 03:53:29,882 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:29,882 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-02-12 03:53:29,882 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-02-12 03:53:29,883 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:29,883 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:29,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:29,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:53:29,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:53:29,883 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:29,884 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 03:53:29,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:53:29,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:53:29,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:29,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:29,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:53:29,885 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-02-12 03:53:29,885 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@60526d02[Count = 0] remaining members to acquire global barrier 2023-02-12 03:53:29,885 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-12 03:53:29,885 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:29,885 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:29,886 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:29,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:29,886 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-12 03:53:29,886 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-02-12 03:53:29,886 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,39639,1676173982450' in zk 2023-02-12 03:53:29,886 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:29,886 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-12 03:53:29,887 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-12 03:53:29,887 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:29,887 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:53:29,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:29,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:53:29,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:53:29,887 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-02-12 03:53:29,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:53:29,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:53:29,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:29,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:29,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:53:29,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:29,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:29,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,39639,1676173982450': 2023-02-12 03:53:29,890 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-12 03:53:29,890 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-02-12 03:53:29,890 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-12 03:53:29,890 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-12 03:53:29,890 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:29,890 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-12 03:53:29,891 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:29,891 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:29,891 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:29,891 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:53:29,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:29,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:29,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:53:29,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:53:29,891 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:29,891 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:53:29,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:53:29,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:53:29,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:29,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:29,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:53:29,892 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:29,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:29,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:29,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:53:29,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:29,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:29,894 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:53:29,894 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:29,894 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:53:29,894 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:29,894 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:53:29,894 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:53:29,894 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-02-12 03:53:29,895 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-12 03:53:29,894 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:29,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:53:29,895 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:29,895 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:29,895 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-12 03:53:29,895 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-12 03:53:29,895 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-12 03:53:29,895 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:29,895 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:53:29,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:53:29,895 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:29,995 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-12 03:53:29,996 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-12 03:53:30,002 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-12 03:53:30,005 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-12 03:53:30,005 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:30,005 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-02-12 03:53:30,005 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:53:30,005 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-12 03:53:30,005 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-12 03:53:30,006 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:30,006 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:30,007 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:53:30,007 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:30,007 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:53:30,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:53:30,007 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:30,007 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-12 03:53:30,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:30,007 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:30,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-12 03:53:30,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:30,008 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:30,008 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-02-12 03:53:30,008 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:30,008 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-12 03:53:30,008 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:53:30,009 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-12 03:53:30,009 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-12 03:53:30,009 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-12 03:53:30,009 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1676173999793.7219c41156bc54a262cb892cb04282fe. 2023-02-12 03:53:30,010 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1676173999793.7219c41156bc54a262cb892cb04282fe. started... 2023-02-12 03:53:30,010 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 7219c41156bc54a262cb892cb04282fe 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-12 03:53:30,429 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120f5cb8f99a4be4ae5af9d1f4efcf4117d to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151120f5cb8f99a4be4ae5af9d1f4efcf4117d 2023-02-12 03:53:30,836 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithMonthlyPolicy/7219c41156bc54a262cb892cb04282fe/.tmp/family1/c3099f61ace04ca18f8f80f648c221bd 2023-02-12 03:53:30,841 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithMonthlyPolicy/7219c41156bc54a262cb892cb04282fe/.tmp/family1/c3099f61ace04ca18f8f80f648c221bd as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithMonthlyPolicy/7219c41156bc54a262cb892cb04282fe/family1/c3099f61ace04ca18f8f80f648c221bd 2023-02-12 03:53:30,846 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithMonthlyPolicy/7219c41156bc54a262cb892cb04282fe/family1/c3099f61ace04ca18f8f80f648c221bd, entries=1, sequenceid=41, filesize=4.9 K 2023-02-12 03:53:30,847 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 7219c41156bc54a262cb892cb04282fe in 837ms, sequenceid=41, compaction requested=true 2023-02-12 03:53:30,847 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 7219c41156bc54a262cb892cb04282fe: 2023-02-12 03:53:30,847 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1676173999793.7219c41156bc54a262cb892cb04282fe. 2023-02-12 03:53:30,847 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-12 03:53:30,847 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-12 03:53:30,847 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:30,847 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-02-12 03:53:30,847 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-02-12 03:53:30,849 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:30,849 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:30,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:30,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:53:30,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:53:30,849 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:30,849 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 03:53:30,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:53:30,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:53:30,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:30,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:30,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:53:30,851 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-02-12 03:53:30,851 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5a62e56b[Count = 0] remaining members to acquire global barrier 2023-02-12 03:53:30,851 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-12 03:53:30,851 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:30,852 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:30,852 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:30,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:30,852 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-12 03:53:30,852 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-02-12 03:53:30,852 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,39639,1676173982450' in zk 2023-02-12 03:53:30,852 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:30,852 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-12 03:53:30,853 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:30,853 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-12 03:53:30,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:30,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:53:30,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:53:30,853 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:53:30,853 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-02-12 03:53:30,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:53:30,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:53:30,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:30,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:30,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:53:30,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:30,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:30,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,39639,1676173982450': 2023-02-12 03:53:30,856 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-12 03:53:30,856 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-02-12 03:53:30,856 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-12 03:53:30,856 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-12 03:53:30,856 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:30,856 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-12 03:53:30,857 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:30,857 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:30,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:30,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:53:30,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:53:30,857 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:30,857 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:53:30,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:30,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:53:30,857 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:30,857 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:53:30,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:53:30,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:30,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:30,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:53:30,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:30,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:30,858 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:30,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:53:30,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:30,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:30,860 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:53:30,860 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:53:30,860 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:53:30,860 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:53:30,860 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:30,860 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-12 03:53:30,860 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-02-12 03:53:30,861 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-12 03:53:30,861 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:30,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:53:30,861 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:30,862 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:30,862 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:30,862 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:30,862 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:30,862 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-12 03:53:30,862 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:53:30,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:53:30,862 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-12 03:53:30,962 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-12 03:53:30,963 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-12 03:53:30,964 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=40099] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithMonthlyPolicy 2023-02-12 03:53:30,966 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676173985818] procedure2.ProcedureExecutor(1029): Stored pid=22, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-02-12 03:53:30,967 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=22, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-02-12 03:53:30,968 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676173985818] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithMonthlyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-12 03:53:30,968 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=22, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1676174610968 2023-02-12 03:53:30,969 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676173985818] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-12 03:53:30,971 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676173985818] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithMonthlyPolicy' and column 'family1' 2023-02-12 03:53:30,971 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676173985818] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-02-12 03:53:30,972 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676173985818] zookeeper.ReadOnlyZKClient(139): Connect 0x6f077d48 to 127.0.0.1:59556 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 03:53:30,976 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676173985818] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@616bef79, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 03:53:30,977 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-02-12 03:53:31,451 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010357a0bd4e15534b71b7e9a10f754cfce7 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2016010357a0bd4e15534b71b7e9a10f754cfce7 2023-02-12 03:53:31,453 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-02-12 03:53:31,470 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-12 03:53:31,472 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:43338, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-12 03:53:31,481 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-12 03:53:31,482 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:45484, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-12 03:53:31,512 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/724672ded8324aef8604a41abab48d07 first=Optional[r5] last=Optional[r6] 2023-02-12 03:53:31,513 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1676173999793.7219c41156bc54a262cb892cb04282fe., hostname=jenkins-hbase20.apache.org,39639,1676173982450, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/724672ded8324aef8604a41abab48d07}] 2023-02-12 03:53:31,518 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/724672ded8324aef8604a41abab48d07 for inclusion in 7219c41156bc54a262cb892cb04282fe/family1 2023-02-12 03:53:31,522 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HStore(775): HFile bounds: first=r5 last=r6 2023-02-12 03:53:31,522 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HStore(777): Region bounds: first= last= 2023-02-12 03:53:31,522 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HRegion(2445): Flush status journal for 7219c41156bc54a262cb892cb04282fe: 2023-02-12 03:53:31,523 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/724672ded8324aef8604a41abab48d07 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/staging/jenkins__testMajorCompactionWithMonthlyPolicy__ipp1kem414g4arvsb4dqv7vkfueec1v1qn8d4eqrirqtfjelqembcdcc7v0va2ur/family1/724672ded8324aef8604a41abab48d07 2023-02-12 03:53:31,526 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/staging/jenkins__testMajorCompactionWithMonthlyPolicy__ipp1kem414g4arvsb4dqv7vkfueec1v1qn8d4eqrirqtfjelqembcdcc7v0va2ur/family1/724672ded8324aef8604a41abab48d07 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithMonthlyPolicy/7219c41156bc54a262cb892cb04282fe/family1/34965bc8a68b4548a84840ee77e97f19_SeqId_44_ 2023-02-12 03:53:31,527 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/staging/jenkins__testMajorCompactionWithMonthlyPolicy__ipp1kem414g4arvsb4dqv7vkfueec1v1qn8d4eqrirqtfjelqembcdcc7v0va2ur/family1/724672ded8324aef8604a41abab48d07 into 7219c41156bc54a262cb892cb04282fe/family1 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithMonthlyPolicy/7219c41156bc54a262cb892cb04282fe/family1/34965bc8a68b4548a84840ee77e97f19_SeqId_44_ - updating store file list. 2023-02-12 03:53:31,535 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithMonthlyPolicy/7219c41156bc54a262cb892cb04282fe/family1/34965bc8a68b4548a84840ee77e97f19_SeqId_44_ into 7219c41156bc54a262cb892cb04282fe/family1 2023-02-12 03:53:31,536 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/staging/jenkins__testMajorCompactionWithMonthlyPolicy__ipp1kem414g4arvsb4dqv7vkfueec1v1qn8d4eqrirqtfjelqembcdcc7v0va2ur/family1/724672ded8324aef8604a41abab48d07 into 7219c41156bc54a262cb892cb04282fe/family1 (new location: hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithMonthlyPolicy/7219c41156bc54a262cb892cb04282fe/family1/34965bc8a68b4548a84840ee77e97f19_SeqId_44_) 2023-02-12 03:53:31,536 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/staging/jenkins__testMajorCompactionWithMonthlyPolicy__ipp1kem414g4arvsb4dqv7vkfueec1v1qn8d4eqrirqtfjelqembcdcc7v0va2ur/family1/724672ded8324aef8604a41abab48d07 2023-02-12 03:53:31,536 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-02-12 03:53:31,541 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 50903 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-02-12 03:53:31,541 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HStore(1912): 7219c41156bc54a262cb892cb04282fe/family1 is initiating minor compaction 2023-02-12 03:53:31,541 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@36c4606a; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-12 03:53:31,541 INFO [RS:0;jenkins-hbase20:39639-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 7219c41156bc54a262cb892cb04282fe/family1 in testMajorCompactionWithMonthlyPolicy,,1676173999793.7219c41156bc54a262cb892cb04282fe. 2023-02-12 03:53:31,541 INFO [RS:0;jenkins-hbase20:39639-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithMonthlyPolicy/7219c41156bc54a262cb892cb04282fe/family1/66b5c3f517074f1a96554f8f051fc201, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithMonthlyPolicy/7219c41156bc54a262cb892cb04282fe/family1/53c7aab95448468e9728f3790e8440dd, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithMonthlyPolicy/7219c41156bc54a262cb892cb04282fe/family1/248eb1f871ee4172b7737ae17dbd3c99, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithMonthlyPolicy/7219c41156bc54a262cb892cb04282fe/family1/cff0997067ce4e4dad2ec96523af9e49, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithMonthlyPolicy/7219c41156bc54a262cb892cb04282fe/family1/8c3e072a828f42c4a606edf7ac9abcb6, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithMonthlyPolicy/7219c41156bc54a262cb892cb04282fe/family1/202dac0bac464e6fba0878c89f02c286, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithMonthlyPolicy/7219c41156bc54a262cb892cb04282fe/family1/604660a5d80346b58243549a35b5ec06, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithMonthlyPolicy/7219c41156bc54a262cb892cb04282fe/family1/a9cacf14248048f9953309224abcabd7, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithMonthlyPolicy/7219c41156bc54a262cb892cb04282fe/family1/c3099f61ace04ca18f8f80f648c221bd, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithMonthlyPolicy/7219c41156bc54a262cb892cb04282fe/family1/34965bc8a68b4548a84840ee77e97f19_SeqId_44_] into tmpdir=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithMonthlyPolicy/7219c41156bc54a262cb892cb04282fe/.tmp, totalSize=49.7 K 2023-02-12 03:53:31,541 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] compactions.Compactor(207): Compacting 66b5c3f517074f1a96554f8f051fc201, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-02-12 03:53:31,541 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] compactions.Compactor(207): Compacting 53c7aab95448468e9728f3790e8440dd, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-02-12 03:53:31,542 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] compactions.Compactor(207): Compacting 248eb1f871ee4172b7737ae17dbd3c99, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-02-12 03:53:31,542 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] compactions.Compactor(207): Compacting cff0997067ce4e4dad2ec96523af9e49, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-02-12 03:53:31,542 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] compactions.Compactor(207): Compacting 8c3e072a828f42c4a606edf7ac9abcb6, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-02-12 03:53:31,542 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] compactions.Compactor(207): Compacting 202dac0bac464e6fba0878c89f02c286, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-02-12 03:53:31,542 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] compactions.Compactor(207): Compacting 604660a5d80346b58243549a35b5ec06, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-02-12 03:53:31,542 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] compactions.Compactor(207): Compacting a9cacf14248048f9953309224abcabd7, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-02-12 03:53:31,542 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] compactions.Compactor(207): Compacting c3099f61ace04ca18f8f80f648c221bd, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-02-12 03:53:31,542 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] compactions.Compactor(207): Compacting 34965bc8a68b4548a84840ee77e97f19_SeqId_44_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=45 2023-02-12 03:53:31,566 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-02-12 03:53:31,568 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-12 03:53:31,570 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160101a20f07cc93704d0cbb1fd90527bc50f0 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160101a20f07cc93704d0cbb1fd90527bc50f0 2023-02-12 03:53:31,571 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2016010303266eeadd0c4e54be7526d012135480 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2016010303266eeadd0c4e54be7526d012135480 2023-02-12 03:53:31,572 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 2 expired mob files are deleted 2023-02-12 03:53:31,572 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101' 2023-02-12 03:53:31,573 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-02-12 03:53:31,573 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-02-12 03:53:31,593 INFO [RS:0;jenkins-hbase20:39639-shortCompactions-0] throttle.PressureAwareThroughputController(145): 7219c41156bc54a262cb892cb04282fe#family1#compaction#22 average throughput is 0.68 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-12 03:53:31,962 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-12 03:53:31,963 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7ed7ad0b to 127.0.0.1:59556 2023-02-12 03:53:31,963 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 03:53:31,964 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-12 03:53:31,964 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x67ee259c to 127.0.0.1:59556 2023-02-12 03:53:31,964 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 03:53:32,025 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithMonthlyPolicy/7219c41156bc54a262cb892cb04282fe/.tmp/family1/73ecf8ee74cd42fb95c78b64543aa2c8 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithMonthlyPolicy/7219c41156bc54a262cb892cb04282fe/family1/73ecf8ee74cd42fb95c78b64543aa2c8 2023-02-12 03:53:32,031 INFO [RS:0;jenkins-hbase20:39639-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 7219c41156bc54a262cb892cb04282fe/family1 of 7219c41156bc54a262cb892cb04282fe into 73ecf8ee74cd42fb95c78b64543aa2c8(size=6.6 K), total size for store is 172.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-12 03:53:32,032 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 7219c41156bc54a262cb892cb04282fe: 2023-02-12 03:53:32,032 INFO [RS:0;jenkins-hbase20:39639-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithMonthlyPolicy,,1676173999793.7219c41156bc54a262cb892cb04282fe., storeName=family1, fileCount=10, fileSize=49.7 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.2 K), priority=2, time=1676174011541; duration=0sec 2023-02-12 03:53:32,032 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-12 03:53:32,040 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231fcb7da4f2cf4443498ed77f6a08a01cc to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151231fcb7da4f2cf4443498ed77f6a08a01cc 2023-02-12 03:53:32,041 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-02-12 03:53:32,056 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithMonthlyPolicy/7219c41156bc54a262cb892cb04282fe/family1/66b5c3f517074f1a96554f8f051fc201, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithMonthlyPolicy/7219c41156bc54a262cb892cb04282fe/family1/53c7aab95448468e9728f3790e8440dd, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithMonthlyPolicy/7219c41156bc54a262cb892cb04282fe/family1/248eb1f871ee4172b7737ae17dbd3c99, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithMonthlyPolicy/7219c41156bc54a262cb892cb04282fe/family1/cff0997067ce4e4dad2ec96523af9e49, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithMonthlyPolicy/7219c41156bc54a262cb892cb04282fe/family1/8c3e072a828f42c4a606edf7ac9abcb6, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithMonthlyPolicy/7219c41156bc54a262cb892cb04282fe/family1/202dac0bac464e6fba0878c89f02c286, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithMonthlyPolicy/7219c41156bc54a262cb892cb04282fe/family1/604660a5d80346b58243549a35b5ec06, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithMonthlyPolicy/7219c41156bc54a262cb892cb04282fe/family1/a9cacf14248048f9953309224abcabd7, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithMonthlyPolicy/7219c41156bc54a262cb892cb04282fe/family1/c3099f61ace04ca18f8f80f648c221bd, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithMonthlyPolicy/7219c41156bc54a262cb892cb04282fe/family1/34965bc8a68b4548a84840ee77e97f19_SeqId_44_] to archive 2023-02-12 03:53:32,057 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-12 03:53:32,060 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithMonthlyPolicy/7219c41156bc54a262cb892cb04282fe/family1/66b5c3f517074f1a96554f8f051fc201 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMajorCompactionWithMonthlyPolicy/7219c41156bc54a262cb892cb04282fe/family1/66b5c3f517074f1a96554f8f051fc201 2023-02-12 03:53:32,061 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithMonthlyPolicy/7219c41156bc54a262cb892cb04282fe/family1/53c7aab95448468e9728f3790e8440dd to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMajorCompactionWithMonthlyPolicy/7219c41156bc54a262cb892cb04282fe/family1/53c7aab95448468e9728f3790e8440dd 2023-02-12 03:53:32,065 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithMonthlyPolicy/7219c41156bc54a262cb892cb04282fe/family1/248eb1f871ee4172b7737ae17dbd3c99 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMajorCompactionWithMonthlyPolicy/7219c41156bc54a262cb892cb04282fe/family1/248eb1f871ee4172b7737ae17dbd3c99 2023-02-12 03:53:32,067 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithMonthlyPolicy/7219c41156bc54a262cb892cb04282fe/family1/cff0997067ce4e4dad2ec96523af9e49 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMajorCompactionWithMonthlyPolicy/7219c41156bc54a262cb892cb04282fe/family1/cff0997067ce4e4dad2ec96523af9e49 2023-02-12 03:53:32,068 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithMonthlyPolicy/7219c41156bc54a262cb892cb04282fe/family1/8c3e072a828f42c4a606edf7ac9abcb6 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMajorCompactionWithMonthlyPolicy/7219c41156bc54a262cb892cb04282fe/family1/8c3e072a828f42c4a606edf7ac9abcb6 2023-02-12 03:53:32,070 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithMonthlyPolicy/7219c41156bc54a262cb892cb04282fe/family1/202dac0bac464e6fba0878c89f02c286 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMajorCompactionWithMonthlyPolicy/7219c41156bc54a262cb892cb04282fe/family1/202dac0bac464e6fba0878c89f02c286 2023-02-12 03:53:32,072 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithMonthlyPolicy/7219c41156bc54a262cb892cb04282fe/family1/604660a5d80346b58243549a35b5ec06 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMajorCompactionWithMonthlyPolicy/7219c41156bc54a262cb892cb04282fe/family1/604660a5d80346b58243549a35b5ec06 2023-02-12 03:53:32,074 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithMonthlyPolicy/7219c41156bc54a262cb892cb04282fe/family1/a9cacf14248048f9953309224abcabd7 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMajorCompactionWithMonthlyPolicy/7219c41156bc54a262cb892cb04282fe/family1/a9cacf14248048f9953309224abcabd7 2023-02-12 03:53:32,076 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithMonthlyPolicy/7219c41156bc54a262cb892cb04282fe/family1/c3099f61ace04ca18f8f80f648c221bd to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMajorCompactionWithMonthlyPolicy/7219c41156bc54a262cb892cb04282fe/family1/c3099f61ace04ca18f8f80f648c221bd 2023-02-12 03:53:32,077 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithMonthlyPolicy/7219c41156bc54a262cb892cb04282fe/family1/34965bc8a68b4548a84840ee77e97f19_SeqId_44_ to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMajorCompactionWithMonthlyPolicy/7219c41156bc54a262cb892cb04282fe/family1/34965bc8a68b4548a84840ee77e97f19_SeqId_44_ 2023-02-12 03:53:32,084 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/e347db858c684ce9910564164b0a5b53 first=Optional[r1] last=Optional[r4] 2023-02-12 03:53:32,085 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1676173999793.7219c41156bc54a262cb892cb04282fe., hostname=jenkins-hbase20.apache.org,39639,1676173982450, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/e347db858c684ce9910564164b0a5b53}] 2023-02-12 03:53:32,088 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/e347db858c684ce9910564164b0a5b53 for inclusion in 7219c41156bc54a262cb892cb04282fe/family1 2023-02-12 03:53:32,091 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HStore(775): HFile bounds: first=r1 last=r4 2023-02-12 03:53:32,091 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HStore(777): Region bounds: first= last= 2023-02-12 03:53:32,092 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HRegion(2445): Flush status journal for 7219c41156bc54a262cb892cb04282fe: 2023-02-12 03:53:32,092 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/e347db858c684ce9910564164b0a5b53 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/staging/jenkins__testMajorCompactionWithMonthlyPolicy__6pup1br52brpa7gtfingr37qc4bvi18guhueukf97e7uppcj69ghcep9mqhvrl79/family1/e347db858c684ce9910564164b0a5b53 2023-02-12 03:53:32,095 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/staging/jenkins__testMajorCompactionWithMonthlyPolicy__6pup1br52brpa7gtfingr37qc4bvi18guhueukf97e7uppcj69ghcep9mqhvrl79/family1/e347db858c684ce9910564164b0a5b53 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithMonthlyPolicy/7219c41156bc54a262cb892cb04282fe/family1/daf656c8745043e99adc3ab53abe278e_SeqId_47_ 2023-02-12 03:53:32,096 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/staging/jenkins__testMajorCompactionWithMonthlyPolicy__6pup1br52brpa7gtfingr37qc4bvi18guhueukf97e7uppcj69ghcep9mqhvrl79/family1/e347db858c684ce9910564164b0a5b53 into 7219c41156bc54a262cb892cb04282fe/family1 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithMonthlyPolicy/7219c41156bc54a262cb892cb04282fe/family1/daf656c8745043e99adc3ab53abe278e_SeqId_47_ - updating store file list. 2023-02-12 03:53:32,102 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithMonthlyPolicy/7219c41156bc54a262cb892cb04282fe/family1/daf656c8745043e99adc3ab53abe278e_SeqId_47_ into 7219c41156bc54a262cb892cb04282fe/family1 2023-02-12 03:53:32,102 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/staging/jenkins__testMajorCompactionWithMonthlyPolicy__6pup1br52brpa7gtfingr37qc4bvi18guhueukf97e7uppcj69ghcep9mqhvrl79/family1/e347db858c684ce9910564164b0a5b53 into 7219c41156bc54a262cb892cb04282fe/family1 (new location: hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithMonthlyPolicy/7219c41156bc54a262cb892cb04282fe/family1/daf656c8745043e99adc3ab53abe278e_SeqId_47_) 2023-02-12 03:53:32,103 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/staging/jenkins__testMajorCompactionWithMonthlyPolicy__6pup1br52brpa7gtfingr37qc4bvi18guhueukf97e7uppcj69ghcep9mqhvrl79/family1/e347db858c684ce9910564164b0a5b53 2023-02-12 03:53:32,103 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-02-12 03:53:32,106 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 182349 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-02-12 03:53:32,106 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HStore(1912): 7219c41156bc54a262cb892cb04282fe/family1 is initiating minor compaction (all files) 2023-02-12 03:53:32,106 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@69bd98cd; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-12 03:53:32,106 INFO [RS:0;jenkins-hbase20:39639-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 7219c41156bc54a262cb892cb04282fe/family1 in testMajorCompactionWithMonthlyPolicy,,1676173999793.7219c41156bc54a262cb892cb04282fe. 2023-02-12 03:53:32,106 INFO [RS:0;jenkins-hbase20:39639-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithMonthlyPolicy/7219c41156bc54a262cb892cb04282fe/family1/5f422c8ef0db416a8a51c2b318c18c1f, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithMonthlyPolicy/7219c41156bc54a262cb892cb04282fe/family1/73ecf8ee74cd42fb95c78b64543aa2c8, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithMonthlyPolicy/7219c41156bc54a262cb892cb04282fe/family1/daf656c8745043e99adc3ab53abe278e_SeqId_47_] into tmpdir=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithMonthlyPolicy/7219c41156bc54a262cb892cb04282fe/.tmp, totalSize=178.1 K 2023-02-12 03:53:32,107 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] compactions.Compactor(207): Compacting 5f422c8ef0db416a8a51c2b318c18c1f, keycount=1000, bloomtype=ROW, size=166.0 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878805947 2023-02-12 03:53:32,107 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] compactions.Compactor(207): Compacting 73ecf8ee74cd42fb95c78b64543aa2c8, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621205947 2023-02-12 03:53:32,108 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] compactions.Compactor(207): Compacting daf656c8745043e99adc3ab53abe278e_SeqId_47_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448965205947 2023-02-12 03:53:32,109 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-02-12 03:53:32,110 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-12 03:53:32,120 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512018ef5216041464366b009bf65bdc97357 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512018ef5216041464366b009bf65bdc97357 2023-02-12 03:53:32,122 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015120525f89d6b38044747acf2317a9c145a10 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015120525f89d6b38044747acf2317a9c145a10 2023-02-12 03:53:32,123 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512289687592762a94719a19c5d42f1ad5780 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512289687592762a94719a19c5d42f1ad5780 2023-02-12 03:53:32,124 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151231d487895838734b53a63b9e8ee8dfddbf to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151231d487895838734b53a63b9e8ee8dfddbf 2023-02-12 03:53:32,124 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 4 expired mob files are deleted 2023-02-12 03:53:32,125 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201' 2023-02-12 03:53:32,125 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-02-12 03:53:32,125 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-02-12 03:53:32,141 INFO [RS:0;jenkins-hbase20:39639-shortCompactions-0] throttle.PressureAwareThroughputController(145): 7219c41156bc54a262cb892cb04282fe#family1#compaction#23 average throughput is 11.11 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-12 03:53:32,578 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithMonthlyPolicy/7219c41156bc54a262cb892cb04282fe/.tmp/family1/586e7c484b194fe989b81300d717c55a as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithMonthlyPolicy/7219c41156bc54a262cb892cb04282fe/family1/586e7c484b194fe989b81300d717c55a 2023-02-12 03:53:32,585 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130f6180a888f724caea604bb1fe9d41ecd to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151130f6180a888f724caea604bb1fe9d41ecd 2023-02-12 03:53:32,586 INFO [RS:0;jenkins-hbase20:39639-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 7219c41156bc54a262cb892cb04282fe/family1 of 7219c41156bc54a262cb892cb04282fe into 586e7c484b194fe989b81300d717c55a(size=167.4 K), total size for store is 167.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-12 03:53:32,586 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 7219c41156bc54a262cb892cb04282fe: 2023-02-12 03:53:32,586 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-02-12 03:53:32,586 INFO [RS:0;jenkins-hbase20:39639-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithMonthlyPolicy,,1676173999793.7219c41156bc54a262cb892cb04282fe., storeName=family1, fileCount=3, fileSize=178.1 K (166.0 K, 6.6 K, 5.5 K), priority=2, time=1676174012106; duration=0sec 2023-02-12 03:53:32,586 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-12 03:53:32,619 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/2fe6db34f51846f7938ede85211ceacc first=Optional[r00] last=Optional[r8] 2023-02-12 03:53:32,620 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1676173999793.7219c41156bc54a262cb892cb04282fe., hostname=jenkins-hbase20.apache.org,39639,1676173982450, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/2fe6db34f51846f7938ede85211ceacc}] 2023-02-12 03:53:32,622 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/2fe6db34f51846f7938ede85211ceacc for inclusion in 7219c41156bc54a262cb892cb04282fe/family1 2023-02-12 03:53:32,626 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HStore(775): HFile bounds: first=r00 last=r8 2023-02-12 03:53:32,626 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HStore(777): Region bounds: first= last= 2023-02-12 03:53:32,626 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HRegion(2445): Flush status journal for 7219c41156bc54a262cb892cb04282fe: 2023-02-12 03:53:32,627 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/2fe6db34f51846f7938ede85211ceacc to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/staging/jenkins__testMajorCompactionWithMonthlyPolicy__qcmfod7fufhuqpbgbdvj7uiohsh3dokc05hg7v654d6639gtcitnk4o5frtrk3ea/family1/2fe6db34f51846f7938ede85211ceacc 2023-02-12 03:53:32,630 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/staging/jenkins__testMajorCompactionWithMonthlyPolicy__qcmfod7fufhuqpbgbdvj7uiohsh3dokc05hg7v654d6639gtcitnk4o5frtrk3ea/family1/2fe6db34f51846f7938ede85211ceacc as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithMonthlyPolicy/7219c41156bc54a262cb892cb04282fe/family1/1f72049664054c2aabc8ffa915610fc4_SeqId_50_ 2023-02-12 03:53:32,631 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/staging/jenkins__testMajorCompactionWithMonthlyPolicy__qcmfod7fufhuqpbgbdvj7uiohsh3dokc05hg7v654d6639gtcitnk4o5frtrk3ea/family1/2fe6db34f51846f7938ede85211ceacc into 7219c41156bc54a262cb892cb04282fe/family1 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithMonthlyPolicy/7219c41156bc54a262cb892cb04282fe/family1/1f72049664054c2aabc8ffa915610fc4_SeqId_50_ - updating store file list. 2023-02-12 03:53:32,636 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithMonthlyPolicy/7219c41156bc54a262cb892cb04282fe/family1/1f72049664054c2aabc8ffa915610fc4_SeqId_50_ into 7219c41156bc54a262cb892cb04282fe/family1 2023-02-12 03:53:32,636 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/staging/jenkins__testMajorCompactionWithMonthlyPolicy__qcmfod7fufhuqpbgbdvj7uiohsh3dokc05hg7v654d6639gtcitnk4o5frtrk3ea/family1/2fe6db34f51846f7938ede85211ceacc into 7219c41156bc54a262cb892cb04282fe/family1 (new location: hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithMonthlyPolicy/7219c41156bc54a262cb892cb04282fe/family1/1f72049664054c2aabc8ffa915610fc4_SeqId_50_) 2023-02-12 03:53:32,636 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/staging/jenkins__testMajorCompactionWithMonthlyPolicy__qcmfod7fufhuqpbgbdvj7uiohsh3dokc05hg7v654d6639gtcitnk4o5frtrk3ea/family1/2fe6db34f51846f7938ede85211ceacc 2023-02-12 03:53:32,639 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-02-12 03:53:32,640 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-12 03:53:32,645 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151120f5cb8f99a4be4ae5af9d1f4efcf4117d to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151120f5cb8f99a4be4ae5af9d1f4efcf4117d 2023-02-12 03:53:32,647 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015112853c423ecdeb843c8a817d92f4ad63278 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015112853c423ecdeb843c8a817d92f4ad63278 2023-02-12 03:53:32,652 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithMonthlyPolicy/7219c41156bc54a262cb892cb04282fe/family1/5f422c8ef0db416a8a51c2b318c18c1f, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithMonthlyPolicy/7219c41156bc54a262cb892cb04282fe/family1/73ecf8ee74cd42fb95c78b64543aa2c8, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithMonthlyPolicy/7219c41156bc54a262cb892cb04282fe/family1/daf656c8745043e99adc3ab53abe278e_SeqId_47_] to archive 2023-02-12 03:53:32,652 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151130f4509bb5ccd74a94ab07fa2688db2dbc to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151130f4509bb5ccd74a94ab07fa2688db2dbc 2023-02-12 03:53:32,652 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 3 expired mob files are deleted 2023-02-12 03:53:32,652 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-02-12 03:53:32,653 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-12 03:53:32,653 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-02-12 03:53:32,653 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-02-12 03:53:32,653 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-02-12 03:53:32,653 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676173985818] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-02-12 03:53:32,653 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676173985818] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithMonthlyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-12 03:53:32,654 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=22, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-02-12 03:53:32,656 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=22, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE in 1.6890 sec 2023-02-12 03:53:32,656 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithMonthlyPolicy/7219c41156bc54a262cb892cb04282fe/family1/5f422c8ef0db416a8a51c2b318c18c1f to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMajorCompactionWithMonthlyPolicy/7219c41156bc54a262cb892cb04282fe/family1/5f422c8ef0db416a8a51c2b318c18c1f 2023-02-12 03:53:32,658 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithMonthlyPolicy/7219c41156bc54a262cb892cb04282fe/family1/73ecf8ee74cd42fb95c78b64543aa2c8 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMajorCompactionWithMonthlyPolicy/7219c41156bc54a262cb892cb04282fe/family1/73ecf8ee74cd42fb95c78b64543aa2c8 2023-02-12 03:53:32,660 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithMonthlyPolicy/7219c41156bc54a262cb892cb04282fe/family1/daf656c8745043e99adc3ab53abe278e_SeqId_47_ to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMajorCompactionWithMonthlyPolicy/7219c41156bc54a262cb892cb04282fe/family1/daf656c8745043e99adc3ab53abe278e_SeqId_47_ 2023-02-12 03:53:32,770 INFO [Listener at localhost.localdomain/41049] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithMonthlyPolicy Thread=249 (was 248) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:59556@0x6f077d48-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: hconnection-0x5ca80d90-shared-pool-23 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x25f538c8-metaLookup-shared--pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1030629287_15 at /127.0.0.1:58030 [Waiting for operation #10] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:59556@0x6f077d48 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$45/1090090368.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1030629287_15 at /127.0.0.1:58046 [Waiting for operation #12] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1030629287_15 at /127.0.0.1:58172 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-186694101_15 at /127.0.0.1:58194 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x25f538c8-shared-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1030629287_15 at /127.0.0.1:58312 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1030629287_15 at /127.0.0.1:58242 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1030629287_15 at /127.0.0.1:58246 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x25f538c8-shared-pool-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x25f538c8-shared-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1030629287_15 at /127.0.0.1:58150 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1030629287_15 at /127.0.0.1:58122 [Waiting for operation #20] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-186694101_15 at /127.0.0.1:58212 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3c8cff1a-3314-a11f-82b4-27989886696f/cluster_8d46982c-f2f0-5a04-0a7b-ed62cf4de184/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x25f538c8-shared-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:59556@0x6f077d48-SendThread(127.0.0.1:59556) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:345) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1223) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1030629287_15 at /127.0.0.1:58104 [Waiting for operation #11] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1030629287_15 at /127.0.0.1:58166 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1030629287_15 at /127.0.0.1:58232 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x25f538c8-shared-pool-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x25f538c8-shared-pool-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1030629287_15 at /127.0.0.1:58258 [Waiting for operation #17] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1030629287_15 at /127.0.0.1:58082 [Waiting for operation #12] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3c8cff1a-3314-a11f-82b4-27989886696f/cluster_8d46982c-f2f0-5a04-0a7b-ed62cf4de184/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1030629287_15 at /127.0.0.1:58110 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=590 (was 589) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=369 (was 408), ProcessCount=164 (was 164), AvailableMemoryMB=4686 (was 4288) - AvailableMemoryMB LEAK? - 2023-02-12 03:53:32,786 INFO [Listener at localhost.localdomain/41049] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompactionWithWeeklyPolicy Thread=249, OpenFileDescriptor=590, MaxFileDescriptor=60000, SystemLoadAverage=369, ProcessCount=164, AvailableMemoryMB=4686 2023-02-12 03:53:32,789 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.HMaster$4(2102): Client=jenkins//148.251.75.209 create 'testMinorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-02-12 03:53:32,790 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] procedure2.ProcedureExecutor(1029): Stored pid=23, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:32,793 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-02-12 03:53:32,793 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(697): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testMinorCompactionWithWeeklyPolicy" procId is: 23 2023-02-12 03:53:32,794 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-12 03:53:32,794 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(1227): Checking to see if procedure is done pid=23 2023-02-12 03:53:32,796 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/56c18fcb418f4ae343b8ef57374cdf69 2023-02-12 03:53:32,797 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/56c18fcb418f4ae343b8ef57374cdf69 empty. 2023-02-12 03:53:32,797 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/56c18fcb418f4ae343b8ef57374cdf69 2023-02-12 03:53:32,797 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testMinorCompactionWithWeeklyPolicy regions 2023-02-12 03:53:32,808 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/.tabledesc/.tableinfo.0000000001 2023-02-12 03:53:32,810 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(7671): creating {ENCODED => 56c18fcb418f4ae343b8ef57374cdf69, NAME => 'testMinorCompactionWithWeeklyPolicy,,1676174012788.56c18fcb418f4ae343b8ef57374cdf69.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMinorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/.tmp 2023-02-12 03:53:32,896 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(1227): Checking to see if procedure is done pid=23 2023-02-12 03:53:33,097 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(1227): Checking to see if procedure is done pid=23 2023-02-12 03:53:33,221 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(865): Instantiated testMinorCompactionWithWeeklyPolicy,,1676174012788.56c18fcb418f4ae343b8ef57374cdf69.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:53:33,221 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1603): Closing 56c18fcb418f4ae343b8ef57374cdf69, disabling compactions & flushes 2023-02-12 03:53:33,221 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1625): Closing region testMinorCompactionWithWeeklyPolicy,,1676174012788.56c18fcb418f4ae343b8ef57374cdf69. 2023-02-12 03:53:33,221 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMinorCompactionWithWeeklyPolicy,,1676174012788.56c18fcb418f4ae343b8ef57374cdf69. 2023-02-12 03:53:33,221 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1713): Acquired close lock on testMinorCompactionWithWeeklyPolicy,,1676174012788.56c18fcb418f4ae343b8ef57374cdf69. after waiting 0 ms 2023-02-12 03:53:33,222 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1723): Updates disabled for region testMinorCompactionWithWeeklyPolicy,,1676174012788.56c18fcb418f4ae343b8ef57374cdf69. 2023-02-12 03:53:33,222 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1837): Closed testMinorCompactionWithWeeklyPolicy,,1676174012788.56c18fcb418f4ae343b8ef57374cdf69. 2023-02-12 03:53:33,222 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1557): Region close journal for 56c18fcb418f4ae343b8ef57374cdf69: Waiting for close lock at 1676174013221Disabling compacts and flushes for region at 1676174013221Disabling writes for close at 1676174013221Writing region close event to WAL at 1676174013222 (+1 ms)Closed at 1676174013222 2023-02-12 03:53:33,224 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-02-12 03:53:33,225 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMinorCompactionWithWeeklyPolicy,,1676174012788.56c18fcb418f4ae343b8ef57374cdf69.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676174013225"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676174013225"}]},"ts":"1676174013225"} 2023-02-12 03:53:33,227 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-12 03:53:33,228 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-12 03:53:33,228 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676174013228"}]},"ts":"1676174013228"} 2023-02-12 03:53:33,229 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithWeeklyPolicy, state=ENABLING in hbase:meta 2023-02-12 03:53:33,233 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=56c18fcb418f4ae343b8ef57374cdf69, ASSIGN}] 2023-02-12 03:53:33,235 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=56c18fcb418f4ae343b8ef57374cdf69, ASSIGN 2023-02-12 03:53:33,236 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=56c18fcb418f4ae343b8ef57374cdf69, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,39639,1676173982450; forceNewPlan=false, retain=false 2023-02-12 03:53:33,387 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=56c18fcb418f4ae343b8ef57374cdf69, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:33,387 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMinorCompactionWithWeeklyPolicy,,1676174012788.56c18fcb418f4ae343b8ef57374cdf69.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676174013387"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676174013387"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676174013387"}]},"ts":"1676174013387"} 2023-02-12 03:53:33,389 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=24, state=RUNNABLE; OpenRegionProcedure 56c18fcb418f4ae343b8ef57374cdf69, server=jenkins-hbase20.apache.org,39639,1676173982450}] 2023-02-12 03:53:33,398 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(1227): Checking to see if procedure is done pid=23 2023-02-12 03:53:33,546 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testMinorCompactionWithWeeklyPolicy,,1676174012788.56c18fcb418f4ae343b8ef57374cdf69. 2023-02-12 03:53:33,546 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 56c18fcb418f4ae343b8ef57374cdf69, NAME => 'testMinorCompactionWithWeeklyPolicy,,1676174012788.56c18fcb418f4ae343b8ef57374cdf69.', STARTKEY => '', ENDKEY => ''} 2023-02-12 03:53:33,547 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompactionWithWeeklyPolicy 56c18fcb418f4ae343b8ef57374cdf69 2023-02-12 03:53:33,547 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testMinorCompactionWithWeeklyPolicy,,1676174012788.56c18fcb418f4ae343b8ef57374cdf69.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:53:33,547 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 56c18fcb418f4ae343b8ef57374cdf69 2023-02-12 03:53:33,547 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 56c18fcb418f4ae343b8ef57374cdf69 2023-02-12 03:53:33,548 INFO [StoreOpener-56c18fcb418f4ae343b8ef57374cdf69-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 56c18fcb418f4ae343b8ef57374cdf69 2023-02-12 03:53:33,550 DEBUG [StoreOpener-56c18fcb418f4ae343b8ef57374cdf69-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithWeeklyPolicy/56c18fcb418f4ae343b8ef57374cdf69/family1 2023-02-12 03:53:33,550 DEBUG [StoreOpener-56c18fcb418f4ae343b8ef57374cdf69-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithWeeklyPolicy/56c18fcb418f4ae343b8ef57374cdf69/family1 2023-02-12 03:53:33,551 INFO [StoreOpener-56c18fcb418f4ae343b8ef57374cdf69-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 56c18fcb418f4ae343b8ef57374cdf69 columnFamilyName family1 2023-02-12 03:53:33,552 INFO [StoreOpener-56c18fcb418f4ae343b8ef57374cdf69-1] regionserver.HStore(310): Store=56c18fcb418f4ae343b8ef57374cdf69/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:53:33,553 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithWeeklyPolicy/56c18fcb418f4ae343b8ef57374cdf69 2023-02-12 03:53:33,554 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithWeeklyPolicy/56c18fcb418f4ae343b8ef57374cdf69 2023-02-12 03:53:33,556 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 56c18fcb418f4ae343b8ef57374cdf69 2023-02-12 03:53:33,558 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithWeeklyPolicy/56c18fcb418f4ae343b8ef57374cdf69/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 03:53:33,558 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 56c18fcb418f4ae343b8ef57374cdf69; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59877429, jitterRate=-0.10775677859783173}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-12 03:53:33,558 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 56c18fcb418f4ae343b8ef57374cdf69: Running coprocessor pre-open hook at 1676174013547Writing region info on filesystem at 1676174013547Initializing all the Stores at 1676174013548 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} at 1676174013548Cleaning up temporary data from old regions at 1676174013554 (+6 ms)Cleaning up detritus from prior splits at 1676174013554Running coprocessor post-open hooks at 1676174013558 (+4 ms)Region opened successfully at 1676174013558 2023-02-12 03:53:33,559 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMinorCompactionWithWeeklyPolicy,,1676174012788.56c18fcb418f4ae343b8ef57374cdf69., pid=25, masterSystemTime=1676174013542 2023-02-12 03:53:33,561 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMinorCompactionWithWeeklyPolicy,,1676174012788.56c18fcb418f4ae343b8ef57374cdf69. 2023-02-12 03:53:33,561 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testMinorCompactionWithWeeklyPolicy,,1676174012788.56c18fcb418f4ae343b8ef57374cdf69. 2023-02-12 03:53:33,561 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=56c18fcb418f4ae343b8ef57374cdf69, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:33,562 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMinorCompactionWithWeeklyPolicy,,1676174012788.56c18fcb418f4ae343b8ef57374cdf69.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676174013561"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676174013561"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676174013561"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676174013561"}]},"ts":"1676174013561"} 2023-02-12 03:53:33,565 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=24 2023-02-12 03:53:33,565 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=24, state=SUCCESS; OpenRegionProcedure 56c18fcb418f4ae343b8ef57374cdf69, server=jenkins-hbase20.apache.org,39639,1676173982450 in 174 msec 2023-02-12 03:53:33,567 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=23 2023-02-12 03:53:33,567 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=23, state=SUCCESS; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=56c18fcb418f4ae343b8ef57374cdf69, ASSIGN in 332 msec 2023-02-12 03:53:33,568 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-12 03:53:33,568 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676174013568"}]},"ts":"1676174013568"} 2023-02-12 03:53:33,569 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithWeeklyPolicy, state=ENABLED in hbase:meta 2023-02-12 03:53:33,571 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-02-12 03:53:33,572 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=23, state=SUCCESS; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy in 782 msec 2023-02-12 03:53:33,900 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(1227): Checking to see if procedure is done pid=23 2023-02-12 03:53:33,901 INFO [Listener at localhost.localdomain/41049] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMinorCompactionWithWeeklyPolicy, procId: 23 completed 2023-02-12 03:53:33,934 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-12 03:53:33,936 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:33,936 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-02-12 03:53:33,936 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:53:33,936 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-12 03:53:33,936 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-12 03:53:33,937 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:33,937 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:33,938 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:33,938 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:53:33,938 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:53:33,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:53:33,938 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:33,938 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-12 03:53:33,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:33,939 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:33,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-12 03:53:33,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:33,939 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:33,939 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:33,939 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-12 03:53:33,939 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:53:33,939 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-12 03:53:33,939 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-12 03:53:33,939 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-12 03:53:33,939 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1676174012788.56c18fcb418f4ae343b8ef57374cdf69. 2023-02-12 03:53:33,939 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1676174012788.56c18fcb418f4ae343b8ef57374cdf69. started... 2023-02-12 03:53:33,940 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 56c18fcb418f4ae343b8ef57374cdf69 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-02-12 03:53:34,066 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMinorCompactionWithWeeklyPolicy' 2023-02-12 03:53:34,366 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130a0354fa4cb3841de8dea597970268d22 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151130a0354fa4cb3841de8dea597970268d22 2023-02-12 03:53:34,770 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithWeeklyPolicy/56c18fcb418f4ae343b8ef57374cdf69/.tmp/family1/ee56374012a7444597e575df3801894e 2023-02-12 03:53:34,776 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithWeeklyPolicy/56c18fcb418f4ae343b8ef57374cdf69/.tmp/family1/ee56374012a7444597e575df3801894e as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithWeeklyPolicy/56c18fcb418f4ae343b8ef57374cdf69/family1/ee56374012a7444597e575df3801894e 2023-02-12 03:53:34,782 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithWeeklyPolicy/56c18fcb418f4ae343b8ef57374cdf69/family1/ee56374012a7444597e575df3801894e, entries=1000, sequenceid=5, filesize=165.1 K 2023-02-12 03:53:34,783 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 56c18fcb418f4ae343b8ef57374cdf69 in 843ms, sequenceid=5, compaction requested=false 2023-02-12 03:53:34,783 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 56c18fcb418f4ae343b8ef57374cdf69: 2023-02-12 03:53:34,783 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1676174012788.56c18fcb418f4ae343b8ef57374cdf69. 2023-02-12 03:53:34,783 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-12 03:53:34,784 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-12 03:53:34,784 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:34,784 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-02-12 03:53:34,784 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-02-12 03:53:34,785 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:34,785 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:34,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:34,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:53:34,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:53:34,785 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:34,785 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 03:53:34,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:53:34,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:53:34,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:34,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:34,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:53:34,786 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-02-12 03:53:34,786 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4e8ba2f2[Count = 0] remaining members to acquire global barrier 2023-02-12 03:53:34,786 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-12 03:53:34,786 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:34,787 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:34,787 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:34,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:34,787 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-12 03:53:34,787 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:34,787 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-12 03:53:34,787 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-02-12 03:53:34,787 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,39639,1676173982450' in zk 2023-02-12 03:53:34,788 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-12 03:53:34,788 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:34,788 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:53:34,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:34,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:53:34,788 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-02-12 03:53:34,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:53:34,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:53:34,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:53:34,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:34,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:34,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:53:34,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:34,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:34,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,39639,1676173982450': 2023-02-12 03:53:34,790 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-12 03:53:34,790 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-02-12 03:53:34,791 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-12 03:53:34,791 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-12 03:53:34,791 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:34,791 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-12 03:53:34,792 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:34,792 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:34,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:34,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:53:34,792 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:34,792 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:53:34,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:34,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:53:34,792 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:34,792 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:53:34,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:53:34,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:53:34,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:34,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:34,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:53:34,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:34,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:34,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:53:34,795 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:34,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:34,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:34,796 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:34,796 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:34,796 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:34,796 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:34,796 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:34,796 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:34,796 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:34,797 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:53:34,797 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:53:34,797 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:53:34,797 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-02-12 03:53:34,797 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-12 03:53:34,797 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:53:34,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:53:34,797 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-12 03:53:34,797 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-12 03:53:34,797 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:53:34,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:53:34,897 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-12 03:53:34,898 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-12 03:53:34,904 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-12 03:53:34,906 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-12 03:53:34,906 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:34,906 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-02-12 03:53:34,906 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:53:34,906 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-12 03:53:34,906 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-12 03:53:34,907 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:34,907 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:34,907 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:53:34,907 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:34,907 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:53:34,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:53:34,909 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:34,909 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-12 03:53:34,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:34,909 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:34,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-12 03:53:34,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:34,910 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:34,910 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-02-12 03:53:34,910 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:34,910 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-12 03:53:34,910 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:53:34,910 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-12 03:53:34,915 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-12 03:53:34,915 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1676174012788.56c18fcb418f4ae343b8ef57374cdf69. 2023-02-12 03:53:34,915 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-12 03:53:34,915 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1676174012788.56c18fcb418f4ae343b8ef57374cdf69. started... 2023-02-12 03:53:34,915 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 56c18fcb418f4ae343b8ef57374cdf69 1/1 column families, dataSize=74 B heapSize=408 B 2023-02-12 03:53:34,939 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128d2d1f3ed1d204a498c7103d90da5d0bd to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151128d2d1f3ed1d204a498c7103d90da5d0bd 2023-02-12 03:53:35,352 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithWeeklyPolicy/56c18fcb418f4ae343b8ef57374cdf69/.tmp/family1/b54798102bac4b5a8ea64d26104bd986 2023-02-12 03:53:35,366 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithWeeklyPolicy/56c18fcb418f4ae343b8ef57374cdf69/.tmp/family1/b54798102bac4b5a8ea64d26104bd986 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithWeeklyPolicy/56c18fcb418f4ae343b8ef57374cdf69/family1/b54798102bac4b5a8ea64d26104bd986 2023-02-12 03:53:35,372 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithWeeklyPolicy/56c18fcb418f4ae343b8ef57374cdf69/family1/b54798102bac4b5a8ea64d26104bd986, entries=1, sequenceid=9, filesize=5.0 K 2023-02-12 03:53:35,373 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 56c18fcb418f4ae343b8ef57374cdf69 in 458ms, sequenceid=9, compaction requested=false 2023-02-12 03:53:35,373 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 56c18fcb418f4ae343b8ef57374cdf69: 2023-02-12 03:53:35,373 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1676174012788.56c18fcb418f4ae343b8ef57374cdf69. 2023-02-12 03:53:35,373 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-12 03:53:35,373 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-12 03:53:35,373 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:35,374 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-02-12 03:53:35,374 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-02-12 03:53:35,375 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:35,375 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:35,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:35,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:53:35,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:53:35,375 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:35,375 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 03:53:35,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:53:35,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:53:35,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:35,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:35,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:53:35,377 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-02-12 03:53:35,377 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5d55c19f[Count = 0] remaining members to acquire global barrier 2023-02-12 03:53:35,377 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-12 03:53:35,377 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:35,378 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:35,378 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:35,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:35,378 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-12 03:53:35,378 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-02-12 03:53:35,378 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:35,379 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-12 03:53:35,379 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,39639,1676173982450' in zk 2023-02-12 03:53:35,380 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-12 03:53:35,380 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:35,380 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:53:35,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:35,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:53:35,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:53:35,380 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-02-12 03:53:35,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:53:35,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:53:35,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:35,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:35,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:53:35,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:35,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:35,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,39639,1676173982450': 2023-02-12 03:53:35,384 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-12 03:53:35,384 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-02-12 03:53:35,384 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-12 03:53:35,384 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-12 03:53:35,384 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:35,384 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-12 03:53:35,385 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:35,385 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:35,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:35,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:53:35,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:53:35,385 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:35,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:35,385 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:53:35,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:53:35,386 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:53:35,386 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:35,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:53:35,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:35,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:35,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:53:35,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:35,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:35,388 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:35,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:53:35,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:35,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:35,390 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:35,390 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:53:35,390 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:35,390 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-02-12 03:53:35,390 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-12 03:53:35,390 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:35,390 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:53:35,390 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:53:35,390 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-12 03:53:35,390 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-12 03:53:35,390 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:53:35,391 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-12 03:53:35,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:53:35,390 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:35,391 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:35,391 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:35,391 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:35,391 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:53:35,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:53:35,491 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-12 03:53:35,492 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-12 03:53:35,495 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-12 03:53:35,497 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-12 03:53:35,497 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:35,497 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-02-12 03:53:35,497 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:53:35,497 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-12 03:53:35,497 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-12 03:53:35,498 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:35,498 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:35,498 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:53:35,498 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:35,499 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:53:35,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:53:35,499 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:35,499 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-12 03:53:35,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:35,500 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:35,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-12 03:53:35,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:35,500 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:35,503 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-02-12 03:53:35,503 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:35,503 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-12 03:53:35,503 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:53:35,503 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-12 03:53:35,503 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-12 03:53:35,503 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-12 03:53:35,503 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1676174012788.56c18fcb418f4ae343b8ef57374cdf69. 2023-02-12 03:53:35,503 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1676174012788.56c18fcb418f4ae343b8ef57374cdf69. started... 2023-02-12 03:53:35,503 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 56c18fcb418f4ae343b8ef57374cdf69 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-12 03:53:35,928 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120164a9fbd1476140f9bd76bc94ff581553 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015120164a9fbd1476140f9bd76bc94ff581553 2023-02-12 03:53:36,338 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithWeeklyPolicy/56c18fcb418f4ae343b8ef57374cdf69/.tmp/family1/7192369893c84ecf8af012e6afd99571 2023-02-12 03:53:36,347 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithWeeklyPolicy/56c18fcb418f4ae343b8ef57374cdf69/.tmp/family1/7192369893c84ecf8af012e6afd99571 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithWeeklyPolicy/56c18fcb418f4ae343b8ef57374cdf69/family1/7192369893c84ecf8af012e6afd99571 2023-02-12 03:53:36,356 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithWeeklyPolicy/56c18fcb418f4ae343b8ef57374cdf69/family1/7192369893c84ecf8af012e6afd99571, entries=1, sequenceid=13, filesize=4.9 K 2023-02-12 03:53:36,357 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 56c18fcb418f4ae343b8ef57374cdf69 in 854ms, sequenceid=13, compaction requested=true 2023-02-12 03:53:36,357 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 56c18fcb418f4ae343b8ef57374cdf69: 2023-02-12 03:53:36,357 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1676174012788.56c18fcb418f4ae343b8ef57374cdf69. 2023-02-12 03:53:36,358 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-12 03:53:36,358 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-12 03:53:36,358 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:36,358 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-02-12 03:53:36,358 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-02-12 03:53:36,359 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:36,359 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:36,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:36,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:53:36,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:53:36,360 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:36,360 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 03:53:36,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:53:36,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:53:36,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:36,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:36,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:53:36,362 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-02-12 03:53:36,362 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2e9c9d4a[Count = 0] remaining members to acquire global barrier 2023-02-12 03:53:36,363 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-12 03:53:36,363 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:36,364 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:36,364 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:36,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:36,364 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-12 03:53:36,364 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-02-12 03:53:36,364 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,39639,1676173982450' in zk 2023-02-12 03:53:36,364 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:36,364 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-12 03:53:36,365 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-12 03:53:36,365 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:36,365 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:53:36,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:36,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:53:36,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:53:36,366 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-02-12 03:53:36,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:53:36,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:53:36,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:36,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:36,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:53:36,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:36,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:36,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,39639,1676173982450': 2023-02-12 03:53:36,369 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-12 03:53:36,369 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-02-12 03:53:36,369 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-12 03:53:36,369 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-12 03:53:36,369 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:36,369 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-12 03:53:36,372 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:36,372 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:36,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:36,372 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:36,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:36,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:53:36,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:53:36,372 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:53:36,372 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:53:36,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:53:36,373 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:36,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:53:36,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:36,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:36,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:53:36,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:36,374 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:36,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:36,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:53:36,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:36,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:36,378 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:36,378 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:36,378 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:53:36,378 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:36,378 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-02-12 03:53:36,378 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-12 03:53:36,378 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-12 03:53:36,378 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:36,378 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:53:36,378 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-12 03:53:36,379 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-12 03:53:36,378 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:53:36,378 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:53:36,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:53:36,378 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:36,379 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:36,379 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:36,379 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:53:36,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:53:36,479 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-12 03:53:36,481 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-12 03:53:36,492 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-12 03:53:36,494 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-12 03:53:36,494 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:36,494 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-02-12 03:53:36,494 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:53:36,494 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-12 03:53:36,494 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-12 03:53:36,495 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:36,495 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:36,496 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:53:36,496 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:36,496 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:53:36,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:53:36,496 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:36,496 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-12 03:53:36,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:36,497 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:36,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-12 03:53:36,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:36,497 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:36,498 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-02-12 03:53:36,498 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:36,498 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-12 03:53:36,498 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:53:36,498 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-12 03:53:36,498 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-12 03:53:36,498 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-12 03:53:36,498 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1676174012788.56c18fcb418f4ae343b8ef57374cdf69. 2023-02-12 03:53:36,498 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1676174012788.56c18fcb418f4ae343b8ef57374cdf69. started... 2023-02-12 03:53:36,499 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 56c18fcb418f4ae343b8ef57374cdf69 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-12 03:53:36,913 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205048e59d70ffd4b2b80455c419ad1f897 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151205048e59d70ffd4b2b80455c419ad1f897 2023-02-12 03:53:37,321 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithWeeklyPolicy/56c18fcb418f4ae343b8ef57374cdf69/.tmp/family1/1f492059fb674e408ab9469936b92510 2023-02-12 03:53:37,327 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithWeeklyPolicy/56c18fcb418f4ae343b8ef57374cdf69/.tmp/family1/1f492059fb674e408ab9469936b92510 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithWeeklyPolicy/56c18fcb418f4ae343b8ef57374cdf69/family1/1f492059fb674e408ab9469936b92510 2023-02-12 03:53:37,334 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithWeeklyPolicy/56c18fcb418f4ae343b8ef57374cdf69/family1/1f492059fb674e408ab9469936b92510, entries=1, sequenceid=17, filesize=4.9 K 2023-02-12 03:53:37,335 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 56c18fcb418f4ae343b8ef57374cdf69 in 836ms, sequenceid=17, compaction requested=true 2023-02-12 03:53:37,335 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 56c18fcb418f4ae343b8ef57374cdf69: 2023-02-12 03:53:37,335 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1676174012788.56c18fcb418f4ae343b8ef57374cdf69. 2023-02-12 03:53:37,335 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-12 03:53:37,335 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-12 03:53:37,335 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:37,335 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-02-12 03:53:37,335 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-02-12 03:53:37,336 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:37,336 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:37,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:37,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:53:37,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:53:37,337 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:37,337 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 03:53:37,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:53:37,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:53:37,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:37,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:37,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:53:37,338 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-02-12 03:53:37,338 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@63186c4f[Count = 0] remaining members to acquire global barrier 2023-02-12 03:53:37,338 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-12 03:53:37,338 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:37,339 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:37,339 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:37,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:37,339 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-12 03:53:37,339 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-02-12 03:53:37,339 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,39639,1676173982450' in zk 2023-02-12 03:53:37,339 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:37,339 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-12 03:53:37,340 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-12 03:53:37,340 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:37,340 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:53:37,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:37,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:53:37,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:53:37,340 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-02-12 03:53:37,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:53:37,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:53:37,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:37,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:37,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:53:37,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:37,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:37,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,39639,1676173982450': 2023-02-12 03:53:37,342 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-12 03:53:37,342 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-02-12 03:53:37,342 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-12 03:53:37,342 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-12 03:53:37,342 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:37,342 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-12 03:53:37,343 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:37,343 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:37,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:37,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:53:37,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:53:37,343 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:37,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:37,343 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:53:37,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:53:37,344 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:53:37,344 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:37,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:53:37,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:37,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:37,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:53:37,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:37,345 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:37,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:37,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:53:37,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:37,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:37,346 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:37,346 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:53:37,346 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:37,346 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-02-12 03:53:37,346 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-12 03:53:37,346 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:53:37,346 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:53:37,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:53:37,346 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:53:37,346 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-12 03:53:37,346 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:37,347 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:37,347 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:37,347 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:53:37,347 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:37,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:53:37,347 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-12 03:53:37,347 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-12 03:53:37,347 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:37,447 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-12 03:53:37,448 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-12 03:53:37,453 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-12 03:53:37,455 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-12 03:53:37,455 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:37,455 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-02-12 03:53:37,455 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:53:37,455 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-12 03:53:37,455 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-12 03:53:37,455 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:37,455 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:37,456 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:37,456 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:53:37,456 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:53:37,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:53:37,456 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:37,457 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-12 03:53:37,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:37,457 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:37,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-12 03:53:37,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:37,457 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:37,462 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-02-12 03:53:37,462 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:37,462 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-12 03:53:37,462 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:53:37,462 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-12 03:53:37,462 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-12 03:53:37,462 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-12 03:53:37,462 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1676174012788.56c18fcb418f4ae343b8ef57374cdf69. 2023-02-12 03:53:37,463 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1676174012788.56c18fcb418f4ae343b8ef57374cdf69. started... 2023-02-12 03:53:37,463 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 56c18fcb418f4ae343b8ef57374cdf69 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-12 03:53:37,876 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512286acb45e7b4714dcba570e91b57e531b5 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512286acb45e7b4714dcba570e91b57e531b5 2023-02-12 03:53:38,282 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithWeeklyPolicy/56c18fcb418f4ae343b8ef57374cdf69/.tmp/family1/b62156b33e6e441db48115232301cde6 2023-02-12 03:53:38,288 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithWeeklyPolicy/56c18fcb418f4ae343b8ef57374cdf69/.tmp/family1/b62156b33e6e441db48115232301cde6 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithWeeklyPolicy/56c18fcb418f4ae343b8ef57374cdf69/family1/b62156b33e6e441db48115232301cde6 2023-02-12 03:53:38,293 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithWeeklyPolicy/56c18fcb418f4ae343b8ef57374cdf69/family1/b62156b33e6e441db48115232301cde6, entries=1, sequenceid=21, filesize=4.9 K 2023-02-12 03:53:38,294 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 56c18fcb418f4ae343b8ef57374cdf69 in 831ms, sequenceid=21, compaction requested=true 2023-02-12 03:53:38,294 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 56c18fcb418f4ae343b8ef57374cdf69: 2023-02-12 03:53:38,294 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1676174012788.56c18fcb418f4ae343b8ef57374cdf69. 2023-02-12 03:53:38,294 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-12 03:53:38,294 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-12 03:53:38,294 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:38,294 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-02-12 03:53:38,294 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-02-12 03:53:38,295 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:38,295 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:38,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:38,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:53:38,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:53:38,295 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:38,295 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 03:53:38,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:53:38,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:53:38,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:38,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:38,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:53:38,296 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-02-12 03:53:38,297 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-12 03:53:38,297 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7097deec[Count = 0] remaining members to acquire global barrier 2023-02-12 03:53:38,297 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:38,297 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:38,297 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:38,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:38,297 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-12 03:53:38,297 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-02-12 03:53:38,297 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,39639,1676173982450' in zk 2023-02-12 03:53:38,297 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:38,297 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-12 03:53:38,298 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:38,298 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-12 03:53:38,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:38,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:53:38,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:53:38,298 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:53:38,298 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-02-12 03:53:38,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:53:38,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:53:38,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:38,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:38,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:53:38,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:38,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:38,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,39639,1676173982450': 2023-02-12 03:53:38,301 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-12 03:53:38,301 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-02-12 03:53:38,301 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-12 03:53:38,301 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-12 03:53:38,301 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:38,301 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-12 03:53:38,302 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:38,302 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:38,302 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:38,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:38,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:53:38,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:53:38,302 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:53:38,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:38,302 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:38,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:53:38,302 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:53:38,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:53:38,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:38,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:38,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:53:38,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:38,303 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:38,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:38,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:53:38,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:38,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:38,305 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:53:38,305 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:38,305 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:53:38,305 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:53:38,305 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:53:38,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:53:38,305 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-02-12 03:53:38,305 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-12 03:53:38,305 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:38,306 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:38,306 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:38,306 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:53:38,306 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-12 03:53:38,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:53:38,306 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:38,306 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-12 03:53:38,306 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:38,306 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-12 03:53:38,306 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:38,406 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-12 03:53:38,407 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-12 03:53:38,410 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-12 03:53:38,412 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-12 03:53:38,412 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:38,412 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-02-12 03:53:38,412 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:53:38,412 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-12 03:53:38,412 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-12 03:53:38,412 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:38,412 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:38,413 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:38,413 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:53:38,413 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:53:38,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:53:38,413 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:38,413 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-12 03:53:38,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:38,414 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:38,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-12 03:53:38,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:38,414 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:38,414 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-02-12 03:53:38,414 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:38,414 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-12 03:53:38,414 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:53:38,414 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-12 03:53:38,414 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-12 03:53:38,414 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-12 03:53:38,414 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1676174012788.56c18fcb418f4ae343b8ef57374cdf69. 2023-02-12 03:53:38,415 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1676174012788.56c18fcb418f4ae343b8ef57374cdf69. started... 2023-02-12 03:53:38,415 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 56c18fcb418f4ae343b8ef57374cdf69 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-12 03:53:38,828 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231ffba59710b724ad7b9529f5d8970dcff to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151231ffba59710b724ad7b9529f5d8970dcff 2023-02-12 03:53:39,093 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-12 03:53:39,234 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithWeeklyPolicy/56c18fcb418f4ae343b8ef57374cdf69/.tmp/family1/9e1123df53fe48a99e42f45872ebeebb 2023-02-12 03:53:39,240 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithWeeklyPolicy/56c18fcb418f4ae343b8ef57374cdf69/.tmp/family1/9e1123df53fe48a99e42f45872ebeebb as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithWeeklyPolicy/56c18fcb418f4ae343b8ef57374cdf69/family1/9e1123df53fe48a99e42f45872ebeebb 2023-02-12 03:53:39,245 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithWeeklyPolicy/56c18fcb418f4ae343b8ef57374cdf69/family1/9e1123df53fe48a99e42f45872ebeebb, entries=1, sequenceid=25, filesize=4.9 K 2023-02-12 03:53:39,246 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 56c18fcb418f4ae343b8ef57374cdf69 in 831ms, sequenceid=25, compaction requested=true 2023-02-12 03:53:39,246 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 56c18fcb418f4ae343b8ef57374cdf69: 2023-02-12 03:53:39,246 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1676174012788.56c18fcb418f4ae343b8ef57374cdf69. 2023-02-12 03:53:39,246 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-12 03:53:39,246 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-12 03:53:39,246 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:39,246 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-02-12 03:53:39,246 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-02-12 03:53:39,247 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:39,247 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:39,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:39,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:53:39,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:53:39,248 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:39,248 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 03:53:39,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:53:39,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:53:39,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:39,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:39,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:53:39,249 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-02-12 03:53:39,249 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-12 03:53:39,249 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3bda058[Count = 0] remaining members to acquire global barrier 2023-02-12 03:53:39,249 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:39,250 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:39,250 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:39,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:39,250 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-12 03:53:39,250 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-02-12 03:53:39,250 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,39639,1676173982450' in zk 2023-02-12 03:53:39,250 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:39,250 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-12 03:53:39,252 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-12 03:53:39,252 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:53:39,252 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-02-12 03:53:39,252 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:39,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:39,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:53:39,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:53:39,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:53:39,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:53:39,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:39,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:39,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:53:39,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:39,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:39,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,39639,1676173982450': 2023-02-12 03:53:39,255 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-12 03:53:39,255 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-02-12 03:53:39,255 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-12 03:53:39,255 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-12 03:53:39,255 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:39,255 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-12 03:53:39,256 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:39,256 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:53:39,256 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:39,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:39,256 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:39,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:39,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:53:39,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:53:39,257 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:53:39,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:53:39,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:53:39,257 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:39,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:39,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:39,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:53:39,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:39,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:39,258 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:39,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:53:39,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:39,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:39,260 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:53:39,260 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:39,260 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-02-12 03:53:39,260 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-12 03:53:39,260 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:39,260 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-12 03:53:39,260 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:39,260 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:39,260 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:39,260 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:39,260 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:39,260 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-12 03:53:39,260 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-12 03:53:39,260 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:53:39,261 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:53:39,261 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:53:39,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:53:39,261 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:53:39,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:53:39,361 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-12 03:53:39,362 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-12 03:53:39,366 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-12 03:53:39,367 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-12 03:53:39,367 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:39,367 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-02-12 03:53:39,367 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:53:39,368 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-12 03:53:39,368 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-12 03:53:39,368 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:39,368 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:39,369 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:39,369 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:53:39,369 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:53:39,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:53:39,369 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:39,369 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-12 03:53:39,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:39,369 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:39,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-12 03:53:39,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:39,372 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:39,372 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-02-12 03:53:39,372 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:39,372 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-12 03:53:39,372 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:53:39,372 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-12 03:53:39,372 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-12 03:53:39,372 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1676174012788.56c18fcb418f4ae343b8ef57374cdf69. 2023-02-12 03:53:39,372 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-12 03:53:39,372 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1676174012788.56c18fcb418f4ae343b8ef57374cdf69. started... 2023-02-12 03:53:39,372 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 56c18fcb418f4ae343b8ef57374cdf69 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-12 03:53:39,797 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601010b1be954e5eb415f99085a7bb52c55ea to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201601010b1be954e5eb415f99085a7bb52c55ea 2023-02-12 03:53:40,203 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithWeeklyPolicy/56c18fcb418f4ae343b8ef57374cdf69/.tmp/family1/e18e0343ed3d464dbdd5ba786a3d83e4 2023-02-12 03:53:40,210 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithWeeklyPolicy/56c18fcb418f4ae343b8ef57374cdf69/.tmp/family1/e18e0343ed3d464dbdd5ba786a3d83e4 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithWeeklyPolicy/56c18fcb418f4ae343b8ef57374cdf69/family1/e18e0343ed3d464dbdd5ba786a3d83e4 2023-02-12 03:53:40,216 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithWeeklyPolicy/56c18fcb418f4ae343b8ef57374cdf69/family1/e18e0343ed3d464dbdd5ba786a3d83e4, entries=1, sequenceid=29, filesize=4.9 K 2023-02-12 03:53:40,217 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 56c18fcb418f4ae343b8ef57374cdf69 in 845ms, sequenceid=29, compaction requested=true 2023-02-12 03:53:40,217 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 56c18fcb418f4ae343b8ef57374cdf69: 2023-02-12 03:53:40,217 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1676174012788.56c18fcb418f4ae343b8ef57374cdf69. 2023-02-12 03:53:40,217 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-12 03:53:40,217 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-12 03:53:40,218 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:40,218 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-02-12 03:53:40,218 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-02-12 03:53:40,219 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:40,219 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:40,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:40,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:53:40,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:53:40,219 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:40,219 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 03:53:40,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:53:40,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:53:40,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:40,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:40,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:53:40,220 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-02-12 03:53:40,220 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-12 03:53:40,220 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@49010ba8[Count = 0] remaining members to acquire global barrier 2023-02-12 03:53:40,220 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:40,221 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:40,221 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:40,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:40,221 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-12 03:53:40,221 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-02-12 03:53:40,221 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,39639,1676173982450' in zk 2023-02-12 03:53:40,221 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:40,221 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-12 03:53:40,222 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-12 03:53:40,222 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:40,222 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:53:40,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:40,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:53:40,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:53:40,222 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-02-12 03:53:40,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:53:40,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:53:40,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:40,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:40,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:53:40,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:40,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:40,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,39639,1676173982450': 2023-02-12 03:53:40,224 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-12 03:53:40,224 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-02-12 03:53:40,224 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-12 03:53:40,224 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-12 03:53:40,225 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:40,225 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-12 03:53:40,226 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:40,226 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:40,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:40,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:53:40,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:53:40,226 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:40,226 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:53:40,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:40,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:53:40,226 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:40,226 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:53:40,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:53:40,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:40,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:40,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:53:40,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:40,227 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:40,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:40,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:53:40,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:40,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:40,229 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:53:40,229 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-02-12 03:53:40,229 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-12 03:53:40,229 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-12 03:53:40,229 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:53:40,229 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:40,229 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:53:40,229 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:53:40,229 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:40,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:53:40,229 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-12 03:53:40,229 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-12 03:53:40,229 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:40,229 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:53:40,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:53:40,229 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:40,229 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:40,229 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:40,229 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:40,329 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-12 03:53:40,330 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-12 03:53:40,334 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-12 03:53:40,336 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-12 03:53:40,336 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:40,336 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-02-12 03:53:40,337 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:53:40,337 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-12 03:53:40,337 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-12 03:53:40,337 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:40,337 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:40,338 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:53:40,338 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:40,338 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:53:40,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:53:40,338 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:40,338 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-12 03:53:40,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:40,339 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:40,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-12 03:53:40,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:40,339 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:40,339 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-02-12 03:53:40,339 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:40,339 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-12 03:53:40,339 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:53:40,339 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-12 03:53:40,340 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-12 03:53:40,340 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-12 03:53:40,340 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1676174012788.56c18fcb418f4ae343b8ef57374cdf69. 2023-02-12 03:53:40,340 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1676174012788.56c18fcb418f4ae343b8ef57374cdf69. started... 2023-02-12 03:53:40,340 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 56c18fcb418f4ae343b8ef57374cdf69 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-12 03:53:40,759 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103323665a92945411d937bdbc9f218a7e7 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160103323665a92945411d937bdbc9f218a7e7 2023-02-12 03:53:41,168 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithWeeklyPolicy/56c18fcb418f4ae343b8ef57374cdf69/.tmp/family1/4aee5a60219f4ddcbda042d0fa1e5c0b 2023-02-12 03:53:41,174 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithWeeklyPolicy/56c18fcb418f4ae343b8ef57374cdf69/.tmp/family1/4aee5a60219f4ddcbda042d0fa1e5c0b as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithWeeklyPolicy/56c18fcb418f4ae343b8ef57374cdf69/family1/4aee5a60219f4ddcbda042d0fa1e5c0b 2023-02-12 03:53:41,180 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithWeeklyPolicy/56c18fcb418f4ae343b8ef57374cdf69/family1/4aee5a60219f4ddcbda042d0fa1e5c0b, entries=1, sequenceid=33, filesize=4.9 K 2023-02-12 03:53:41,180 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 56c18fcb418f4ae343b8ef57374cdf69 in 840ms, sequenceid=33, compaction requested=true 2023-02-12 03:53:41,180 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 56c18fcb418f4ae343b8ef57374cdf69: 2023-02-12 03:53:41,180 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1676174012788.56c18fcb418f4ae343b8ef57374cdf69. 2023-02-12 03:53:41,181 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-12 03:53:41,181 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-12 03:53:41,181 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:41,181 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-02-12 03:53:41,181 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-02-12 03:53:41,182 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:41,182 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:41,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:41,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:53:41,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:53:41,182 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:41,182 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 03:53:41,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:53:41,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:53:41,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:41,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:41,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:53:41,183 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-02-12 03:53:41,183 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@695b6cd3[Count = 0] remaining members to acquire global barrier 2023-02-12 03:53:41,183 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-12 03:53:41,183 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:41,184 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:41,184 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:41,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:41,184 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-12 03:53:41,184 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-02-12 03:53:41,184 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,39639,1676173982450' in zk 2023-02-12 03:53:41,184 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:41,184 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-12 03:53:41,185 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-12 03:53:41,185 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:41,185 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:53:41,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:41,185 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-02-12 03:53:41,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:53:41,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:53:41,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:53:41,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:53:41,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:41,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:41,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:53:41,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:41,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:41,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,39639,1676173982450': 2023-02-12 03:53:41,187 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-12 03:53:41,187 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-02-12 03:53:41,187 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-12 03:53:41,187 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-12 03:53:41,187 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:41,187 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-12 03:53:41,188 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:41,188 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:41,188 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:53:41,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:41,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:53:41,188 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:41,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:53:41,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:41,188 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:53:41,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:53:41,188 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:41,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:53:41,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:41,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:41,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:53:41,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:41,189 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:41,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:41,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:53:41,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:41,191 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:41,191 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:41,191 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:53:41,191 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:53:41,191 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:53:41,191 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:41,191 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:41,191 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-02-12 03:53:41,191 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-12 03:53:41,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:53:41,191 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-12 03:53:41,191 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:41,191 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:41,191 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-12 03:53:41,191 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:53:41,191 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-12 03:53:41,191 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:41,191 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:53:41,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:53:41,292 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-12 03:53:41,293 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-12 03:53:41,297 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-12 03:53:41,299 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-12 03:53:41,299 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:41,299 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-02-12 03:53:41,299 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:53:41,299 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-12 03:53:41,299 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-12 03:53:41,299 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:41,299 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:41,300 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:53:41,300 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:41,300 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:53:41,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:53:41,300 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:41,300 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-12 03:53:41,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:41,301 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:41,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-12 03:53:41,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:41,301 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:41,302 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-02-12 03:53:41,302 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:41,302 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-12 03:53:41,302 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:53:41,302 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-12 03:53:41,302 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-12 03:53:41,302 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-12 03:53:41,302 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1676174012788.56c18fcb418f4ae343b8ef57374cdf69. 2023-02-12 03:53:41,302 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1676174012788.56c18fcb418f4ae343b8ef57374cdf69. started... 2023-02-12 03:53:41,302 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 56c18fcb418f4ae343b8ef57374cdf69 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-12 03:53:41,721 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907fcb3de1af0b1488f8f985a70fbaec1fd to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20150907fcb3de1af0b1488f8f985a70fbaec1fd 2023-02-12 03:53:42,127 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithWeeklyPolicy/56c18fcb418f4ae343b8ef57374cdf69/.tmp/family1/3d31ff5960cf404ea1fd81fd1155fc3f 2023-02-12 03:53:42,132 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithWeeklyPolicy/56c18fcb418f4ae343b8ef57374cdf69/.tmp/family1/3d31ff5960cf404ea1fd81fd1155fc3f as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithWeeklyPolicy/56c18fcb418f4ae343b8ef57374cdf69/family1/3d31ff5960cf404ea1fd81fd1155fc3f 2023-02-12 03:53:42,137 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithWeeklyPolicy/56c18fcb418f4ae343b8ef57374cdf69/family1/3d31ff5960cf404ea1fd81fd1155fc3f, entries=1, sequenceid=37, filesize=4.9 K 2023-02-12 03:53:42,138 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 56c18fcb418f4ae343b8ef57374cdf69 in 836ms, sequenceid=37, compaction requested=true 2023-02-12 03:53:42,138 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 56c18fcb418f4ae343b8ef57374cdf69: 2023-02-12 03:53:42,138 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1676174012788.56c18fcb418f4ae343b8ef57374cdf69. 2023-02-12 03:53:42,138 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-12 03:53:42,138 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-12 03:53:42,138 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:42,138 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-02-12 03:53:42,138 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-02-12 03:53:42,141 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:42,141 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:42,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:42,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:53:42,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:53:42,141 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:42,141 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 03:53:42,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:53:42,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:53:42,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:42,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:42,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:53:42,143 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-02-12 03:53:42,143 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2775bfaa[Count = 0] remaining members to acquire global barrier 2023-02-12 03:53:42,143 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-12 03:53:42,143 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:42,143 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:42,143 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:42,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:42,143 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-12 03:53:42,143 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-02-12 03:53:42,143 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,39639,1676173982450' in zk 2023-02-12 03:53:42,144 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:42,144 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-12 03:53:42,144 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:42,144 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-12 03:53:42,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:42,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:53:42,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:53:42,144 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:53:42,144 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-02-12 03:53:42,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:53:42,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:53:42,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:42,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:42,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:53:42,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:42,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:42,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,39639,1676173982450': 2023-02-12 03:53:42,146 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-12 03:53:42,146 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-02-12 03:53:42,146 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-12 03:53:42,146 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-12 03:53:42,146 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:42,146 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-12 03:53:42,147 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:42,147 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:42,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:42,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:53:42,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:53:42,147 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:42,147 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:53:42,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:42,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:53:42,148 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:42,148 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:53:42,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:53:42,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:42,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:42,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:53:42,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:42,148 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:42,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:42,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:53:42,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:42,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:42,150 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:42,150 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:53:42,150 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:42,150 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:53:42,150 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-12 03:53:42,150 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-02-12 03:53:42,150 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-12 03:53:42,150 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:42,150 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:53:42,150 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:53:42,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:53:42,150 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:42,150 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:42,150 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-12 03:53:42,150 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-12 03:53:42,150 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:42,150 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:53:42,150 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:42,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:53:42,250 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-12 03:53:42,252 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-12 03:53:42,255 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-12 03:53:42,257 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-12 03:53:42,257 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:42,257 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-02-12 03:53:42,257 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:53:42,257 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-12 03:53:42,257 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-12 03:53:42,258 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:42,258 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:42,258 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:42,258 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:53:42,258 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:53:42,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:53:42,259 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:42,259 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-12 03:53:42,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:42,259 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:42,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-12 03:53:42,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:42,260 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:42,260 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-02-12 03:53:42,260 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:42,260 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-12 03:53:42,260 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:53:42,260 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-12 03:53:42,260 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-12 03:53:42,260 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-12 03:53:42,260 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1676174012788.56c18fcb418f4ae343b8ef57374cdf69. 2023-02-12 03:53:42,260 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1676174012788.56c18fcb418f4ae343b8ef57374cdf69. started... 2023-02-12 03:53:42,260 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 56c18fcb418f4ae343b8ef57374cdf69 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-12 03:53:42,678 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120b5244e9ad28d4327975aeeb60cbd769d to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151120b5244e9ad28d4327975aeeb60cbd769d 2023-02-12 03:53:43,084 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithWeeklyPolicy/56c18fcb418f4ae343b8ef57374cdf69/.tmp/family1/2b012c26ffd84b1c900cdf648261dd59 2023-02-12 03:53:43,090 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithWeeklyPolicy/56c18fcb418f4ae343b8ef57374cdf69/.tmp/family1/2b012c26ffd84b1c900cdf648261dd59 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithWeeklyPolicy/56c18fcb418f4ae343b8ef57374cdf69/family1/2b012c26ffd84b1c900cdf648261dd59 2023-02-12 03:53:43,095 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithWeeklyPolicy/56c18fcb418f4ae343b8ef57374cdf69/family1/2b012c26ffd84b1c900cdf648261dd59, entries=1, sequenceid=41, filesize=4.9 K 2023-02-12 03:53:43,096 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 56c18fcb418f4ae343b8ef57374cdf69 in 836ms, sequenceid=41, compaction requested=true 2023-02-12 03:53:43,096 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 56c18fcb418f4ae343b8ef57374cdf69: 2023-02-12 03:53:43,096 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1676174012788.56c18fcb418f4ae343b8ef57374cdf69. 2023-02-12 03:53:43,096 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-12 03:53:43,096 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-12 03:53:43,096 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:43,096 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-02-12 03:53:43,096 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-02-12 03:53:43,097 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:43,097 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:43,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:43,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:53:43,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:53:43,098 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:43,098 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 03:53:43,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:53:43,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:53:43,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:43,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:43,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:53:43,099 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-02-12 03:53:43,099 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@49a4647c[Count = 0] remaining members to acquire global barrier 2023-02-12 03:53:43,099 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-12 03:53:43,099 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:43,100 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:43,100 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:43,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:43,100 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-12 03:53:43,100 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-02-12 03:53:43,100 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:43,100 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-12 03:53:43,100 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,39639,1676173982450' in zk 2023-02-12 03:53:43,101 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-12 03:53:43,101 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:53:43,101 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-02-12 03:53:43,101 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:43,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:43,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:53:43,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:53:43,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:53:43,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:53:43,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:43,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:43,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:53:43,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:43,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:43,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,39639,1676173982450': 2023-02-12 03:53:43,103 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-12 03:53:43,103 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-02-12 03:53:43,103 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-12 03:53:43,103 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-12 03:53:43,103 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:43,103 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-12 03:53:43,104 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:43,104 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:43,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:43,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:53:43,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:53:43,104 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:43,104 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:53:43,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:43,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:53:43,104 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:43,104 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:53:43,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:53:43,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:43,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:43,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:53:43,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:43,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:43,105 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:43,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:53:43,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:43,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:43,106 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:53:43,107 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:43,107 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:53:43,107 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:53:43,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:53:43,107 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-12 03:53:43,107 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:53:43,107 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:43,107 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:43,107 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:43,107 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:43,107 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:53:43,107 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:43,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:53:43,107 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:43,111 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-02-12 03:53:43,111 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-12 03:53:43,111 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-12 03:53:43,111 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-12 03:53:43,211 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-12 03:53:43,212 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-12 03:53:43,213 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=40099] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMinorCompactionWithWeeklyPolicy 2023-02-12 03:53:43,215 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676173985818] procedure2.ProcedureExecutor(1029): Stored pid=26, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-02-12 03:53:43,215 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=26, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-02-12 03:53:43,221 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676173985818] mob.MobUtils(833): start MOB compaction of files for table='testMinorCompactionWithWeeklyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-12 03:53:43,221 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=26, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1676174623221 2023-02-12 03:53:43,222 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676173985818] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-02-12 03:53:43,223 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676173985818] compactions.PartitionedMobCompactor(306): The compaction type is PART_FILES, the request has 0 del files, 9 selected files, and 0 irrelevant files table 'testMinorCompactionWithWeeklyPolicy' and column 'family1' 2023-02-12 03:53:43,224 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676173985818] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-02-12 03:53:43,224 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676173985818] zookeeper.ReadOnlyZKClient(139): Connect 0x14af4725 to 127.0.0.1:59556 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 03:53:43,237 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676173985818] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2a0172ee, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 03:53:43,237 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-02-12 03:53:44,088 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010332a3c4ecd9a44048820ab82e9304ea68 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2016010332a3c4ecd9a44048820ab82e9304ea68 2023-02-12 03:53:44,089 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-02-12 03:53:44,106 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-12 03:53:44,107 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:33538, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-12 03:53:44,114 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-12 03:53:44,115 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:46588, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-12 03:53:44,125 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/f7ccff25439d4da9b71d7e40b20a5caa first=Optional[r3] last=Optional[r6] 2023-02-12 03:53:44,126 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMinorCompactionWithWeeklyPolicy,,1676174012788.56c18fcb418f4ae343b8ef57374cdf69., hostname=jenkins-hbase20.apache.org,39639,1676173982450, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/f7ccff25439d4da9b71d7e40b20a5caa}] 2023-02-12 03:53:44,136 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/f7ccff25439d4da9b71d7e40b20a5caa for inclusion in 56c18fcb418f4ae343b8ef57374cdf69/family1 2023-02-12 03:53:44,139 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-02-12 03:53:44,140 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HStore(777): Region bounds: first= last= 2023-02-12 03:53:44,140 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HRegion(2445): Flush status journal for 56c18fcb418f4ae343b8ef57374cdf69: 2023-02-12 03:53:44,141 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/f7ccff25439d4da9b71d7e40b20a5caa to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/staging/jenkins__testMinorCompactionWithWeeklyPolicy__9rfoaa89s48q0pcvgrubnc9d0v3u8f7c5fh1b8abput34haevfcst3kg1l18aij7/family1/f7ccff25439d4da9b71d7e40b20a5caa 2023-02-12 03:53:44,144 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/staging/jenkins__testMinorCompactionWithWeeklyPolicy__9rfoaa89s48q0pcvgrubnc9d0v3u8f7c5fh1b8abput34haevfcst3kg1l18aij7/family1/f7ccff25439d4da9b71d7e40b20a5caa as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithWeeklyPolicy/56c18fcb418f4ae343b8ef57374cdf69/family1/376e7c07674d41e398aa0c5db0c8524f_SeqId_44_ 2023-02-12 03:53:44,144 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/staging/jenkins__testMinorCompactionWithWeeklyPolicy__9rfoaa89s48q0pcvgrubnc9d0v3u8f7c5fh1b8abput34haevfcst3kg1l18aij7/family1/f7ccff25439d4da9b71d7e40b20a5caa into 56c18fcb418f4ae343b8ef57374cdf69/family1 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithWeeklyPolicy/56c18fcb418f4ae343b8ef57374cdf69/family1/376e7c07674d41e398aa0c5db0c8524f_SeqId_44_ - updating store file list. 2023-02-12 03:53:44,149 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithWeeklyPolicy/56c18fcb418f4ae343b8ef57374cdf69/family1/376e7c07674d41e398aa0c5db0c8524f_SeqId_44_ into 56c18fcb418f4ae343b8ef57374cdf69/family1 2023-02-12 03:53:44,149 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/staging/jenkins__testMinorCompactionWithWeeklyPolicy__9rfoaa89s48q0pcvgrubnc9d0v3u8f7c5fh1b8abput34haevfcst3kg1l18aij7/family1/f7ccff25439d4da9b71d7e40b20a5caa into 56c18fcb418f4ae343b8ef57374cdf69/family1 (new location: hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithWeeklyPolicy/56c18fcb418f4ae343b8ef57374cdf69/family1/376e7c07674d41e398aa0c5db0c8524f_SeqId_44_) 2023-02-12 03:53:44,150 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/staging/jenkins__testMinorCompactionWithWeeklyPolicy__9rfoaa89s48q0pcvgrubnc9d0v3u8f7c5fh1b8abput34haevfcst3kg1l18aij7/family1/f7ccff25439d4da9b71d7e40b20a5caa 2023-02-12 03:53:44,150 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-02-12 03:53:44,152 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51214 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-02-12 03:53:44,153 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HStore(1912): 56c18fcb418f4ae343b8ef57374cdf69/family1 is initiating minor compaction 2023-02-12 03:53:44,153 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@776ec578; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-12 03:53:44,153 INFO [RS:0;jenkins-hbase20:39639-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 56c18fcb418f4ae343b8ef57374cdf69/family1 in testMinorCompactionWithWeeklyPolicy,,1676174012788.56c18fcb418f4ae343b8ef57374cdf69. 2023-02-12 03:53:44,153 INFO [RS:0;jenkins-hbase20:39639-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithWeeklyPolicy/56c18fcb418f4ae343b8ef57374cdf69/family1/b54798102bac4b5a8ea64d26104bd986, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithWeeklyPolicy/56c18fcb418f4ae343b8ef57374cdf69/family1/7192369893c84ecf8af012e6afd99571, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithWeeklyPolicy/56c18fcb418f4ae343b8ef57374cdf69/family1/1f492059fb674e408ab9469936b92510, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithWeeklyPolicy/56c18fcb418f4ae343b8ef57374cdf69/family1/b62156b33e6e441db48115232301cde6, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithWeeklyPolicy/56c18fcb418f4ae343b8ef57374cdf69/family1/9e1123df53fe48a99e42f45872ebeebb, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithWeeklyPolicy/56c18fcb418f4ae343b8ef57374cdf69/family1/e18e0343ed3d464dbdd5ba786a3d83e4, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithWeeklyPolicy/56c18fcb418f4ae343b8ef57374cdf69/family1/4aee5a60219f4ddcbda042d0fa1e5c0b, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithWeeklyPolicy/56c18fcb418f4ae343b8ef57374cdf69/family1/3d31ff5960cf404ea1fd81fd1155fc3f, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithWeeklyPolicy/56c18fcb418f4ae343b8ef57374cdf69/family1/2b012c26ffd84b1c900cdf648261dd59, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithWeeklyPolicy/56c18fcb418f4ae343b8ef57374cdf69/family1/376e7c07674d41e398aa0c5db0c8524f_SeqId_44_] into tmpdir=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithWeeklyPolicy/56c18fcb418f4ae343b8ef57374cdf69/.tmp, totalSize=50.0 K 2023-02-12 03:53:44,153 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] compactions.Compactor(207): Compacting b54798102bac4b5a8ea64d26104bd986, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-02-12 03:53:44,153 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] compactions.Compactor(207): Compacting 7192369893c84ecf8af012e6afd99571, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-02-12 03:53:44,153 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] compactions.Compactor(207): Compacting 1f492059fb674e408ab9469936b92510, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-02-12 03:53:44,153 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] compactions.Compactor(207): Compacting b62156b33e6e441db48115232301cde6, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-02-12 03:53:44,153 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] compactions.Compactor(207): Compacting 9e1123df53fe48a99e42f45872ebeebb, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-02-12 03:53:44,154 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] compactions.Compactor(207): Compacting e18e0343ed3d464dbdd5ba786a3d83e4, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-02-12 03:53:44,154 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] compactions.Compactor(207): Compacting 4aee5a60219f4ddcbda042d0fa1e5c0b, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-02-12 03:53:44,154 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] compactions.Compactor(207): Compacting 3d31ff5960cf404ea1fd81fd1155fc3f, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-02-12 03:53:44,154 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] compactions.Compactor(207): Compacting 2b012c26ffd84b1c900cdf648261dd59, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-02-12 03:53:44,154 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] compactions.Compactor(207): Compacting 376e7c07674d41e398aa0c5db0c8524f_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-02-12 03:53:44,155 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-02-12 03:53:44,156 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-12 03:53:44,164 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512286acb45e7b4714dcba570e91b57e531b5 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512286acb45e7b4714dcba570e91b57e531b5 2023-02-12 03:53:44,165 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151231ffba59710b724ad7b9529f5d8970dcff to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151231ffba59710b724ad7b9529f5d8970dcff 2023-02-12 03:53:44,166 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201601010b1be954e5eb415f99085a7bb52c55ea to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201601010b1be954e5eb415f99085a7bb52c55ea 2023-02-12 03:53:44,167 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160103323665a92945411d937bdbc9f218a7e7 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160103323665a92945411d937bdbc9f218a7e7 2023-02-12 03:53:44,167 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithWeeklyPolicy 4 expired mob files are deleted 2023-02-12 03:53:44,167 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-02-12 03:53:44,168 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-02-12 03:53:44,168 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-02-12 03:53:44,168 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-02-12 03:53:44,168 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-02-12 03:53:44,168 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-02-12 03:53:44,168 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-02-12 03:53:44,168 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-02-12 03:53:44,168 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-02-12 03:53:44,198 INFO [RS:0;jenkins-hbase20:39639-shortCompactions-0] throttle.PressureAwareThroughputController(145): 56c18fcb418f4ae343b8ef57374cdf69#family1#compaction#34 average throughput is 0.45 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-12 03:53:44,616 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithWeeklyPolicy/56c18fcb418f4ae343b8ef57374cdf69/.tmp/family1/a1690226e64745b9bd041e9eb13ba5f8 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithWeeklyPolicy/56c18fcb418f4ae343b8ef57374cdf69/family1/a1690226e64745b9bd041e9eb13ba5f8 2023-02-12 03:53:44,621 INFO [RS:0;jenkins-hbase20:39639-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 56c18fcb418f4ae343b8ef57374cdf69/family1 of 56c18fcb418f4ae343b8ef57374cdf69 into a1690226e64745b9bd041e9eb13ba5f8(size=6.6 K), total size for store is 171.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-12 03:53:44,621 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 56c18fcb418f4ae343b8ef57374cdf69: 2023-02-12 03:53:44,621 INFO [RS:0;jenkins-hbase20:39639-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithWeeklyPolicy,,1676174012788.56c18fcb418f4ae343b8ef57374cdf69., storeName=family1, fileCount=10, fileSize=50.0 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.5 K), priority=2, time=1676174024153; duration=0sec 2023-02-12 03:53:44,621 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-12 03:53:44,659 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithWeeklyPolicy/56c18fcb418f4ae343b8ef57374cdf69/family1/b54798102bac4b5a8ea64d26104bd986, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithWeeklyPolicy/56c18fcb418f4ae343b8ef57374cdf69/family1/7192369893c84ecf8af012e6afd99571, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithWeeklyPolicy/56c18fcb418f4ae343b8ef57374cdf69/family1/1f492059fb674e408ab9469936b92510, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithWeeklyPolicy/56c18fcb418f4ae343b8ef57374cdf69/family1/b62156b33e6e441db48115232301cde6, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithWeeklyPolicy/56c18fcb418f4ae343b8ef57374cdf69/family1/9e1123df53fe48a99e42f45872ebeebb, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithWeeklyPolicy/56c18fcb418f4ae343b8ef57374cdf69/family1/e18e0343ed3d464dbdd5ba786a3d83e4, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithWeeklyPolicy/56c18fcb418f4ae343b8ef57374cdf69/family1/4aee5a60219f4ddcbda042d0fa1e5c0b, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithWeeklyPolicy/56c18fcb418f4ae343b8ef57374cdf69/family1/3d31ff5960cf404ea1fd81fd1155fc3f, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithWeeklyPolicy/56c18fcb418f4ae343b8ef57374cdf69/family1/2b012c26ffd84b1c900cdf648261dd59, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithWeeklyPolicy/56c18fcb418f4ae343b8ef57374cdf69/family1/376e7c07674d41e398aa0c5db0c8524f_SeqId_44_] to archive 2023-02-12 03:53:44,660 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-12 03:53:44,662 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithWeeklyPolicy/56c18fcb418f4ae343b8ef57374cdf69/family1/b54798102bac4b5a8ea64d26104bd986 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMinorCompactionWithWeeklyPolicy/56c18fcb418f4ae343b8ef57374cdf69/family1/b54798102bac4b5a8ea64d26104bd986 2023-02-12 03:53:44,663 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithWeeklyPolicy/56c18fcb418f4ae343b8ef57374cdf69/family1/7192369893c84ecf8af012e6afd99571 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMinorCompactionWithWeeklyPolicy/56c18fcb418f4ae343b8ef57374cdf69/family1/7192369893c84ecf8af012e6afd99571 2023-02-12 03:53:44,665 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithWeeklyPolicy/56c18fcb418f4ae343b8ef57374cdf69/family1/1f492059fb674e408ab9469936b92510 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMinorCompactionWithWeeklyPolicy/56c18fcb418f4ae343b8ef57374cdf69/family1/1f492059fb674e408ab9469936b92510 2023-02-12 03:53:44,666 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithWeeklyPolicy/56c18fcb418f4ae343b8ef57374cdf69/family1/b62156b33e6e441db48115232301cde6 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMinorCompactionWithWeeklyPolicy/56c18fcb418f4ae343b8ef57374cdf69/family1/b62156b33e6e441db48115232301cde6 2023-02-12 03:53:44,667 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithWeeklyPolicy/56c18fcb418f4ae343b8ef57374cdf69/family1/9e1123df53fe48a99e42f45872ebeebb to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMinorCompactionWithWeeklyPolicy/56c18fcb418f4ae343b8ef57374cdf69/family1/9e1123df53fe48a99e42f45872ebeebb 2023-02-12 03:53:44,668 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithWeeklyPolicy/56c18fcb418f4ae343b8ef57374cdf69/family1/e18e0343ed3d464dbdd5ba786a3d83e4 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMinorCompactionWithWeeklyPolicy/56c18fcb418f4ae343b8ef57374cdf69/family1/e18e0343ed3d464dbdd5ba786a3d83e4 2023-02-12 03:53:44,669 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithWeeklyPolicy/56c18fcb418f4ae343b8ef57374cdf69/family1/4aee5a60219f4ddcbda042d0fa1e5c0b to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMinorCompactionWithWeeklyPolicy/56c18fcb418f4ae343b8ef57374cdf69/family1/4aee5a60219f4ddcbda042d0fa1e5c0b 2023-02-12 03:53:44,670 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithWeeklyPolicy/56c18fcb418f4ae343b8ef57374cdf69/family1/3d31ff5960cf404ea1fd81fd1155fc3f to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMinorCompactionWithWeeklyPolicy/56c18fcb418f4ae343b8ef57374cdf69/family1/3d31ff5960cf404ea1fd81fd1155fc3f 2023-02-12 03:53:44,672 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithWeeklyPolicy/56c18fcb418f4ae343b8ef57374cdf69/family1/2b012c26ffd84b1c900cdf648261dd59 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMinorCompactionWithWeeklyPolicy/56c18fcb418f4ae343b8ef57374cdf69/family1/2b012c26ffd84b1c900cdf648261dd59 2023-02-12 03:53:44,673 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithWeeklyPolicy/56c18fcb418f4ae343b8ef57374cdf69/family1/376e7c07674d41e398aa0c5db0c8524f_SeqId_44_ to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMinorCompactionWithWeeklyPolicy/56c18fcb418f4ae343b8ef57374cdf69/family1/376e7c07674d41e398aa0c5db0c8524f_SeqId_44_ 2023-02-12 03:53:45,014 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205a25a6052937c4b1d9c676fc91503848f to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151205a25a6052937c4b1d9c676fc91503848f 2023-02-12 03:53:45,015 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-02-12 03:53:45,043 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/f5c5e48971d94b20b5215bd38083f6ee first=Optional[r1] last=Optional[r2] 2023-02-12 03:53:45,043 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMinorCompactionWithWeeklyPolicy,,1676174012788.56c18fcb418f4ae343b8ef57374cdf69., hostname=jenkins-hbase20.apache.org,39639,1676173982450, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/f5c5e48971d94b20b5215bd38083f6ee}] 2023-02-12 03:53:45,047 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/f5c5e48971d94b20b5215bd38083f6ee for inclusion in 56c18fcb418f4ae343b8ef57374cdf69/family1 2023-02-12 03:53:45,051 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HStore(775): HFile bounds: first=r1 last=r2 2023-02-12 03:53:45,051 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HStore(777): Region bounds: first= last= 2023-02-12 03:53:45,051 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HRegion(2445): Flush status journal for 56c18fcb418f4ae343b8ef57374cdf69: 2023-02-12 03:53:45,052 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/f5c5e48971d94b20b5215bd38083f6ee to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/staging/jenkins__testMinorCompactionWithWeeklyPolicy__8fdfndchgd8q0c3gsco81a0meb7e8j0al4mimjq2ai3omt5cd0pgdq76ub6mh0qd/family1/f5c5e48971d94b20b5215bd38083f6ee 2023-02-12 03:53:45,055 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/staging/jenkins__testMinorCompactionWithWeeklyPolicy__8fdfndchgd8q0c3gsco81a0meb7e8j0al4mimjq2ai3omt5cd0pgdq76ub6mh0qd/family1/f5c5e48971d94b20b5215bd38083f6ee as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithWeeklyPolicy/56c18fcb418f4ae343b8ef57374cdf69/family1/ace1a6edec4f444385f1a71240d831a9_SeqId_47_ 2023-02-12 03:53:45,055 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/staging/jenkins__testMinorCompactionWithWeeklyPolicy__8fdfndchgd8q0c3gsco81a0meb7e8j0al4mimjq2ai3omt5cd0pgdq76ub6mh0qd/family1/f5c5e48971d94b20b5215bd38083f6ee into 56c18fcb418f4ae343b8ef57374cdf69/family1 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithWeeklyPolicy/56c18fcb418f4ae343b8ef57374cdf69/family1/ace1a6edec4f444385f1a71240d831a9_SeqId_47_ - updating store file list. 2023-02-12 03:53:45,067 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithWeeklyPolicy/56c18fcb418f4ae343b8ef57374cdf69/family1/ace1a6edec4f444385f1a71240d831a9_SeqId_47_ into 56c18fcb418f4ae343b8ef57374cdf69/family1 2023-02-12 03:53:45,067 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/staging/jenkins__testMinorCompactionWithWeeklyPolicy__8fdfndchgd8q0c3gsco81a0meb7e8j0al4mimjq2ai3omt5cd0pgdq76ub6mh0qd/family1/f5c5e48971d94b20b5215bd38083f6ee into 56c18fcb418f4ae343b8ef57374cdf69/family1 (new location: hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithWeeklyPolicy/56c18fcb418f4ae343b8ef57374cdf69/family1/ace1a6edec4f444385f1a71240d831a9_SeqId_47_) 2023-02-12 03:53:45,068 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/staging/jenkins__testMinorCompactionWithWeeklyPolicy__8fdfndchgd8q0c3gsco81a0meb7e8j0al4mimjq2ai3omt5cd0pgdq76ub6mh0qd/family1/f5c5e48971d94b20b5215bd38083f6ee 2023-02-12 03:53:45,068 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-02-12 03:53:45,069 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 181014 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-02-12 03:53:45,069 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HStore(1912): 56c18fcb418f4ae343b8ef57374cdf69/family1 is initiating minor compaction (all files) 2023-02-12 03:53:45,069 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@5d7a6eb4; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-12 03:53:45,069 INFO [RS:0;jenkins-hbase20:39639-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 56c18fcb418f4ae343b8ef57374cdf69/family1 in testMinorCompactionWithWeeklyPolicy,,1676174012788.56c18fcb418f4ae343b8ef57374cdf69. 2023-02-12 03:53:45,069 INFO [RS:0;jenkins-hbase20:39639-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithWeeklyPolicy/56c18fcb418f4ae343b8ef57374cdf69/family1/ee56374012a7444597e575df3801894e, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithWeeklyPolicy/56c18fcb418f4ae343b8ef57374cdf69/family1/a1690226e64745b9bd041e9eb13ba5f8, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithWeeklyPolicy/56c18fcb418f4ae343b8ef57374cdf69/family1/ace1a6edec4f444385f1a71240d831a9_SeqId_47_] into tmpdir=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithWeeklyPolicy/56c18fcb418f4ae343b8ef57374cdf69/.tmp, totalSize=176.8 K 2023-02-12 03:53:45,070 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] compactions.Compactor(207): Compacting ee56374012a7444597e575df3801894e, keycount=1000, bloomtype=ROW, size=165.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878805947 2023-02-12 03:53:45,070 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] compactions.Compactor(207): Compacting a1690226e64745b9bd041e9eb13ba5f8, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621205947 2023-02-12 03:53:45,071 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] compactions.Compactor(207): Compacting ace1a6edec4f444385f1a71240d831a9_SeqId_47_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448965205947 2023-02-12 03:53:45,071 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-02-12 03:53:45,072 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-12 03:53:45,074 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015120164a9fbd1476140f9bd76bc94ff581553 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015120164a9fbd1476140f9bd76bc94ff581553 2023-02-12 03:53:45,075 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151205048e59d70ffd4b2b80455c419ad1f897 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151205048e59d70ffd4b2b80455c419ad1f897 2023-02-12 03:53:45,075 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithWeeklyPolicy 2 expired mob files are deleted 2023-02-12 03:53:45,075 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-02-12 03:53:45,076 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-02-12 03:53:45,076 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676173985818] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-02-12 03:53:45,076 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676173985818] mob.MobUtils(840): end MOB compaction of files for table='testMinorCompactionWithWeeklyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-12 03:53:45,077 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=26, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-02-12 03:53:45,080 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=26, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE in 1.8630 sec 2023-02-12 03:53:45,100 INFO [RS:0;jenkins-hbase20:39639-shortCompactions-0] throttle.PressureAwareThroughputController(145): 56c18fcb418f4ae343b8ef57374cdf69#family1#compaction#35 average throughput is 8.59 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-12 03:53:45,198 INFO [Listener at localhost.localdomain/41049] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompactionWithWeeklyPolicy Thread=254 (was 249) - Thread LEAK? -, OpenFileDescriptor=604 (was 590) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=352 (was 369), ProcessCount=164 (was 164), AvailableMemoryMB=4536 (was 4686) 2023-02-12 03:53:45,212 INFO [Listener at localhost.localdomain/41049] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testScannerOnBulkLoadRefHFiles Thread=254, OpenFileDescriptor=604, MaxFileDescriptor=60000, SystemLoadAverage=352, ProcessCount=164, AvailableMemoryMB=4535 2023-02-12 03:53:45,215 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.HMaster$4(2102): Client=jenkins//148.251.75.209 create 'testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-02-12 03:53:45,216 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] procedure2.ProcedureExecutor(1029): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles 2023-02-12 03:53:45,218 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_PRE_OPERATION 2023-02-12 03:53:45,218 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(697): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testScannerOnBulkLoadRefHFiles" procId is: 27 2023-02-12 03:53:45,219 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-02-12 03:53:45,220 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-12 03:53:45,222 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/.tmp/data/default/testScannerOnBulkLoadRefHFiles/11ce5e4ebf46f66d8a2278adef25cc7b 2023-02-12 03:53:45,227 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/.tmp/data/default/testScannerOnBulkLoadRefHFiles/4c1781260cda984f8a55d33a072f186e 2023-02-12 03:53:45,229 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/.tmp/data/default/testScannerOnBulkLoadRefHFiles/11ce5e4ebf46f66d8a2278adef25cc7b empty. 2023-02-12 03:53:45,230 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/.tmp/data/default/testScannerOnBulkLoadRefHFiles/5a64d004db5bc34d6763997394073059 2023-02-12 03:53:45,232 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/.tmp/data/default/testScannerOnBulkLoadRefHFiles/11ce5e4ebf46f66d8a2278adef25cc7b 2023-02-12 03:53:45,232 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/.tmp/data/default/testScannerOnBulkLoadRefHFiles/4c1781260cda984f8a55d33a072f186e empty. 2023-02-12 03:53:45,232 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/.tmp/data/default/testScannerOnBulkLoadRefHFiles/5a64d004db5bc34d6763997394073059 empty. 2023-02-12 03:53:45,233 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/.tmp/data/default/testScannerOnBulkLoadRefHFiles/4c1781260cda984f8a55d33a072f186e 2023-02-12 03:53:45,233 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/.tmp/data/default/testScannerOnBulkLoadRefHFiles/5a64d004db5bc34d6763997394073059 2023-02-12 03:53:45,233 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testScannerOnBulkLoadRefHFiles regions 2023-02-12 03:53:45,321 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-02-12 03:53:45,522 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-02-12 03:53:45,654 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/.tmp/data/default/testScannerOnBulkLoadRefHFiles/.tabledesc/.tableinfo.0000000001 2023-02-12 03:53:45,655 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(7671): creating {ENCODED => 11ce5e4ebf46f66d8a2278adef25cc7b, NAME => 'testScannerOnBulkLoadRefHFiles,,1676174025214.11ce5e4ebf46f66d8a2278adef25cc7b.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/.tmp 2023-02-12 03:53:45,655 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(7671): creating {ENCODED => 4c1781260cda984f8a55d33a072f186e, NAME => 'testScannerOnBulkLoadRefHFiles,1,1676174025214.4c1781260cda984f8a55d33a072f186e.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/.tmp 2023-02-12 03:53:45,656 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(7671): creating {ENCODED => 5a64d004db5bc34d6763997394073059, NAME => 'testScannerOnBulkLoadRefHFiles,2,1676174025214.5a64d004db5bc34d6763997394073059.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/.tmp 2023-02-12 03:53:45,823 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-02-12 03:53:46,070 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(865): Instantiated testScannerOnBulkLoadRefHFiles,2,1676174025214.5a64d004db5bc34d6763997394073059.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:53:46,070 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(865): Instantiated testScannerOnBulkLoadRefHFiles,1,1676174025214.4c1781260cda984f8a55d33a072f186e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:53:46,070 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1603): Closing 5a64d004db5bc34d6763997394073059, disabling compactions & flushes 2023-02-12 03:53:46,070 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1603): Closing 4c1781260cda984f8a55d33a072f186e, disabling compactions & flushes 2023-02-12 03:53:46,071 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1625): Closing region testScannerOnBulkLoadRefHFiles,2,1676174025214.5a64d004db5bc34d6763997394073059. 2023-02-12 03:53:46,071 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(865): Instantiated testScannerOnBulkLoadRefHFiles,,1676174025214.11ce5e4ebf46f66d8a2278adef25cc7b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:53:46,071 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1625): Closing region testScannerOnBulkLoadRefHFiles,1,1676174025214.4c1781260cda984f8a55d33a072f186e. 2023-02-12 03:53:46,071 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1603): Closing 11ce5e4ebf46f66d8a2278adef25cc7b, disabling compactions & flushes 2023-02-12 03:53:46,071 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,1,1676174025214.4c1781260cda984f8a55d33a072f186e. 2023-02-12 03:53:46,071 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1713): Acquired close lock on testScannerOnBulkLoadRefHFiles,1,1676174025214.4c1781260cda984f8a55d33a072f186e. after waiting 0 ms 2023-02-12 03:53:46,071 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1723): Updates disabled for region testScannerOnBulkLoadRefHFiles,1,1676174025214.4c1781260cda984f8a55d33a072f186e. 2023-02-12 03:53:46,071 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,2,1676174025214.5a64d004db5bc34d6763997394073059. 2023-02-12 03:53:46,071 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1837): Closed testScannerOnBulkLoadRefHFiles,1,1676174025214.4c1781260cda984f8a55d33a072f186e. 2023-02-12 03:53:46,071 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1625): Closing region testScannerOnBulkLoadRefHFiles,,1676174025214.11ce5e4ebf46f66d8a2278adef25cc7b. 2023-02-12 03:53:46,071 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1557): Region close journal for 4c1781260cda984f8a55d33a072f186e: Waiting for close lock at 1676174026070Disabling compacts and flushes for region at 1676174026070Disabling writes for close at 1676174026071 (+1 ms)Writing region close event to WAL at 1676174026071Closed at 1676174026071 2023-02-12 03:53:46,071 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1713): Acquired close lock on testScannerOnBulkLoadRefHFiles,2,1676174025214.5a64d004db5bc34d6763997394073059. after waiting 0 ms 2023-02-12 03:53:46,071 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,,1676174025214.11ce5e4ebf46f66d8a2278adef25cc7b. 2023-02-12 03:53:46,071 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1713): Acquired close lock on testScannerOnBulkLoadRefHFiles,,1676174025214.11ce5e4ebf46f66d8a2278adef25cc7b. after waiting 0 ms 2023-02-12 03:53:46,071 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1723): Updates disabled for region testScannerOnBulkLoadRefHFiles,2,1676174025214.5a64d004db5bc34d6763997394073059. 2023-02-12 03:53:46,071 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1723): Updates disabled for region testScannerOnBulkLoadRefHFiles,,1676174025214.11ce5e4ebf46f66d8a2278adef25cc7b. 2023-02-12 03:53:46,071 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1837): Closed testScannerOnBulkLoadRefHFiles,2,1676174025214.5a64d004db5bc34d6763997394073059. 2023-02-12 03:53:46,071 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1837): Closed testScannerOnBulkLoadRefHFiles,,1676174025214.11ce5e4ebf46f66d8a2278adef25cc7b. 2023-02-12 03:53:46,071 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1557): Region close journal for 5a64d004db5bc34d6763997394073059: Waiting for close lock at 1676174026070Disabling compacts and flushes for region at 1676174026070Disabling writes for close at 1676174026071 (+1 ms)Writing region close event to WAL at 1676174026071Closed at 1676174026071 2023-02-12 03:53:46,071 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1557): Region close journal for 11ce5e4ebf46f66d8a2278adef25cc7b: Waiting for close lock at 1676174026071Disabling compacts and flushes for region at 1676174026071Disabling writes for close at 1676174026071Writing region close event to WAL at 1676174026071Closed at 1676174026071 2023-02-12 03:53:46,074 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_ADD_TO_META 2023-02-12 03:53:46,075 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,1,1676174025214.4c1781260cda984f8a55d33a072f186e.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1676174026074"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676174026074"}]},"ts":"1676174026074"} 2023-02-12 03:53:46,075 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,2,1676174025214.5a64d004db5bc34d6763997394073059.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1676174026074"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676174026074"}]},"ts":"1676174026074"} 2023-02-12 03:53:46,075 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,,1676174025214.11ce5e4ebf46f66d8a2278adef25cc7b.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1676174026074"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676174026074"}]},"ts":"1676174026074"} 2023-02-12 03:53:46,079 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-02-12 03:53:46,080 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-12 03:53:46,080 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testScannerOnBulkLoadRefHFiles","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676174026080"}]},"ts":"1676174026080"} 2023-02-12 03:53:46,083 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testScannerOnBulkLoadRefHFiles, state=ENABLING in hbase:meta 2023-02-12 03:53:46,086 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=11ce5e4ebf46f66d8a2278adef25cc7b, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=4c1781260cda984f8a55d33a072f186e, ASSIGN}, {pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=5a64d004db5bc34d6763997394073059, ASSIGN}] 2023-02-12 03:53:46,089 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=5a64d004db5bc34d6763997394073059, ASSIGN 2023-02-12 03:53:46,089 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=11ce5e4ebf46f66d8a2278adef25cc7b, ASSIGN 2023-02-12 03:53:46,089 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=4c1781260cda984f8a55d33a072f186e, ASSIGN 2023-02-12 03:53:46,091 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=5a64d004db5bc34d6763997394073059, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,39639,1676173982450; forceNewPlan=false, retain=false 2023-02-12 03:53:46,091 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=4c1781260cda984f8a55d33a072f186e, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,39639,1676173982450; forceNewPlan=false, retain=false 2023-02-12 03:53:46,091 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=11ce5e4ebf46f66d8a2278adef25cc7b, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,39639,1676173982450; forceNewPlan=false, retain=false 2023-02-12 03:53:46,243 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=11ce5e4ebf46f66d8a2278adef25cc7b, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:46,243 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=4c1781260cda984f8a55d33a072f186e, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:46,243 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=30 updating hbase:meta row=5a64d004db5bc34d6763997394073059, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:46,243 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,,1676174025214.11ce5e4ebf46f66d8a2278adef25cc7b.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1676174026243"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676174026243"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676174026243"}]},"ts":"1676174026243"} 2023-02-12 03:53:46,243 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,2,1676174025214.5a64d004db5bc34d6763997394073059.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1676174026243"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676174026243"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676174026243"}]},"ts":"1676174026243"} 2023-02-12 03:53:46,243 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,1,1676174025214.4c1781260cda984f8a55d33a072f186e.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1676174026243"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676174026243"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676174026243"}]},"ts":"1676174026243"} 2023-02-12 03:53:46,245 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=31, ppid=28, state=RUNNABLE; OpenRegionProcedure 11ce5e4ebf46f66d8a2278adef25cc7b, server=jenkins-hbase20.apache.org,39639,1676173982450}] 2023-02-12 03:53:46,246 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=32, ppid=30, state=RUNNABLE; OpenRegionProcedure 5a64d004db5bc34d6763997394073059, server=jenkins-hbase20.apache.org,39639,1676173982450}] 2023-02-12 03:53:46,247 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=33, ppid=29, state=RUNNABLE; OpenRegionProcedure 4c1781260cda984f8a55d33a072f186e, server=jenkins-hbase20.apache.org,39639,1676173982450}] 2023-02-12 03:53:46,324 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-02-12 03:53:46,338 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithWeeklyPolicy/56c18fcb418f4ae343b8ef57374cdf69/.tmp/family1/63c2331898004150931cdae01a8b126a as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithWeeklyPolicy/56c18fcb418f4ae343b8ef57374cdf69/family1/63c2331898004150931cdae01a8b126a 2023-02-12 03:53:46,344 INFO [RS:0;jenkins-hbase20:39639-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 56c18fcb418f4ae343b8ef57374cdf69/family1 of 56c18fcb418f4ae343b8ef57374cdf69 into 63c2331898004150931cdae01a8b126a(size=166.4 K), total size for store is 166.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-12 03:53:46,344 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 56c18fcb418f4ae343b8ef57374cdf69: 2023-02-12 03:53:46,344 INFO [RS:0;jenkins-hbase20:39639-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithWeeklyPolicy,,1676174012788.56c18fcb418f4ae343b8ef57374cdf69., storeName=family1, fileCount=3, fileSize=176.8 K (165.1 K, 6.6 K, 5.2 K), priority=2, time=1676174025069; duration=1sec 2023-02-12 03:53:46,345 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-12 03:53:46,353 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithWeeklyPolicy/56c18fcb418f4ae343b8ef57374cdf69/family1/ee56374012a7444597e575df3801894e, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithWeeklyPolicy/56c18fcb418f4ae343b8ef57374cdf69/family1/a1690226e64745b9bd041e9eb13ba5f8, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithWeeklyPolicy/56c18fcb418f4ae343b8ef57374cdf69/family1/ace1a6edec4f444385f1a71240d831a9_SeqId_47_] to archive 2023-02-12 03:53:46,353 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-12 03:53:46,355 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithWeeklyPolicy/56c18fcb418f4ae343b8ef57374cdf69/family1/ee56374012a7444597e575df3801894e to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMinorCompactionWithWeeklyPolicy/56c18fcb418f4ae343b8ef57374cdf69/family1/ee56374012a7444597e575df3801894e 2023-02-12 03:53:46,357 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithWeeklyPolicy/56c18fcb418f4ae343b8ef57374cdf69/family1/a1690226e64745b9bd041e9eb13ba5f8 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMinorCompactionWithWeeklyPolicy/56c18fcb418f4ae343b8ef57374cdf69/family1/a1690226e64745b9bd041e9eb13ba5f8 2023-02-12 03:53:46,358 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithWeeklyPolicy/56c18fcb418f4ae343b8ef57374cdf69/family1/ace1a6edec4f444385f1a71240d831a9_SeqId_47_ to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMinorCompactionWithWeeklyPolicy/56c18fcb418f4ae343b8ef57374cdf69/family1/ace1a6edec4f444385f1a71240d831a9_SeqId_47_ 2023-02-12 03:53:46,402 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testScannerOnBulkLoadRefHFiles,2,1676174025214.5a64d004db5bc34d6763997394073059. 2023-02-12 03:53:46,402 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 5a64d004db5bc34d6763997394073059, NAME => 'testScannerOnBulkLoadRefHFiles,2,1676174025214.5a64d004db5bc34d6763997394073059.', STARTKEY => '2', ENDKEY => ''} 2023-02-12 03:53:46,403 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles 5a64d004db5bc34d6763997394073059 2023-02-12 03:53:46,403 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testScannerOnBulkLoadRefHFiles,2,1676174025214.5a64d004db5bc34d6763997394073059.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:53:46,403 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 5a64d004db5bc34d6763997394073059 2023-02-12 03:53:46,403 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 5a64d004db5bc34d6763997394073059 2023-02-12 03:53:46,404 INFO [StoreOpener-5a64d004db5bc34d6763997394073059-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 5a64d004db5bc34d6763997394073059 2023-02-12 03:53:46,406 DEBUG [StoreOpener-5a64d004db5bc34d6763997394073059-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testScannerOnBulkLoadRefHFiles/5a64d004db5bc34d6763997394073059/family1 2023-02-12 03:53:46,406 DEBUG [StoreOpener-5a64d004db5bc34d6763997394073059-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testScannerOnBulkLoadRefHFiles/5a64d004db5bc34d6763997394073059/family1 2023-02-12 03:53:46,407 INFO [StoreOpener-5a64d004db5bc34d6763997394073059-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5a64d004db5bc34d6763997394073059 columnFamilyName family1 2023-02-12 03:53:46,409 INFO [StoreOpener-5a64d004db5bc34d6763997394073059-1] regionserver.HStore(310): Store=5a64d004db5bc34d6763997394073059/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:53:46,410 INFO [StoreOpener-5a64d004db5bc34d6763997394073059-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 5a64d004db5bc34d6763997394073059 2023-02-12 03:53:46,412 DEBUG [StoreOpener-5a64d004db5bc34d6763997394073059-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testScannerOnBulkLoadRefHFiles/5a64d004db5bc34d6763997394073059/family2 2023-02-12 03:53:46,412 DEBUG [StoreOpener-5a64d004db5bc34d6763997394073059-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testScannerOnBulkLoadRefHFiles/5a64d004db5bc34d6763997394073059/family2 2023-02-12 03:53:46,412 INFO [StoreOpener-5a64d004db5bc34d6763997394073059-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5a64d004db5bc34d6763997394073059 columnFamilyName family2 2023-02-12 03:53:46,414 INFO [StoreOpener-5a64d004db5bc34d6763997394073059-1] regionserver.HStore(310): Store=5a64d004db5bc34d6763997394073059/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:53:46,416 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testScannerOnBulkLoadRefHFiles/5a64d004db5bc34d6763997394073059 2023-02-12 03:53:46,416 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testScannerOnBulkLoadRefHFiles/5a64d004db5bc34d6763997394073059 2023-02-12 03:53:46,418 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 03:53:46,420 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 5a64d004db5bc34d6763997394073059 2023-02-12 03:53:46,422 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testScannerOnBulkLoadRefHFiles/5a64d004db5bc34d6763997394073059/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 03:53:46,423 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 5a64d004db5bc34d6763997394073059; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70006435, jitterRate=0.04317717254161835}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 03:53:46,423 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 5a64d004db5bc34d6763997394073059: Running coprocessor pre-open hook at 1676174026403Writing region info on filesystem at 1676174026403Initializing all the Stores at 1676174026404 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676174026404Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676174026404Cleaning up temporary data from old regions at 1676174026417 (+13 ms)Cleaning up detritus from prior splits at 1676174026418 (+1 ms)Running coprocessor post-open hooks at 1676174026423 (+5 ms)Region opened successfully at 1676174026423 2023-02-12 03:53:46,424 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,2,1676174025214.5a64d004db5bc34d6763997394073059., pid=32, masterSystemTime=1676174026398 2023-02-12 03:53:46,426 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,2,1676174025214.5a64d004db5bc34d6763997394073059. 2023-02-12 03:53:46,426 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testScannerOnBulkLoadRefHFiles,2,1676174025214.5a64d004db5bc34d6763997394073059. 2023-02-12 03:53:46,426 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testScannerOnBulkLoadRefHFiles,,1676174025214.11ce5e4ebf46f66d8a2278adef25cc7b. 2023-02-12 03:53:46,426 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 11ce5e4ebf46f66d8a2278adef25cc7b, NAME => 'testScannerOnBulkLoadRefHFiles,,1676174025214.11ce5e4ebf46f66d8a2278adef25cc7b.', STARTKEY => '', ENDKEY => '1'} 2023-02-12 03:53:46,427 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles 11ce5e4ebf46f66d8a2278adef25cc7b 2023-02-12 03:53:46,427 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=30 updating hbase:meta row=5a64d004db5bc34d6763997394073059, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:46,427 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,2,1676174025214.5a64d004db5bc34d6763997394073059.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1676174026427"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676174026427"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676174026427"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676174026427"}]},"ts":"1676174026427"} 2023-02-12 03:53:46,427 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testScannerOnBulkLoadRefHFiles,,1676174025214.11ce5e4ebf46f66d8a2278adef25cc7b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:53:46,428 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 11ce5e4ebf46f66d8a2278adef25cc7b 2023-02-12 03:53:46,428 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 11ce5e4ebf46f66d8a2278adef25cc7b 2023-02-12 03:53:46,430 INFO [StoreOpener-11ce5e4ebf46f66d8a2278adef25cc7b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 11ce5e4ebf46f66d8a2278adef25cc7b 2023-02-12 03:53:46,432 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=32, resume processing ppid=30 2023-02-12 03:53:46,432 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=32, ppid=30, state=SUCCESS; OpenRegionProcedure 5a64d004db5bc34d6763997394073059, server=jenkins-hbase20.apache.org,39639,1676173982450 in 183 msec 2023-02-12 03:53:46,433 DEBUG [StoreOpener-11ce5e4ebf46f66d8a2278adef25cc7b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testScannerOnBulkLoadRefHFiles/11ce5e4ebf46f66d8a2278adef25cc7b/family1 2023-02-12 03:53:46,433 DEBUG [StoreOpener-11ce5e4ebf46f66d8a2278adef25cc7b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testScannerOnBulkLoadRefHFiles/11ce5e4ebf46f66d8a2278adef25cc7b/family1 2023-02-12 03:53:46,433 INFO [StoreOpener-11ce5e4ebf46f66d8a2278adef25cc7b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 11ce5e4ebf46f66d8a2278adef25cc7b columnFamilyName family1 2023-02-12 03:53:46,434 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=5a64d004db5bc34d6763997394073059, ASSIGN in 346 msec 2023-02-12 03:53:46,434 INFO [StoreOpener-11ce5e4ebf46f66d8a2278adef25cc7b-1] regionserver.HStore(310): Store=11ce5e4ebf46f66d8a2278adef25cc7b/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:53:46,435 INFO [StoreOpener-11ce5e4ebf46f66d8a2278adef25cc7b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 11ce5e4ebf46f66d8a2278adef25cc7b 2023-02-12 03:53:46,438 DEBUG [StoreOpener-11ce5e4ebf46f66d8a2278adef25cc7b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testScannerOnBulkLoadRefHFiles/11ce5e4ebf46f66d8a2278adef25cc7b/family2 2023-02-12 03:53:46,438 DEBUG [StoreOpener-11ce5e4ebf46f66d8a2278adef25cc7b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testScannerOnBulkLoadRefHFiles/11ce5e4ebf46f66d8a2278adef25cc7b/family2 2023-02-12 03:53:46,439 INFO [StoreOpener-11ce5e4ebf46f66d8a2278adef25cc7b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 11ce5e4ebf46f66d8a2278adef25cc7b columnFamilyName family2 2023-02-12 03:53:46,441 INFO [StoreOpener-11ce5e4ebf46f66d8a2278adef25cc7b-1] regionserver.HStore(310): Store=11ce5e4ebf46f66d8a2278adef25cc7b/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:53:46,442 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testScannerOnBulkLoadRefHFiles/11ce5e4ebf46f66d8a2278adef25cc7b 2023-02-12 03:53:46,442 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testScannerOnBulkLoadRefHFiles/11ce5e4ebf46f66d8a2278adef25cc7b 2023-02-12 03:53:46,444 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 03:53:46,445 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 11ce5e4ebf46f66d8a2278adef25cc7b 2023-02-12 03:53:46,447 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testScannerOnBulkLoadRefHFiles/11ce5e4ebf46f66d8a2278adef25cc7b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 03:53:46,448 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 11ce5e4ebf46f66d8a2278adef25cc7b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67300735, jitterRate=0.0028591006994247437}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 03:53:46,448 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 11ce5e4ebf46f66d8a2278adef25cc7b: Running coprocessor pre-open hook at 1676174026428Writing region info on filesystem at 1676174026428Initializing all the Stores at 1676174026429 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676174026429Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676174026429Cleaning up temporary data from old regions at 1676174026443 (+14 ms)Cleaning up detritus from prior splits at 1676174026443Running coprocessor post-open hooks at 1676174026448 (+5 ms)Region opened successfully at 1676174026448 2023-02-12 03:53:46,449 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,,1676174025214.11ce5e4ebf46f66d8a2278adef25cc7b., pid=31, masterSystemTime=1676174026398 2023-02-12 03:53:46,451 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,,1676174025214.11ce5e4ebf46f66d8a2278adef25cc7b. 2023-02-12 03:53:46,451 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testScannerOnBulkLoadRefHFiles,,1676174025214.11ce5e4ebf46f66d8a2278adef25cc7b. 2023-02-12 03:53:46,451 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testScannerOnBulkLoadRefHFiles,1,1676174025214.4c1781260cda984f8a55d33a072f186e. 2023-02-12 03:53:46,451 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 4c1781260cda984f8a55d33a072f186e, NAME => 'testScannerOnBulkLoadRefHFiles,1,1676174025214.4c1781260cda984f8a55d33a072f186e.', STARTKEY => '1', ENDKEY => '2'} 2023-02-12 03:53:46,451 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=11ce5e4ebf46f66d8a2278adef25cc7b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:46,451 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,,1676174025214.11ce5e4ebf46f66d8a2278adef25cc7b.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1676174026451"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676174026451"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676174026451"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676174026451"}]},"ts":"1676174026451"} 2023-02-12 03:53:46,451 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles 4c1781260cda984f8a55d33a072f186e 2023-02-12 03:53:46,451 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testScannerOnBulkLoadRefHFiles,1,1676174025214.4c1781260cda984f8a55d33a072f186e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:53:46,452 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 4c1781260cda984f8a55d33a072f186e 2023-02-12 03:53:46,452 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 4c1781260cda984f8a55d33a072f186e 2023-02-12 03:53:46,453 INFO [StoreOpener-4c1781260cda984f8a55d33a072f186e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 4c1781260cda984f8a55d33a072f186e 2023-02-12 03:53:46,454 DEBUG [StoreOpener-4c1781260cda984f8a55d33a072f186e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testScannerOnBulkLoadRefHFiles/4c1781260cda984f8a55d33a072f186e/family1 2023-02-12 03:53:46,454 DEBUG [StoreOpener-4c1781260cda984f8a55d33a072f186e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testScannerOnBulkLoadRefHFiles/4c1781260cda984f8a55d33a072f186e/family1 2023-02-12 03:53:46,454 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=31, resume processing ppid=28 2023-02-12 03:53:46,454 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=31, ppid=28, state=SUCCESS; OpenRegionProcedure 11ce5e4ebf46f66d8a2278adef25cc7b, server=jenkins-hbase20.apache.org,39639,1676173982450 in 208 msec 2023-02-12 03:53:46,455 INFO [StoreOpener-4c1781260cda984f8a55d33a072f186e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4c1781260cda984f8a55d33a072f186e columnFamilyName family1 2023-02-12 03:53:46,455 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=11ce5e4ebf46f66d8a2278adef25cc7b, ASSIGN in 368 msec 2023-02-12 03:53:46,456 INFO [StoreOpener-4c1781260cda984f8a55d33a072f186e-1] regionserver.HStore(310): Store=4c1781260cda984f8a55d33a072f186e/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:53:46,456 INFO [StoreOpener-4c1781260cda984f8a55d33a072f186e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 4c1781260cda984f8a55d33a072f186e 2023-02-12 03:53:46,457 DEBUG [StoreOpener-4c1781260cda984f8a55d33a072f186e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testScannerOnBulkLoadRefHFiles/4c1781260cda984f8a55d33a072f186e/family2 2023-02-12 03:53:46,457 DEBUG [StoreOpener-4c1781260cda984f8a55d33a072f186e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testScannerOnBulkLoadRefHFiles/4c1781260cda984f8a55d33a072f186e/family2 2023-02-12 03:53:46,457 INFO [StoreOpener-4c1781260cda984f8a55d33a072f186e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4c1781260cda984f8a55d33a072f186e columnFamilyName family2 2023-02-12 03:53:46,458 INFO [StoreOpener-4c1781260cda984f8a55d33a072f186e-1] regionserver.HStore(310): Store=4c1781260cda984f8a55d33a072f186e/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:53:46,459 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testScannerOnBulkLoadRefHFiles/4c1781260cda984f8a55d33a072f186e 2023-02-12 03:53:46,459 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testScannerOnBulkLoadRefHFiles/4c1781260cda984f8a55d33a072f186e 2023-02-12 03:53:46,460 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 03:53:46,461 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 4c1781260cda984f8a55d33a072f186e 2023-02-12 03:53:46,462 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testScannerOnBulkLoadRefHFiles/4c1781260cda984f8a55d33a072f186e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 03:53:46,463 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 4c1781260cda984f8a55d33a072f186e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69105175, jitterRate=0.02974735200405121}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 03:53:46,463 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 4c1781260cda984f8a55d33a072f186e: Running coprocessor pre-open hook at 1676174026452Writing region info on filesystem at 1676174026452Initializing all the Stores at 1676174026452Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676174026453 (+1 ms)Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676174026453Cleaning up temporary data from old regions at 1676174026460 (+7 ms)Cleaning up detritus from prior splits at 1676174026460Running coprocessor post-open hooks at 1676174026463 (+3 ms)Region opened successfully at 1676174026463 2023-02-12 03:53:46,463 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,1,1676174025214.4c1781260cda984f8a55d33a072f186e., pid=33, masterSystemTime=1676174026398 2023-02-12 03:53:46,465 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,1,1676174025214.4c1781260cda984f8a55d33a072f186e. 2023-02-12 03:53:46,465 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testScannerOnBulkLoadRefHFiles,1,1676174025214.4c1781260cda984f8a55d33a072f186e. 2023-02-12 03:53:46,465 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=4c1781260cda984f8a55d33a072f186e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:46,466 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,1,1676174025214.4c1781260cda984f8a55d33a072f186e.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1676174026465"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676174026465"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676174026465"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676174026465"}]},"ts":"1676174026465"} 2023-02-12 03:53:46,470 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=33, resume processing ppid=29 2023-02-12 03:53:46,470 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=33, ppid=29, state=SUCCESS; OpenRegionProcedure 4c1781260cda984f8a55d33a072f186e, server=jenkins-hbase20.apache.org,39639,1676173982450 in 220 msec 2023-02-12 03:53:46,472 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=27 2023-02-12 03:53:46,472 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=4c1781260cda984f8a55d33a072f186e, ASSIGN in 384 msec 2023-02-12 03:53:46,472 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-12 03:53:46,473 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testScannerOnBulkLoadRefHFiles","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676174026473"}]},"ts":"1676174026473"} 2023-02-12 03:53:46,474 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testScannerOnBulkLoadRefHFiles, state=ENABLED in hbase:meta 2023-02-12 03:53:46,476 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_POST_OPERATION 2023-02-12 03:53:46,478 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles in 1.2610 sec 2023-02-12 03:53:47,325 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-02-12 03:53:47,325 INFO [Listener at localhost.localdomain/41049] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testScannerOnBulkLoadRefHFiles, procId: 27 completed 2023-02-12 03:53:47,335 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-12 03:53:47,337 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] procedure.ProcedureCoordinator(165): Submitting procedure testScannerOnBulkLoadRefHFiles 2023-02-12 03:53:47,338 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testScannerOnBulkLoadRefHFiles' 2023-02-12 03:53:47,338 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:53:47,338 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' 2023-02-12 03:53:47,338 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testScannerOnBulkLoadRefHFiles', kicking off acquire phase on members. 2023-02-12 03:53:47,338 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-12 03:53:47,339 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-02-12 03:53:47,340 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:53:47,340 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:47,340 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:53:47,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:53:47,340 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:47,340 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-12 03:53:47,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-02-12 03:53:47,341 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-12 03:53:47,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-12 03:53:47,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-02-12 03:53:47,342 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testScannerOnBulkLoadRefHFiles 2023-02-12 03:53:47,342 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testScannerOnBulkLoadRefHFiles 2023-02-12 03:53:47,342 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testScannerOnBulkLoadRefHFiles' with timeout 60000ms 2023-02-12 03:53:47,342 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:53:47,342 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' stage 2023-02-12 03:53:47,343 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,,1676174025214.11ce5e4ebf46f66d8a2278adef25cc7b. 2023-02-12 03:53:47,343 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,,1676174025214.11ce5e4ebf46f66d8a2278adef25cc7b. started... 2023-02-12 03:53:47,343 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,1,1676174025214.4c1781260cda984f8a55d33a072f186e. 2023-02-12 03:53:47,344 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 11ce5e4ebf46f66d8a2278adef25cc7b: 2023-02-12 03:53:47,344 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,,1676174025214.11ce5e4ebf46f66d8a2278adef25cc7b. 2023-02-12 03:53:47,343 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-12 03:53:47,344 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-12 03:53:47,344 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-12 03:53:47,344 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,2,1676174025214.5a64d004db5bc34d6763997394073059. 2023-02-12 03:53:47,344 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,1,1676174025214.4c1781260cda984f8a55d33a072f186e. started... 2023-02-12 03:53:47,345 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,2,1676174025214.5a64d004db5bc34d6763997394073059. started... 2023-02-12 03:53:47,345 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 4c1781260cda984f8a55d33a072f186e: 2023-02-12 03:53:47,346 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 5a64d004db5bc34d6763997394073059 2/2 column families, dataSize=48 B heapSize=632 B 2023-02-12 03:53:47,346 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,1,1676174025214.4c1781260cda984f8a55d33a072f186e. 2023-02-12 03:53:47,346 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-12 03:53:47,765 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302126d89d2b2b11a4701ba3a3900a0f07f50 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c202302126d89d2b2b11a4701ba3a3900a0f07f50 2023-02-12 03:53:48,172 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=48, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testScannerOnBulkLoadRefHFiles/5a64d004db5bc34d6763997394073059/.tmp/family1/9d1e04e9525b4b97aa3962f4177b1c34 2023-02-12 03:53:48,177 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testScannerOnBulkLoadRefHFiles/5a64d004db5bc34d6763997394073059/.tmp/family1/9d1e04e9525b4b97aa3962f4177b1c34 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testScannerOnBulkLoadRefHFiles/5a64d004db5bc34d6763997394073059/family1/9d1e04e9525b4b97aa3962f4177b1c34 2023-02-12 03:53:48,182 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testScannerOnBulkLoadRefHFiles/5a64d004db5bc34d6763997394073059/family1/9d1e04e9525b4b97aa3962f4177b1c34, entries=1, sequenceid=5, filesize=4.9 K 2023-02-12 03:53:48,183 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~48 B/48, heapSize ~360 B/360, currentSize=0 B/0 for 5a64d004db5bc34d6763997394073059 in 837ms, sequenceid=5, compaction requested=false 2023-02-12 03:53:48,183 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testScannerOnBulkLoadRefHFiles' 2023-02-12 03:53:48,184 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 5a64d004db5bc34d6763997394073059: 2023-02-12 03:53:48,184 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,2,1676174025214.5a64d004db5bc34d6763997394073059. 2023-02-12 03:53:48,184 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-12 03:53:48,184 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-12 03:53:48,184 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:48,184 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally acquired 2023-02-12 03:53:48,184 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure (testScannerOnBulkLoadRefHFiles) in zk 2023-02-12 03:53:48,186 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:48,186 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-12 03:53:48,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:48,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:53:48,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:53:48,186 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-12 03:53:48,186 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testScannerOnBulkLoadRefHFiles' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 03:53:48,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:53:48,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:53:48,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-12 03:53:48,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:48,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:53:48,187 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure 'testScannerOnBulkLoadRefHFiles' on coordinator 2023-02-12 03:53:48,187 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@8b97aab[Count = 0] remaining members to acquire global barrier 2023-02-12 03:53:48,187 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'in-barrier' execution. 2023-02-12 03:53:48,187 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-12 03:53:48,188 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-12 03:53:48,188 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-12 03:53:48,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-12 03:53:48,188 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testScannerOnBulkLoadRefHFiles' received 'reached' from coordinator. 2023-02-12 03:53:48,188 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:48,188 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-12 03:53:48,188 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally completed 2023-02-12 03:53:48,188 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testScannerOnBulkLoadRefHFiles' completed for member 'jenkins-hbase20.apache.org,39639,1676173982450' in zk 2023-02-12 03:53:48,189 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testScannerOnBulkLoadRefHFiles' has notified controller of completion 2023-02-12 03:53:48,189 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:48,189 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:53:48,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:48,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:53:48,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:53:48,189 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testScannerOnBulkLoadRefHFiles' completed. 2023-02-12 03:53:48,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:53:48,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:53:48,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-12 03:53:48,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:48,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:53:48,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-12 03:53:48,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:48,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testScannerOnBulkLoadRefHFiles' member 'jenkins-hbase20.apache.org,39639,1676173982450': 2023-02-12 03:53:48,192 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' released barrier for procedure'testScannerOnBulkLoadRefHFiles', counting down latch. Waiting for 0 more 2023-02-12 03:53:48,192 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testScannerOnBulkLoadRefHFiles' execution completed 2023-02-12 03:53:48,192 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-12 03:53:48,192 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-12 03:53:48,192 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testScannerOnBulkLoadRefHFiles 2023-02-12 03:53:48,192 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testScannerOnBulkLoadRefHFilesincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-12 03:53:48,193 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-12 03:53:48,193 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-12 03:53:48,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-12 03:53:48,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:53:48,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:53:48,193 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-12 03:53:48,193 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:53:48,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-12 03:53:48,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:53:48,194 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:48,194 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:53:48,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:53:48,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-12 03:53:48,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-12 03:53:48,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:53:48,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-12 03:53:48,195 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:48,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:48,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:53:48,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-12 03:53:48,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:48,197 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:53:48,198 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:53:48,198 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:48,198 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles because node does not exist (not an error) 2023-02-12 03:53:48,198 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testScannerOnBulkLoadRefHFiles' 2023-02-12 03:53:48,198 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-12 03:53:48,198 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:53:48,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:53:48,198 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:53:48,198 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testScannerOnBulkLoadRefHFiles'' to complete. (max 300000 ms per retry) 2023-02-12 03:53:48,198 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-02-12 03:53:48,198 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-02-12 03:53:48,198 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-12 03:53:48,198 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:53:48,198 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:48,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:53:48,198 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-12 03:53:48,199 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-12 03:53:48,199 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-12 03:53:48,298 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-12 03:53:48,299 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-12 03:53:48,304 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-12 03:53:48,307 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] procedure.ProcedureCoordinator(143): Procedure testScannerOnBulkLoadRefHFiles was in running list but was completed. Accepting new attempt. 2023-02-12 03:53:48,307 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] procedure.ProcedureCoordinator(165): Submitting procedure testScannerOnBulkLoadRefHFiles 2023-02-12 03:53:48,307 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testScannerOnBulkLoadRefHFiles' 2023-02-12 03:53:48,307 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:53:48,307 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' 2023-02-12 03:53:48,307 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testScannerOnBulkLoadRefHFiles', kicking off acquire phase on members. 2023-02-12 03:53:48,308 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-12 03:53:48,308 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-02-12 03:53:48,309 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:48,309 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:53:48,309 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:53:48,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:53:48,309 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:48,309 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-12 03:53:48,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-02-12 03:53:48,310 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-12 03:53:48,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-12 03:53:48,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-02-12 03:53:48,311 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testScannerOnBulkLoadRefHFiles 2023-02-12 03:53:48,311 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testScannerOnBulkLoadRefHFiles is still present, removing 2023-02-12 03:53:48,311 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testScannerOnBulkLoadRefHFiles 2023-02-12 03:53:48,311 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testScannerOnBulkLoadRefHFiles' with timeout 60000ms 2023-02-12 03:53:48,312 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:53:48,312 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' stage 2023-02-12 03:53:48,312 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,,1676174025214.11ce5e4ebf46f66d8a2278adef25cc7b. 2023-02-12 03:53:48,312 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,1,1676174025214.4c1781260cda984f8a55d33a072f186e. 2023-02-12 03:53:48,312 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,1,1676174025214.4c1781260cda984f8a55d33a072f186e. started... 2023-02-12 03:53:48,312 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,,1676174025214.11ce5e4ebf46f66d8a2278adef25cc7b. started... 2023-02-12 03:53:48,312 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 4c1781260cda984f8a55d33a072f186e: 2023-02-12 03:53:48,312 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 11ce5e4ebf46f66d8a2278adef25cc7b: 2023-02-12 03:53:48,313 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,1,1676174025214.4c1781260cda984f8a55d33a072f186e. 2023-02-12 03:53:48,313 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-12 03:53:48,313 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,2,1676174025214.5a64d004db5bc34d6763997394073059. 2023-02-12 03:53:48,313 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,2,1676174025214.5a64d004db5bc34d6763997394073059. started... 2023-02-12 03:53:48,313 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 5a64d004db5bc34d6763997394073059 2/2 column families, dataSize=90 B heapSize=752 B 2023-02-12 03:53:48,313 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,,1676174025214.11ce5e4ebf46f66d8a2278adef25cc7b. 2023-02-12 03:53:48,313 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-12 03:53:48,313 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-12 03:53:48,314 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-12 03:53:48,732 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023021250ebdbafb9284d7caf273a497954b9a7 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c2023021250ebdbafb9284d7caf273a497954b9a7 2023-02-12 03:53:49,145 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=90, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testScannerOnBulkLoadRefHFiles/5a64d004db5bc34d6763997394073059/.tmp/family1/413d636bfe6249969ab6b149a2ad1f80 2023-02-12 03:53:49,151 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testScannerOnBulkLoadRefHFiles/5a64d004db5bc34d6763997394073059/.tmp/family1/413d636bfe6249969ab6b149a2ad1f80 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testScannerOnBulkLoadRefHFiles/5a64d004db5bc34d6763997394073059/family1/413d636bfe6249969ab6b149a2ad1f80 2023-02-12 03:53:49,156 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testScannerOnBulkLoadRefHFiles/5a64d004db5bc34d6763997394073059/family1/413d636bfe6249969ab6b149a2ad1f80, entries=2, sequenceid=9, filesize=5.0 K 2023-02-12 03:53:49,157 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~90 B/90, heapSize ~480 B/480, currentSize=0 B/0 for 5a64d004db5bc34d6763997394073059 in 844ms, sequenceid=9, compaction requested=false 2023-02-12 03:53:49,157 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 5a64d004db5bc34d6763997394073059: 2023-02-12 03:53:49,157 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,2,1676174025214.5a64d004db5bc34d6763997394073059. 2023-02-12 03:53:49,157 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-12 03:53:49,157 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-12 03:53:49,157 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:49,157 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally acquired 2023-02-12 03:53:49,158 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure (testScannerOnBulkLoadRefHFiles) in zk 2023-02-12 03:53:49,159 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:49,159 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-12 03:53:49,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:49,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:53:49,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:53:49,159 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-12 03:53:49,159 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testScannerOnBulkLoadRefHFiles' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 03:53:49,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:53:49,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:53:49,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-12 03:53:49,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:49,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:53:49,160 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure 'testScannerOnBulkLoadRefHFiles' on coordinator 2023-02-12 03:53:49,160 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3a36b29b[Count = 0] remaining members to acquire global barrier 2023-02-12 03:53:49,160 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'in-barrier' execution. 2023-02-12 03:53:49,160 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-12 03:53:49,161 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-12 03:53:49,161 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-12 03:53:49,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-12 03:53:49,161 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testScannerOnBulkLoadRefHFiles' received 'reached' from coordinator. 2023-02-12 03:53:49,161 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally completed 2023-02-12 03:53:49,161 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testScannerOnBulkLoadRefHFiles' completed for member 'jenkins-hbase20.apache.org,39639,1676173982450' in zk 2023-02-12 03:53:49,162 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testScannerOnBulkLoadRefHFiles' has notified controller of completion 2023-02-12 03:53:49,162 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:53:49,162 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testScannerOnBulkLoadRefHFiles' completed. 2023-02-12 03:53:49,163 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:49,163 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' released barrier for procedure'testScannerOnBulkLoadRefHFiles', counting down latch. Waiting for 0 more 2023-02-12 03:53:49,164 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-12 03:53:49,164 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testScannerOnBulkLoadRefHFiles' execution completed 2023-02-12 03:53:49,164 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-12 03:53:49,164 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-12 03:53:49,164 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testScannerOnBulkLoadRefHFiles 2023-02-12 03:53:49,164 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testScannerOnBulkLoadRefHFilesincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-12 03:53:49,165 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-12 03:53:49,165 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-12 03:53:49,165 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-12 03:53:49,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-12 03:53:49,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:53:49,165 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:53:49,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:53:49,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-12 03:53:49,165 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:53:49,165 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:49,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:53:49,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:53:49,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-12 03:53:49,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-12 03:53:49,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:53:49,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-12 03:53:49,167 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:49,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:49,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:53:49,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-12 03:53:49,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:49,169 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:49,169 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-02-12 03:53:49,169 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:53:49,169 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-02-12 03:53:49,169 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:53:49,169 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:53:49,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:53:49,169 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:53:49,169 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles because node does not exist (not an error) 2023-02-12 03:53:49,169 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:49,169 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testScannerOnBulkLoadRefHFiles' 2023-02-12 03:53:49,169 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-12 03:53:49,169 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-12 03:53:49,169 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-12 03:53:49,169 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-12 03:53:49,170 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testScannerOnBulkLoadRefHFiles'' to complete. (max 300000 ms per retry) 2023-02-12 03:53:49,170 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-12 03:53:49,170 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:53:49,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:53:49,270 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-12 03:53:49,271 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-12 03:53:49,277 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=40099] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testScannerOnBulkLoadRefHFiles 2023-02-12 03:53:49,280 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676173985818] procedure2.ProcedureExecutor(1029): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-02-12 03:53:49,280 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-02-12 03:53:49,281 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676173985818] mob.MobUtils(833): start MOB compaction of files for table='testScannerOnBulkLoadRefHFiles', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-12 03:53:49,281 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1676174629281 2023-02-12 03:53:49,282 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676173985818] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-12 03:53:49,282 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676173985818] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 2 selected files, and 0 irrelevant files table 'testScannerOnBulkLoadRefHFiles' and column 'family1' 2023-02-12 03:53:49,282 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676173985818] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-02-12 03:53:49,283 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676173985818] zookeeper.ReadOnlyZKClient(139): Connect 0x3c5ea81a to 127.0.0.1:59556 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 03:53:49,286 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676173985818] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1d692b7d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 03:53:49,286 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20230212 for table='testScannerOnBulkLoadRefHFiles' and column='family1' 2023-02-12 03:53:50,121 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230212080c6509427f4a808975f76a622708a7 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20230212080c6509427f4a808975f76a622708a7 2023-02-12 03:53:50,123 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230212 table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-02-12 03:53:50,137 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-12 03:53:50,139 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:33548, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-12 03:53:50,176 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-12 03:53:50,179 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:46590, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-12 03:53:50,208 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20230212/family1/1815426567784c01b8951725b9c3df9d first=Optional[k0] last=Optional[k1] 2023-02-12 03:53:50,209 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testScannerOnBulkLoadRefHFiles,2,1676174025214.5a64d004db5bc34d6763997394073059., hostname=jenkins-hbase20.apache.org,39639,1676173982450, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20230212/family1/1815426567784c01b8951725b9c3df9d}] 2023-02-12 03:53:50,217 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20230212/family1/1815426567784c01b8951725b9c3df9d for inclusion in 5a64d004db5bc34d6763997394073059/family1 2023-02-12 03:53:50,220 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HStore(775): HFile bounds: first=k0 last=k1 2023-02-12 03:53:50,220 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HStore(777): Region bounds: first=2 last= 2023-02-12 03:53:50,221 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HRegion(2445): Flush status journal for 5a64d004db5bc34d6763997394073059: 2023-02-12 03:53:50,222 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20230212/family1/1815426567784c01b8951725b9c3df9d to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/staging/jenkins__testScannerOnBulkLoadRefHFiles__vompjgs5q6sqcp0tojo45up5d42hl8oh067pn0pvmkvcda8vrkv9i7g7p6v0cj0j/family1/1815426567784c01b8951725b9c3df9d 2023-02-12 03:53:50,235 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/staging/jenkins__testScannerOnBulkLoadRefHFiles__vompjgs5q6sqcp0tojo45up5d42hl8oh067pn0pvmkvcda8vrkv9i7g7p6v0cj0j/family1/1815426567784c01b8951725b9c3df9d as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testScannerOnBulkLoadRefHFiles/5a64d004db5bc34d6763997394073059/family1/5d8da20852e6482ab3d359253ef51b8d_SeqId_12_ 2023-02-12 03:53:50,235 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/staging/jenkins__testScannerOnBulkLoadRefHFiles__vompjgs5q6sqcp0tojo45up5d42hl8oh067pn0pvmkvcda8vrkv9i7g7p6v0cj0j/family1/1815426567784c01b8951725b9c3df9d into 5a64d004db5bc34d6763997394073059/family1 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testScannerOnBulkLoadRefHFiles/5a64d004db5bc34d6763997394073059/family1/5d8da20852e6482ab3d359253ef51b8d_SeqId_12_ - updating store file list. 2023-02-12 03:53:50,241 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testScannerOnBulkLoadRefHFiles/5a64d004db5bc34d6763997394073059/family1/5d8da20852e6482ab3d359253ef51b8d_SeqId_12_ into 5a64d004db5bc34d6763997394073059/family1 2023-02-12 03:53:50,241 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/staging/jenkins__testScannerOnBulkLoadRefHFiles__vompjgs5q6sqcp0tojo45up5d42hl8oh067pn0pvmkvcda8vrkv9i7g7p6v0cj0j/family1/1815426567784c01b8951725b9c3df9d into 5a64d004db5bc34d6763997394073059/family1 (new location: hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testScannerOnBulkLoadRefHFiles/5a64d004db5bc34d6763997394073059/family1/5d8da20852e6482ab3d359253ef51b8d_SeqId_12_) 2023-02-12 03:53:50,242 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/staging/jenkins__testScannerOnBulkLoadRefHFiles__vompjgs5q6sqcp0tojo45up5d42hl8oh067pn0pvmkvcda8vrkv9i7g7p6v0cj0j/family1/1815426567784c01b8951725b9c3df9d 2023-02-12 03:53:50,242 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-02-12 03:53:50,244 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 15445 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-02-12 03:53:50,244 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HStore(1912): 5a64d004db5bc34d6763997394073059/family1 is initiating minor compaction (all files) 2023-02-12 03:53:50,245 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@7455f60a; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-12 03:53:50,245 INFO [RS:0;jenkins-hbase20:39639-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 5a64d004db5bc34d6763997394073059/family1 in testScannerOnBulkLoadRefHFiles,2,1676174025214.5a64d004db5bc34d6763997394073059. 2023-02-12 03:53:50,245 INFO [RS:0;jenkins-hbase20:39639-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testScannerOnBulkLoadRefHFiles/5a64d004db5bc34d6763997394073059/family1/9d1e04e9525b4b97aa3962f4177b1c34, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testScannerOnBulkLoadRefHFiles/5a64d004db5bc34d6763997394073059/family1/413d636bfe6249969ab6b149a2ad1f80, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testScannerOnBulkLoadRefHFiles/5a64d004db5bc34d6763997394073059/family1/5d8da20852e6482ab3d359253ef51b8d_SeqId_12_] into tmpdir=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testScannerOnBulkLoadRefHFiles/5a64d004db5bc34d6763997394073059/.tmp, totalSize=15.1 K 2023-02-12 03:53:50,246 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] compactions.Compactor(207): Compacting 9d1e04e9525b4b97aa3962f4177b1c34, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676174027326 2023-02-12 03:53:50,246 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] compactions.Compactor(207): Compacting 413d636bfe6249969ab6b149a2ad1f80, keycount=2, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676174027326 2023-02-12 03:53:50,250 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] compactions.Compactor(207): Compacting 5d8da20852e6482ab3d359253ef51b8d_SeqId_12_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676174027326 2023-02-12 03:53:50,251 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230212 table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-02-12 03:53:50,252 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-12 03:53:50,258 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c2023021250ebdbafb9284d7caf273a497954b9a7 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c2023021250ebdbafb9284d7caf273a497954b9a7 2023-02-12 03:53:50,262 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c202302126d89d2b2b11a4701ba3a3900a0f07f50 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c202302126d89d2b2b11a4701ba3a3900a0f07f50 2023-02-12 03:53:50,262 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testScannerOnBulkLoadRefHFiles 2 expired mob files are deleted 2023-02-12 03:53:50,262 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20230212' 2023-02-12 03:53:50,263 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20230212 for table='testScannerOnBulkLoadRefHFiles' and column='family1' 2023-02-12 03:53:50,264 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676173985818] compactions.PartitionedMobCompactor(354): After compaction, there are 1 mob files. table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-02-12 03:53:50,264 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676173985818] mob.MobUtils(840): end MOB compaction of files for table='testScannerOnBulkLoadRefHFiles', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-12 03:53:50,266 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-02-12 03:53:50,268 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE in 988 msec 2023-02-12 03:53:50,284 INFO [RS:0;jenkins-hbase20:39639-shortCompactions-0] throttle.PressureAwareThroughputController(145): 5a64d004db5bc34d6763997394073059#family1#compaction#38 average throughput is 0.01 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-12 03:53:50,316 INFO [Listener at localhost.localdomain/41049] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testScannerOnBulkLoadRefHFiles Thread=253 (was 254), OpenFileDescriptor=607 (was 604) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=380 (was 352) - SystemLoadAverage LEAK? -, ProcessCount=164 (was 164), AvailableMemoryMB=4360 (was 4535) 2023-02-12 03:53:50,335 INFO [Listener at localhost.localdomain/41049] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyPolicy Thread=251, OpenFileDescriptor=605, MaxFileDescriptor=60000, SystemLoadAverage=380, ProcessCount=164, AvailableMemoryMB=4357 2023-02-12 03:53:50,338 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.HMaster$4(2102): Client=jenkins//148.251.75.209 create 'testMajorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-02-12 03:53:50,339 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] procedure2.ProcedureExecutor(1029): Stored pid=35, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:50,342 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-02-12 03:53:50,342 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(697): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyPolicy" procId is: 35 2023-02-12 03:53:50,344 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-02-12 03:53:50,344 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-12 03:53:50,346 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/6868bac373e3128a323294fb5686f080 2023-02-12 03:53:50,347 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/6868bac373e3128a323294fb5686f080 empty. 2023-02-12 03:53:50,347 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/6868bac373e3128a323294fb5686f080 2023-02-12 03:53:50,347 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyPolicy regions 2023-02-12 03:53:50,448 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-02-12 03:53:50,649 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-02-12 03:53:50,764 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/.tabledesc/.tableinfo.0000000001 2023-02-12 03:53:50,766 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(7671): creating {ENCODED => 6868bac373e3128a323294fb5686f080, NAME => 'testMajorCompactionWithWeeklyPolicy,,1676174030338.6868bac373e3128a323294fb5686f080.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/.tmp 2023-02-12 03:53:50,950 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-02-12 03:53:51,129 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testScannerOnBulkLoadRefHFiles/5a64d004db5bc34d6763997394073059/.tmp/family1/1c6f1931107443ec8a7f097af853e9cc as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testScannerOnBulkLoadRefHFiles/5a64d004db5bc34d6763997394073059/family1/1c6f1931107443ec8a7f097af853e9cc 2023-02-12 03:53:51,134 INFO [RS:0;jenkins-hbase20:39639-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 5a64d004db5bc34d6763997394073059/family1 of 5a64d004db5bc34d6763997394073059 into 1c6f1931107443ec8a7f097af853e9cc(size=5.1 K), total size for store is 5.1 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-12 03:53:51,134 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 5a64d004db5bc34d6763997394073059: 2023-02-12 03:53:51,135 INFO [RS:0;jenkins-hbase20:39639-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testScannerOnBulkLoadRefHFiles,2,1676174025214.5a64d004db5bc34d6763997394073059., storeName=family1, fileCount=3, fileSize=15.1 K (4.9 K, 5.0 K, 5.2 K), priority=2, time=1676174030244; duration=0sec 2023-02-12 03:53:51,135 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-12 03:53:51,152 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testScannerOnBulkLoadRefHFiles/5a64d004db5bc34d6763997394073059/family1/9d1e04e9525b4b97aa3962f4177b1c34, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testScannerOnBulkLoadRefHFiles/5a64d004db5bc34d6763997394073059/family1/413d636bfe6249969ab6b149a2ad1f80, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testScannerOnBulkLoadRefHFiles/5a64d004db5bc34d6763997394073059/family1/5d8da20852e6482ab3d359253ef51b8d_SeqId_12_] to archive 2023-02-12 03:53:51,153 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-12 03:53:51,155 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testScannerOnBulkLoadRefHFiles/5a64d004db5bc34d6763997394073059/family1/9d1e04e9525b4b97aa3962f4177b1c34 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testScannerOnBulkLoadRefHFiles/5a64d004db5bc34d6763997394073059/family1/9d1e04e9525b4b97aa3962f4177b1c34 2023-02-12 03:53:51,156 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testScannerOnBulkLoadRefHFiles/5a64d004db5bc34d6763997394073059/family1/413d636bfe6249969ab6b149a2ad1f80 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testScannerOnBulkLoadRefHFiles/5a64d004db5bc34d6763997394073059/family1/413d636bfe6249969ab6b149a2ad1f80 2023-02-12 03:53:51,158 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testScannerOnBulkLoadRefHFiles/5a64d004db5bc34d6763997394073059/family1/5d8da20852e6482ab3d359253ef51b8d_SeqId_12_ to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testScannerOnBulkLoadRefHFiles/5a64d004db5bc34d6763997394073059/family1/5d8da20852e6482ab3d359253ef51b8d_SeqId_12_ 2023-02-12 03:53:51,173 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyPolicy,,1676174030338.6868bac373e3128a323294fb5686f080.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:53:51,173 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1603): Closing 6868bac373e3128a323294fb5686f080, disabling compactions & flushes 2023-02-12 03:53:51,173 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyPolicy,,1676174030338.6868bac373e3128a323294fb5686f080. 2023-02-12 03:53:51,173 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyPolicy,,1676174030338.6868bac373e3128a323294fb5686f080. 2023-02-12 03:53:51,173 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyPolicy,,1676174030338.6868bac373e3128a323294fb5686f080. after waiting 0 ms 2023-02-12 03:53:51,173 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyPolicy,,1676174030338.6868bac373e3128a323294fb5686f080. 2023-02-12 03:53:51,173 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyPolicy,,1676174030338.6868bac373e3128a323294fb5686f080. 2023-02-12 03:53:51,173 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1557): Region close journal for 6868bac373e3128a323294fb5686f080: Waiting for close lock at 1676174031173Disabling compacts and flushes for region at 1676174031173Disabling writes for close at 1676174031173Writing region close event to WAL at 1676174031173Closed at 1676174031173 2023-02-12 03:53:51,176 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-02-12 03:53:51,177 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyPolicy,,1676174030338.6868bac373e3128a323294fb5686f080.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676174031176"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676174031176"}]},"ts":"1676174031176"} 2023-02-12 03:53:51,178 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-12 03:53:51,179 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-12 03:53:51,179 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676174031179"}]},"ts":"1676174031179"} 2023-02-12 03:53:51,180 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyPolicy, state=ENABLING in hbase:meta 2023-02-12 03:53:51,182 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=6868bac373e3128a323294fb5686f080, ASSIGN}] 2023-02-12 03:53:51,184 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=6868bac373e3128a323294fb5686f080, ASSIGN 2023-02-12 03:53:51,184 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=6868bac373e3128a323294fb5686f080, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,39639,1676173982450; forceNewPlan=false, retain=false 2023-02-12 03:53:51,336 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=6868bac373e3128a323294fb5686f080, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:51,336 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyPolicy,,1676174030338.6868bac373e3128a323294fb5686f080.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676174031336"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676174031336"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676174031336"}]},"ts":"1676174031336"} 2023-02-12 03:53:51,338 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE; OpenRegionProcedure 6868bac373e3128a323294fb5686f080, server=jenkins-hbase20.apache.org,39639,1676173982450}] 2023-02-12 03:53:51,451 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-02-12 03:53:51,493 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyPolicy,,1676174030338.6868bac373e3128a323294fb5686f080. 2023-02-12 03:53:51,493 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 6868bac373e3128a323294fb5686f080, NAME => 'testMajorCompactionWithWeeklyPolicy,,1676174030338.6868bac373e3128a323294fb5686f080.', STARTKEY => '', ENDKEY => ''} 2023-02-12 03:53:51,493 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyPolicy 6868bac373e3128a323294fb5686f080 2023-02-12 03:53:51,493 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyPolicy,,1676174030338.6868bac373e3128a323294fb5686f080.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:53:51,493 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 6868bac373e3128a323294fb5686f080 2023-02-12 03:53:51,494 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 6868bac373e3128a323294fb5686f080 2023-02-12 03:53:51,495 INFO [StoreOpener-6868bac373e3128a323294fb5686f080-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 6868bac373e3128a323294fb5686f080 2023-02-12 03:53:51,496 DEBUG [StoreOpener-6868bac373e3128a323294fb5686f080-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyPolicy/6868bac373e3128a323294fb5686f080/family1 2023-02-12 03:53:51,496 DEBUG [StoreOpener-6868bac373e3128a323294fb5686f080-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyPolicy/6868bac373e3128a323294fb5686f080/family1 2023-02-12 03:53:51,496 INFO [StoreOpener-6868bac373e3128a323294fb5686f080-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6868bac373e3128a323294fb5686f080 columnFamilyName family1 2023-02-12 03:53:51,498 INFO [StoreOpener-6868bac373e3128a323294fb5686f080-1] regionserver.HStore(310): Store=6868bac373e3128a323294fb5686f080/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:53:51,499 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyPolicy/6868bac373e3128a323294fb5686f080 2023-02-12 03:53:51,499 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyPolicy/6868bac373e3128a323294fb5686f080 2023-02-12 03:53:51,502 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 6868bac373e3128a323294fb5686f080 2023-02-12 03:53:51,504 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyPolicy/6868bac373e3128a323294fb5686f080/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 03:53:51,504 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 6868bac373e3128a323294fb5686f080; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62119432, jitterRate=-0.0743483304977417}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-12 03:53:51,504 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 6868bac373e3128a323294fb5686f080: Running coprocessor pre-open hook at 1676174031494Writing region info on filesystem at 1676174031494Initializing all the Stores at 1676174031494Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} at 1676174031494Cleaning up temporary data from old regions at 1676174031500 (+6 ms)Cleaning up detritus from prior splits at 1676174031500Running coprocessor post-open hooks at 1676174031504 (+4 ms)Region opened successfully at 1676174031504 2023-02-12 03:53:51,505 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyPolicy,,1676174030338.6868bac373e3128a323294fb5686f080., pid=37, masterSystemTime=1676174031490 2023-02-12 03:53:51,507 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyPolicy,,1676174030338.6868bac373e3128a323294fb5686f080. 2023-02-12 03:53:51,507 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyPolicy,,1676174030338.6868bac373e3128a323294fb5686f080. 2023-02-12 03:53:51,508 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=6868bac373e3128a323294fb5686f080, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:51,508 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyPolicy,,1676174030338.6868bac373e3128a323294fb5686f080.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1676174031508"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676174031508"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676174031508"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676174031508"}]},"ts":"1676174031508"} 2023-02-12 03:53:51,513 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=37, resume processing ppid=36 2023-02-12 03:53:51,513 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=36, state=SUCCESS; OpenRegionProcedure 6868bac373e3128a323294fb5686f080, server=jenkins-hbase20.apache.org,39639,1676173982450 in 172 msec 2023-02-12 03:53:51,516 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=36, resume processing ppid=35 2023-02-12 03:53:51,516 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=36, ppid=35, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=6868bac373e3128a323294fb5686f080, ASSIGN in 331 msec 2023-02-12 03:53:51,516 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-12 03:53:51,516 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676174031516"}]},"ts":"1676174031516"} 2023-02-12 03:53:51,518 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyPolicy, state=ENABLED in hbase:meta 2023-02-12 03:53:51,519 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-02-12 03:53:51,521 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=35, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy in 1.1820 sec 2023-02-12 03:53:51,929 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-12 03:53:52,068 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyPolicy' 2023-02-12 03:53:52,453 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-02-12 03:53:52,453 INFO [Listener at localhost.localdomain/41049] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyPolicy, procId: 35 completed 2023-02-12 03:53:52,479 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-12 03:53:52,480 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:52,480 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-02-12 03:53:52,480 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:53:52,480 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-12 03:53:52,480 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-12 03:53:52,481 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:52,481 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:52,482 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:53:52,482 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:52,482 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:53:52,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:53:52,482 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:52,482 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-12 03:53:52,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:52,482 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:52,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-12 03:53:52,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:52,483 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:52,483 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:52,483 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-12 03:53:52,483 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:53:52,483 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-12 03:53:52,483 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-12 03:53:52,483 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-12 03:53:52,483 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1676174030338.6868bac373e3128a323294fb5686f080. 2023-02-12 03:53:52,483 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1676174030338.6868bac373e3128a323294fb5686f080. started... 2023-02-12 03:53:52,484 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 6868bac373e3128a323294fb5686f080 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-02-12 03:53:52,910 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130221c425e4dc946e386a44d8845f6e86f to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151130221c425e4dc946e386a44d8845f6e86f 2023-02-12 03:53:53,315 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyPolicy/6868bac373e3128a323294fb5686f080/.tmp/family1/997fa36bced54aad88a65ff095582cb1 2023-02-12 03:53:53,326 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyPolicy/6868bac373e3128a323294fb5686f080/.tmp/family1/997fa36bced54aad88a65ff095582cb1 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyPolicy/6868bac373e3128a323294fb5686f080/family1/997fa36bced54aad88a65ff095582cb1 2023-02-12 03:53:53,333 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyPolicy/6868bac373e3128a323294fb5686f080/family1/997fa36bced54aad88a65ff095582cb1, entries=1000, sequenceid=5, filesize=165.1 K 2023-02-12 03:53:53,334 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 6868bac373e3128a323294fb5686f080 in 850ms, sequenceid=5, compaction requested=false 2023-02-12 03:53:53,334 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 6868bac373e3128a323294fb5686f080: 2023-02-12 03:53:53,334 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1676174030338.6868bac373e3128a323294fb5686f080. 2023-02-12 03:53:53,334 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-12 03:53:53,334 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-12 03:53:53,334 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:53,335 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-02-12 03:53:53,335 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-02-12 03:53:53,336 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:53,336 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:53,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:53,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:53:53,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:53:53,336 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:53,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:53:53,336 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 03:53:53,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:53:53,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:53,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:53,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:53:53,337 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-02-12 03:53:53,337 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3034c298[Count = 0] remaining members to acquire global barrier 2023-02-12 03:53:53,337 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-12 03:53:53,337 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:53,338 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:53,338 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:53,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:53,338 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-12 03:53:53,338 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-02-12 03:53:53,338 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,39639,1676173982450' in zk 2023-02-12 03:53:53,338 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:53,338 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-12 03:53:53,339 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-12 03:53:53,339 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:53,339 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:53:53,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:53,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:53:53,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:53:53,339 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-02-12 03:53:53,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:53:53,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:53:53,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:53,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:53,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:53:53,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:53,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:53,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,39639,1676173982450': 2023-02-12 03:53:53,341 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-12 03:53:53,341 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-02-12 03:53:53,341 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-12 03:53:53,341 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-12 03:53:53,341 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:53,341 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-12 03:53:53,342 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:53,342 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:53,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:53,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:53:53,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:53:53,342 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:53,342 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:53:53,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:53,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:53:53,343 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:53,343 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:53:53,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:53:53,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:53,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:53,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:53:53,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:53,343 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:53,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:53,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:53:53,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:53,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:53,345 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:53,345 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:53,345 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:53:53,345 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:53,345 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:53:53,345 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:53:53,345 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-02-12 03:53:53,345 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-12 03:53:53,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:53:53,345 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:53,345 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:53:53,345 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:53,345 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-12 03:53:53,345 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:53,345 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-12 03:53:53,345 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:53:53,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:53:53,345 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:53,345 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-12 03:53:53,445 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-12 03:53:53,447 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-12 03:53:53,453 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-12 03:53:53,456 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-12 03:53:53,456 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:53,457 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-02-12 03:53:53,457 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:53:53,457 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-12 03:53:53,457 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-12 03:53:53,458 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:53,458 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:53,459 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:53:53,459 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:53,459 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:53:53,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:53:53,460 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:53,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:53,460 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-12 03:53:53,461 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:53,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-12 03:53:53,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:53,462 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:53,462 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-02-12 03:53:53,462 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:53,462 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-12 03:53:53,462 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:53:53,462 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-12 03:53:53,463 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-12 03:53:53,463 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-12 03:53:53,463 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1676174030338.6868bac373e3128a323294fb5686f080. 2023-02-12 03:53:53,463 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1676174030338.6868bac373e3128a323294fb5686f080. started... 2023-02-12 03:53:53,463 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 6868bac373e3128a323294fb5686f080 1/1 column families, dataSize=74 B heapSize=408 B 2023-02-12 03:53:53,883 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112892724108a3dc413bbae1b2bb1fb9d48f to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015112892724108a3dc413bbae1b2bb1fb9d48f 2023-02-12 03:53:54,293 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyPolicy/6868bac373e3128a323294fb5686f080/.tmp/family1/0eddbd0473ca47f9994fd1c008b9995d 2023-02-12 03:53:54,300 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyPolicy/6868bac373e3128a323294fb5686f080/.tmp/family1/0eddbd0473ca47f9994fd1c008b9995d as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyPolicy/6868bac373e3128a323294fb5686f080/family1/0eddbd0473ca47f9994fd1c008b9995d 2023-02-12 03:53:54,306 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyPolicy/6868bac373e3128a323294fb5686f080/family1/0eddbd0473ca47f9994fd1c008b9995d, entries=1, sequenceid=9, filesize=5.0 K 2023-02-12 03:53:54,307 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 6868bac373e3128a323294fb5686f080 in 844ms, sequenceid=9, compaction requested=false 2023-02-12 03:53:54,307 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 6868bac373e3128a323294fb5686f080: 2023-02-12 03:53:54,307 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1676174030338.6868bac373e3128a323294fb5686f080. 2023-02-12 03:53:54,307 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-12 03:53:54,307 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-12 03:53:54,307 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:54,307 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-02-12 03:53:54,307 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-02-12 03:53:54,308 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:54,308 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:54,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:54,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:53:54,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:53:54,309 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:54,309 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 03:53:54,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:53:54,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:53:54,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:54,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:54,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:53:54,310 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-02-12 03:53:54,310 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5ad9c766[Count = 0] remaining members to acquire global barrier 2023-02-12 03:53:54,310 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-12 03:53:54,311 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:54,312 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:54,312 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:54,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:54,312 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-12 03:53:54,312 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-02-12 03:53:54,312 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,39639,1676173982450' in zk 2023-02-12 03:53:54,312 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:54,312 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-12 03:53:54,313 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:54,313 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-12 03:53:54,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:54,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:53:54,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:53:54,313 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:53:54,313 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-02-12 03:53:54,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:53:54,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:53:54,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:54,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:54,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:53:54,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:54,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:54,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,39639,1676173982450': 2023-02-12 03:53:54,315 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-12 03:53:54,315 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-02-12 03:53:54,316 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-12 03:53:54,316 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-12 03:53:54,316 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:54,316 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-12 03:53:54,317 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:54,317 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:54,317 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:53:54,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:54,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:53:54,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:53:54,317 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:54,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:54,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:53:54,317 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:53:54,317 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:54,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:53:54,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:54,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:54,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:53:54,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:54,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:54,318 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:54,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:53:54,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:54,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:54,320 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:54,320 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:53:54,320 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:54,320 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:53:54,320 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:53:54,320 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:53:54,320 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-02-12 03:53:54,320 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-12 03:53:54,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:53:54,320 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:54,320 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:54,320 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:54,321 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:54,321 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-12 03:53:54,321 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:53:54,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:53:54,321 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:54,321 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-12 03:53:54,421 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-12 03:53:54,422 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-12 03:53:54,427 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-12 03:53:54,428 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-12 03:53:54,428 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:54,428 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-02-12 03:53:54,429 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:53:54,429 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-12 03:53:54,429 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-12 03:53:54,429 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:54,429 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:54,430 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:54,430 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:53:54,430 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:53:54,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:53:54,430 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:54,430 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-12 03:53:54,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:54,431 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:54,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-12 03:53:54,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:54,432 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:54,432 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-02-12 03:53:54,432 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:54,432 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-12 03:53:54,432 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:53:54,432 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-12 03:53:54,433 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-12 03:53:54,433 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-12 03:53:54,433 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1676174030338.6868bac373e3128a323294fb5686f080. 2023-02-12 03:53:54,433 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1676174030338.6868bac373e3128a323294fb5686f080. started... 2023-02-12 03:53:54,433 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 6868bac373e3128a323294fb5686f080 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-12 03:53:54,850 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512015a0e49d01a8843f8b8e248a5d7a42435 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512015a0e49d01a8843f8b8e248a5d7a42435 2023-02-12 03:53:55,257 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyPolicy/6868bac373e3128a323294fb5686f080/.tmp/family1/fcdad7d7aab5419a93bb13d1f6429124 2023-02-12 03:53:55,269 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyPolicy/6868bac373e3128a323294fb5686f080/.tmp/family1/fcdad7d7aab5419a93bb13d1f6429124 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyPolicy/6868bac373e3128a323294fb5686f080/family1/fcdad7d7aab5419a93bb13d1f6429124 2023-02-12 03:53:55,276 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyPolicy/6868bac373e3128a323294fb5686f080/family1/fcdad7d7aab5419a93bb13d1f6429124, entries=1, sequenceid=13, filesize=4.9 K 2023-02-12 03:53:55,277 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 6868bac373e3128a323294fb5686f080 in 844ms, sequenceid=13, compaction requested=true 2023-02-12 03:53:55,277 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 6868bac373e3128a323294fb5686f080: 2023-02-12 03:53:55,277 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1676174030338.6868bac373e3128a323294fb5686f080. 2023-02-12 03:53:55,277 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-12 03:53:55,278 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-12 03:53:55,278 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:55,278 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-02-12 03:53:55,278 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-02-12 03:53:55,279 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:55,279 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:55,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:55,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:53:55,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:53:55,279 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:55,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:53:55,279 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 03:53:55,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:53:55,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:55,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:55,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:53:55,281 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-02-12 03:53:55,281 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@197682b4[Count = 0] remaining members to acquire global barrier 2023-02-12 03:53:55,281 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-12 03:53:55,281 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:55,282 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:55,282 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:55,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:55,282 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-12 03:53:55,282 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-02-12 03:53:55,282 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,39639,1676173982450' in zk 2023-02-12 03:53:55,282 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:55,282 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-12 03:53:55,283 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:55,283 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-12 03:53:55,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:55,283 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:53:55,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:53:55,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:53:55,283 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-02-12 03:53:55,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:53:55,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:53:55,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:55,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:55,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:53:55,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:55,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:55,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,39639,1676173982450': 2023-02-12 03:53:55,286 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-12 03:53:55,286 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-02-12 03:53:55,287 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-12 03:53:55,287 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-12 03:53:55,287 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:55,287 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-12 03:53:55,288 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:55,288 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:55,288 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:55,288 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:53:55,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:55,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:55,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:53:55,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:53:55,289 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:53:55,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:53:55,289 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:55,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:53:55,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:55,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:55,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:53:55,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:55,290 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:55,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:55,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:53:55,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:55,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:55,292 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:55,292 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:55,292 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:53:55,292 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:55,293 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:53:55,293 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:53:55,293 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-02-12 03:53:55,293 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-12 03:53:55,293 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:53:55,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:53:55,293 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-12 03:53:55,293 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:55,293 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:55,293 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-12 03:53:55,293 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:53:55,293 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-12 03:53:55,293 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:55,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:53:55,293 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:55,393 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-12 03:53:55,394 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-12 03:53:55,398 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-12 03:53:55,400 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-12 03:53:55,400 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:55,400 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-02-12 03:53:55,400 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:53:55,400 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-12 03:53:55,400 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-12 03:53:55,400 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:55,400 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:55,401 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:55,401 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:53:55,401 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:53:55,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:53:55,402 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:55,402 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-12 03:53:55,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:55,402 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:55,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-12 03:53:55,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:55,402 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:55,403 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-02-12 03:53:55,403 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:55,403 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-12 03:53:55,403 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:53:55,403 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-12 03:53:55,403 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-12 03:53:55,403 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-12 03:53:55,403 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1676174030338.6868bac373e3128a323294fb5686f080. 2023-02-12 03:53:55,403 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1676174030338.6868bac373e3128a323294fb5686f080. started... 2023-02-12 03:53:55,403 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 6868bac373e3128a323294fb5686f080 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-12 03:53:55,820 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205d186fb528b3d46d295abadd3ec6961cb to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151205d186fb528b3d46d295abadd3ec6961cb 2023-02-12 03:53:56,227 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyPolicy/6868bac373e3128a323294fb5686f080/.tmp/family1/6ba4dd3abd3647a4a9e91dd2d627d624 2023-02-12 03:53:56,239 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyPolicy/6868bac373e3128a323294fb5686f080/.tmp/family1/6ba4dd3abd3647a4a9e91dd2d627d624 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyPolicy/6868bac373e3128a323294fb5686f080/family1/6ba4dd3abd3647a4a9e91dd2d627d624 2023-02-12 03:53:56,246 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyPolicy/6868bac373e3128a323294fb5686f080/family1/6ba4dd3abd3647a4a9e91dd2d627d624, entries=1, sequenceid=17, filesize=4.9 K 2023-02-12 03:53:56,247 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 6868bac373e3128a323294fb5686f080 in 844ms, sequenceid=17, compaction requested=true 2023-02-12 03:53:56,247 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 6868bac373e3128a323294fb5686f080: 2023-02-12 03:53:56,247 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1676174030338.6868bac373e3128a323294fb5686f080. 2023-02-12 03:53:56,247 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-12 03:53:56,247 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-12 03:53:56,247 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:56,247 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-02-12 03:53:56,247 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-02-12 03:53:56,248 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:56,248 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:56,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:56,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:53:56,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:53:56,249 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:56,249 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 03:53:56,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:53:56,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:53:56,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:56,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:56,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:53:56,251 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-02-12 03:53:56,251 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@16db596b[Count = 0] remaining members to acquire global barrier 2023-02-12 03:53:56,251 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-12 03:53:56,251 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:56,251 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:56,251 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:56,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:56,251 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-12 03:53:56,252 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-02-12 03:53:56,252 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:56,252 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-12 03:53:56,252 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,39639,1676173982450' in zk 2023-02-12 03:53:56,252 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:56,252 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-12 03:53:56,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:56,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:53:56,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:53:56,252 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:53:56,253 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-02-12 03:53:56,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:53:56,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:53:56,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:56,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:56,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:53:56,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:56,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:56,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,39639,1676173982450': 2023-02-12 03:53:56,254 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-12 03:53:56,254 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-02-12 03:53:56,255 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-12 03:53:56,255 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-12 03:53:56,255 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:56,255 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-12 03:53:56,256 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:56,256 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:56,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:56,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:53:56,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:53:56,256 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:56,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:56,256 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:53:56,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:53:56,256 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:53:56,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:53:56,256 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:56,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:56,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:56,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:53:56,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:56,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:56,257 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:56,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:53:56,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:56,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:56,259 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:56,259 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:56,259 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:53:56,259 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:56,259 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:53:56,259 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:53:56,259 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:53:56,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:53:56,259 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:56,259 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-02-12 03:53:56,259 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-12 03:53:56,259 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:56,259 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:56,259 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:56,259 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:53:56,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:53:56,259 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-12 03:53:56,259 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-12 03:53:56,360 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-12 03:53:56,361 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-12 03:53:56,367 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-12 03:53:56,369 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-12 03:53:56,369 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:56,370 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-02-12 03:53:56,370 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:53:56,370 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-12 03:53:56,370 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-12 03:53:56,371 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:56,371 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:56,374 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:53:56,374 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:56,374 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:53:56,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:53:56,375 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:56,375 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-12 03:53:56,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:56,376 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:56,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-12 03:53:56,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:56,377 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:56,377 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-02-12 03:53:56,377 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:56,377 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-12 03:53:56,378 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:53:56,378 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-12 03:53:56,378 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-12 03:53:56,378 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-12 03:53:56,378 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1676174030338.6868bac373e3128a323294fb5686f080. 2023-02-12 03:53:56,378 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1676174030338.6868bac373e3128a323294fb5686f080. started... 2023-02-12 03:53:56,378 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 6868bac373e3128a323294fb5686f080 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-12 03:53:56,794 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512285399d565460e4a35a494fc0b54eb4d79 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512285399d565460e4a35a494fc0b54eb4d79 2023-02-12 03:53:56,997 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-12 03:53:57,034 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-12 03:53:57,034 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3c5ea81a to 127.0.0.1:59556 2023-02-12 03:53:57,034 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 03:53:57,034 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-12 03:53:57,035 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x14af4725 to 127.0.0.1:59556 2023-02-12 03:53:57,035 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 03:53:57,035 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-12 03:53:57,035 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6f077d48 to 127.0.0.1:59556 2023-02-12 03:53:57,035 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 03:53:57,203 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyPolicy/6868bac373e3128a323294fb5686f080/.tmp/family1/5030db1b8e7a4b5ebe0d21831e227e5b 2023-02-12 03:53:57,214 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyPolicy/6868bac373e3128a323294fb5686f080/.tmp/family1/5030db1b8e7a4b5ebe0d21831e227e5b as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyPolicy/6868bac373e3128a323294fb5686f080/family1/5030db1b8e7a4b5ebe0d21831e227e5b 2023-02-12 03:53:57,220 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyPolicy/6868bac373e3128a323294fb5686f080/family1/5030db1b8e7a4b5ebe0d21831e227e5b, entries=1, sequenceid=21, filesize=4.9 K 2023-02-12 03:53:57,221 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 6868bac373e3128a323294fb5686f080 in 843ms, sequenceid=21, compaction requested=true 2023-02-12 03:53:57,221 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 6868bac373e3128a323294fb5686f080: 2023-02-12 03:53:57,221 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1676174030338.6868bac373e3128a323294fb5686f080. 2023-02-12 03:53:57,221 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-12 03:53:57,221 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-12 03:53:57,221 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:57,221 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-02-12 03:53:57,221 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-02-12 03:53:57,223 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:57,223 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:57,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:57,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:53:57,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:53:57,223 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:57,223 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 03:53:57,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:53:57,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:53:57,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:57,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:57,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:53:57,226 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-02-12 03:53:57,226 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6d692a[Count = 0] remaining members to acquire global barrier 2023-02-12 03:53:57,226 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-12 03:53:57,226 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:57,227 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:57,227 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:57,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:57,227 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-12 03:53:57,227 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:57,227 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-12 03:53:57,227 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-02-12 03:53:57,227 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,39639,1676173982450' in zk 2023-02-12 03:53:57,228 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-12 03:53:57,228 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:57,228 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:53:57,228 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-02-12 03:53:57,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:57,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:53:57,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:53:57,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:53:57,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:53:57,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:57,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:57,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:53:57,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:57,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:57,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,39639,1676173982450': 2023-02-12 03:53:57,232 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-12 03:53:57,232 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-02-12 03:53:57,232 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-12 03:53:57,232 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-12 03:53:57,232 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:57,232 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-12 03:53:57,233 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:57,233 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:57,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:57,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:53:57,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:53:57,233 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:57,233 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:53:57,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:57,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:53:57,234 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:57,234 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:53:57,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:53:57,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:57,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:57,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:53:57,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:57,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:57,236 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:57,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:53:57,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:57,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:57,245 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:57,245 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:53:57,245 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:53:57,245 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:57,246 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-02-12 03:53:57,246 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-12 03:53:57,246 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:57,246 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:57,246 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:57,246 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:53:57,246 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:53:57,246 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:57,246 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-12 03:53:57,246 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:57,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:53:57,246 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-12 03:53:57,246 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:53:57,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:53:57,346 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-12 03:53:57,348 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-12 03:53:57,354 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-12 03:53:57,356 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-12 03:53:57,356 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:57,356 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-02-12 03:53:57,356 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:53:57,356 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-12 03:53:57,356 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-12 03:53:57,357 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:57,357 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:57,358 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:53:57,358 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:57,358 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:53:57,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:53:57,358 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:57,358 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-12 03:53:57,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:57,359 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:57,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-12 03:53:57,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:57,359 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:57,360 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-02-12 03:53:57,360 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:57,360 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-12 03:53:57,360 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:53:57,360 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-12 03:53:57,360 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-12 03:53:57,360 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-12 03:53:57,360 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1676174030338.6868bac373e3128a323294fb5686f080. 2023-02-12 03:53:57,360 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1676174030338.6868bac373e3128a323294fb5686f080. started... 2023-02-12 03:53:57,360 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 6868bac373e3128a323294fb5686f080 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-12 03:53:57,777 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231c62db91c83e1462bbc1f48cb3d983e30 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151231c62db91c83e1462bbc1f48cb3d983e30 2023-02-12 03:53:58,185 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyPolicy/6868bac373e3128a323294fb5686f080/.tmp/family1/47fa6dc4dbac4d2e9a4532b3af6acb9a 2023-02-12 03:53:58,190 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyPolicy/6868bac373e3128a323294fb5686f080/.tmp/family1/47fa6dc4dbac4d2e9a4532b3af6acb9a as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyPolicy/6868bac373e3128a323294fb5686f080/family1/47fa6dc4dbac4d2e9a4532b3af6acb9a 2023-02-12 03:53:58,195 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyPolicy/6868bac373e3128a323294fb5686f080/family1/47fa6dc4dbac4d2e9a4532b3af6acb9a, entries=1, sequenceid=25, filesize=4.9 K 2023-02-12 03:53:58,196 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 6868bac373e3128a323294fb5686f080 in 836ms, sequenceid=25, compaction requested=true 2023-02-12 03:53:58,197 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 6868bac373e3128a323294fb5686f080: 2023-02-12 03:53:58,197 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1676174030338.6868bac373e3128a323294fb5686f080. 2023-02-12 03:53:58,197 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-12 03:53:58,197 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-12 03:53:58,197 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:58,197 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-02-12 03:53:58,197 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-02-12 03:53:58,199 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:58,199 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:58,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:58,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:53:58,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:53:58,199 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:58,199 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 03:53:58,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:53:58,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:53:58,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:58,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:58,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:53:58,201 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-02-12 03:53:58,201 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@141b7cb6[Count = 0] remaining members to acquire global barrier 2023-02-12 03:53:58,201 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-12 03:53:58,201 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:58,201 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:58,202 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:58,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:58,202 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-12 03:53:58,202 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-02-12 03:53:58,202 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,39639,1676173982450' in zk 2023-02-12 03:53:58,202 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:58,202 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-12 03:53:58,203 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-12 03:53:58,203 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:53:58,203 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-02-12 03:53:58,203 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:58,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:58,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:53:58,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:53:58,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:53:58,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:53:58,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:58,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:58,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:53:58,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:58,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:58,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,39639,1676173982450': 2023-02-12 03:53:58,206 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-12 03:53:58,206 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-02-12 03:53:58,206 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-12 03:53:58,206 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-12 03:53:58,206 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:58,206 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-12 03:53:58,207 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:58,207 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:58,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:58,208 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:58,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:53:58,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:53:58,208 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:53:58,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:58,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:53:58,208 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:53:58,208 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:58,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:53:58,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:58,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:58,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:53:58,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:58,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:58,210 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:58,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:53:58,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:58,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:58,212 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:58,212 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:58,212 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:53:58,212 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:58,212 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:53:58,212 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-02-12 03:53:58,212 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-12 03:53:58,212 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:53:58,212 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:58,212 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:53:58,212 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:58,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:53:58,212 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-12 03:53:58,212 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:58,213 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-12 03:53:58,213 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:58,213 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:53:58,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:53:58,313 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-12 03:53:58,314 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-12 03:53:58,323 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-12 03:53:58,326 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-12 03:53:58,326 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:58,326 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-02-12 03:53:58,326 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:53:58,327 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-12 03:53:58,327 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-12 03:53:58,327 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:58,327 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:58,328 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:58,328 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:53:58,328 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:53:58,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:53:58,329 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:58,329 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-12 03:53:58,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:58,329 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:58,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-12 03:53:58,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:58,330 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:58,330 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-02-12 03:53:58,330 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:58,330 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-12 03:53:58,330 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:53:58,330 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-12 03:53:58,331 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-12 03:53:58,331 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-12 03:53:58,331 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1676174030338.6868bac373e3128a323294fb5686f080. 2023-02-12 03:53:58,331 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1676174030338.6868bac373e3128a323294fb5686f080. started... 2023-02-12 03:53:58,331 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 6868bac373e3128a323294fb5686f080 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-12 03:53:58,750 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010160c66052fe2b4772bee7d896fa884f99 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2016010160c66052fe2b4772bee7d896fa884f99 2023-02-12 03:53:59,158 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyPolicy/6868bac373e3128a323294fb5686f080/.tmp/family1/bb9d2637d81142e4829dae3424e154b6 2023-02-12 03:53:59,165 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyPolicy/6868bac373e3128a323294fb5686f080/.tmp/family1/bb9d2637d81142e4829dae3424e154b6 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyPolicy/6868bac373e3128a323294fb5686f080/family1/bb9d2637d81142e4829dae3424e154b6 2023-02-12 03:53:59,170 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyPolicy/6868bac373e3128a323294fb5686f080/family1/bb9d2637d81142e4829dae3424e154b6, entries=1, sequenceid=29, filesize=4.9 K 2023-02-12 03:53:59,171 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 6868bac373e3128a323294fb5686f080 in 840ms, sequenceid=29, compaction requested=true 2023-02-12 03:53:59,171 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 6868bac373e3128a323294fb5686f080: 2023-02-12 03:53:59,171 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1676174030338.6868bac373e3128a323294fb5686f080. 2023-02-12 03:53:59,171 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-12 03:53:59,171 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-12 03:53:59,171 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:59,171 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-02-12 03:53:59,171 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-02-12 03:53:59,173 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:59,173 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:59,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:59,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:53:59,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:53:59,173 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:59,173 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 03:53:59,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:53:59,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:53:59,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:59,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:59,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:53:59,175 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-02-12 03:53:59,175 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@39552fa3[Count = 0] remaining members to acquire global barrier 2023-02-12 03:53:59,175 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-12 03:53:59,175 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:59,176 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:59,176 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:59,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:59,176 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-12 03:53:59,176 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-02-12 03:53:59,176 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,39639,1676173982450' in zk 2023-02-12 03:53:59,176 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:59,176 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-12 03:53:59,177 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-12 03:53:59,177 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:59,177 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:53:59,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:59,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:53:59,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:53:59,177 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-02-12 03:53:59,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:53:59,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:53:59,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:59,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:59,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:53:59,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:59,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:59,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,39639,1676173982450': 2023-02-12 03:53:59,180 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-12 03:53:59,180 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-02-12 03:53:59,180 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-12 03:53:59,180 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-12 03:53:59,180 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:59,180 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-12 03:53:59,181 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:59,181 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:59,181 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:59,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:59,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:53:59,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:53:59,181 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:53:59,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:59,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:53:59,182 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:53:59,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:53:59,182 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:59,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:59,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:59,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:53:59,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:59,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:59,183 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:59,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:53:59,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:59,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:59,185 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:59,185 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:53:59,185 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:59,185 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-02-12 03:53:59,185 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-12 03:53:59,185 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-12 03:53:59,185 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:59,185 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:53:59,185 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:53:59,185 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:53:59,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:53:59,186 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:59,186 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:59,186 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-12 03:53:59,186 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-12 03:53:59,186 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:59,186 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:53:59,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:53:59,186 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:59,286 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-12 03:53:59,287 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-12 03:53:59,292 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-12 03:53:59,294 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-12 03:53:59,294 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:59,294 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-02-12 03:53:59,294 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:53:59,294 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-12 03:53:59,294 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-12 03:53:59,295 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:59,295 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:59,296 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:53:59,296 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:59,296 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:53:59,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:53:59,297 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:53:59,297 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-12 03:53:59,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:59,298 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:59,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-12 03:53:59,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:59,298 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:59,298 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-02-12 03:53:59,299 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-02-12 03:53:59,299 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-12 03:53:59,299 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:53:59,299 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-12 03:53:59,299 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-12 03:53:59,299 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-12 03:53:59,299 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1676174030338.6868bac373e3128a323294fb5686f080. 2023-02-12 03:53:59,299 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1676174030338.6868bac373e3128a323294fb5686f080. started... 2023-02-12 03:53:59,299 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 6868bac373e3128a323294fb5686f080 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-12 03:53:59,718 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601033d476d4fe3494a59bb4a707e45601a6a to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201601033d476d4fe3494a59bb4a707e45601a6a 2023-02-12 03:54:00,129 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyPolicy/6868bac373e3128a323294fb5686f080/.tmp/family1/6606f48266a44fa39ca128bb10a6cfa3 2023-02-12 03:54:00,138 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyPolicy/6868bac373e3128a323294fb5686f080/.tmp/family1/6606f48266a44fa39ca128bb10a6cfa3 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyPolicy/6868bac373e3128a323294fb5686f080/family1/6606f48266a44fa39ca128bb10a6cfa3 2023-02-12 03:54:00,143 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyPolicy/6868bac373e3128a323294fb5686f080/family1/6606f48266a44fa39ca128bb10a6cfa3, entries=1, sequenceid=33, filesize=4.9 K 2023-02-12 03:54:00,144 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 6868bac373e3128a323294fb5686f080 in 845ms, sequenceid=33, compaction requested=true 2023-02-12 03:54:00,144 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 6868bac373e3128a323294fb5686f080: 2023-02-12 03:54:00,144 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1676174030338.6868bac373e3128a323294fb5686f080. 2023-02-12 03:54:00,144 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-12 03:54:00,144 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-12 03:54:00,144 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:00,144 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-02-12 03:54:00,144 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-02-12 03:54:00,145 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:00,146 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:54:00,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:00,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:54:00,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:54:00,146 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:54:00,146 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 03:54:00,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:54:00,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:54:00,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-12 03:54:00,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:00,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:54:00,147 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-02-12 03:54:00,147 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-12 03:54:00,147 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:54:00,147 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@750929e3[Count = 0] remaining members to acquire global barrier 2023-02-12 03:54:00,148 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:54:00,148 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:54:00,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:54:00,148 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-12 03:54:00,148 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-02-12 03:54:00,148 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,39639,1676173982450' in zk 2023-02-12 03:54:00,148 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:00,148 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-12 03:54:00,149 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-12 03:54:00,149 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:00,149 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:54:00,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:00,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:54:00,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:54:00,149 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-02-12 03:54:00,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:54:00,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:54:00,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-12 03:54:00,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:00,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:54:00,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-12 03:54:00,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:00,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,39639,1676173982450': 2023-02-12 03:54:00,151 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-12 03:54:00,151 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-02-12 03:54:00,151 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-12 03:54:00,151 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-12 03:54:00,151 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-02-12 03:54:00,151 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-12 03:54:00,152 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:54:00,152 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:54:00,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:54:00,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:54:00,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:54:00,152 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:54:00,152 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:54:00,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:54:00,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:54:00,153 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:00,153 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:54:00,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:54:00,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-12 03:54:00,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:54:00,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:54:00,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-12 03:54:00,154 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:00,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:00,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:54:00,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-12 03:54:00,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:00,155 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:00,156 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:54:00,156 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:54:00,156 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:54:00,156 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:54:00,156 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:54:00,156 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:54:00,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:54:00,156 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-02-12 03:54:00,156 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-12 03:54:00,156 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-12 03:54:00,156 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:00,156 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:54:00,156 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:54:00,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:54:00,156 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-12 03:54:00,156 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:54:00,156 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-12 03:54:00,156 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:54:00,257 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-12 03:54:00,258 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-12 03:54:00,266 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-12 03:54:00,268 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-12 03:54:00,268 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-02-12 03:54:00,268 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-02-12 03:54:00,268 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:54:00,268 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-12 03:54:00,268 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-12 03:54:00,269 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:54:00,269 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:54:00,270 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:54:00,270 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:00,270 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:54:00,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:54:00,270 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:00,270 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-12 03:54:00,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:54:00,271 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:54:00,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-12 03:54:00,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:54:00,271 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-02-12 03:54:00,272 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-02-12 03:54:00,272 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-02-12 03:54:00,272 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-12 03:54:00,272 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:54:00,272 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-12 03:54:00,272 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-12 03:54:00,272 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-12 03:54:00,272 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1676174030338.6868bac373e3128a323294fb5686f080. 2023-02-12 03:54:00,272 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1676174030338.6868bac373e3128a323294fb5686f080. started... 2023-02-12 03:54:00,272 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 6868bac373e3128a323294fb5686f080 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-12 03:54:00,687 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015090757b6402566804af5a27ddfa53f2d668c to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015090757b6402566804af5a27ddfa53f2d668c 2023-02-12 03:54:01,093 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyPolicy/6868bac373e3128a323294fb5686f080/.tmp/family1/cb2e3aed961b497aaf9e4b210d302968 2023-02-12 03:54:01,103 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyPolicy/6868bac373e3128a323294fb5686f080/.tmp/family1/cb2e3aed961b497aaf9e4b210d302968 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyPolicy/6868bac373e3128a323294fb5686f080/family1/cb2e3aed961b497aaf9e4b210d302968 2023-02-12 03:54:01,107 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyPolicy/6868bac373e3128a323294fb5686f080/family1/cb2e3aed961b497aaf9e4b210d302968, entries=1, sequenceid=37, filesize=4.9 K 2023-02-12 03:54:01,108 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 6868bac373e3128a323294fb5686f080 in 836ms, sequenceid=37, compaction requested=true 2023-02-12 03:54:01,108 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 6868bac373e3128a323294fb5686f080: 2023-02-12 03:54:01,108 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1676174030338.6868bac373e3128a323294fb5686f080. 2023-02-12 03:54:01,108 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-12 03:54:01,109 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-12 03:54:01,109 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:01,109 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-02-12 03:54:01,109 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-02-12 03:54:01,110 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:01,110 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:54:01,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:01,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:54:01,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:54:01,110 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:54:01,110 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 03:54:01,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:54:01,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:54:01,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-12 03:54:01,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:01,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:54:01,111 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-02-12 03:54:01,112 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1e462a51[Count = 0] remaining members to acquire global barrier 2023-02-12 03:54:01,112 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-12 03:54:01,112 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:54:01,112 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:54:01,112 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:54:01,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:54:01,112 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-12 03:54:01,112 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-02-12 03:54:01,113 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,39639,1676173982450' in zk 2023-02-12 03:54:01,113 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:01,113 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-12 03:54:01,113 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-12 03:54:01,113 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:54:01,113 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:01,113 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-02-12 03:54:01,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:01,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:54:01,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:54:01,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:54:01,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:54:01,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-12 03:54:01,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:01,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:54:01,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-12 03:54:01,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:01,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,39639,1676173982450': 2023-02-12 03:54:01,115 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-12 03:54:01,115 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-02-12 03:54:01,115 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-12 03:54:01,115 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-12 03:54:01,115 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-02-12 03:54:01,115 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-12 03:54:01,116 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:54:01,116 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:54:01,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:54:01,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:54:01,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:54:01,116 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:54:01,116 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:54:01,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:54:01,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:54:01,117 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:54:01,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:54:01,117 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:01,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-12 03:54:01,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:54:01,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:54:01,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-12 03:54:01,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:01,118 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:01,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:54:01,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-12 03:54:01,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:01,119 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:01,119 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:54:01,119 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:54:01,119 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:54:01,119 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:54:01,119 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-02-12 03:54:01,119 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-12 03:54:01,119 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:01,119 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:54:01,119 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:54:01,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:54:01,119 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:54:01,119 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:54:01,119 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:54:01,119 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:54:01,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:54:01,120 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-12 03:54:01,120 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-12 03:54:01,220 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-12 03:54:01,221 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-12 03:54:01,224 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-12 03:54:01,225 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-12 03:54:01,225 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-02-12 03:54:01,225 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-02-12 03:54:01,225 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:54:01,225 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-12 03:54:01,226 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-12 03:54:01,226 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:54:01,226 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:54:01,227 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:54:01,227 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:01,227 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:54:01,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:54:01,227 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:01,227 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-12 03:54:01,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:54:01,227 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:54:01,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-12 03:54:01,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:54:01,228 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-02-12 03:54:01,228 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-02-12 03:54:01,228 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-02-12 03:54:01,228 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-12 03:54:01,228 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:54:01,228 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-12 03:54:01,228 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-12 03:54:01,228 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-12 03:54:01,228 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1676174030338.6868bac373e3128a323294fb5686f080. 2023-02-12 03:54:01,228 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1676174030338.6868bac373e3128a323294fb5686f080. started... 2023-02-12 03:54:01,228 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 6868bac373e3128a323294fb5686f080 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-12 03:54:01,648 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112043063aa23c934791b9cea33e2086b542 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015112043063aa23c934791b9cea33e2086b542 2023-02-12 03:54:02,055 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyPolicy/6868bac373e3128a323294fb5686f080/.tmp/family1/9a7af808ccb44902a73d55acfdd2bad3 2023-02-12 03:54:02,059 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyPolicy/6868bac373e3128a323294fb5686f080/.tmp/family1/9a7af808ccb44902a73d55acfdd2bad3 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyPolicy/6868bac373e3128a323294fb5686f080/family1/9a7af808ccb44902a73d55acfdd2bad3 2023-02-12 03:54:02,065 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyPolicy/6868bac373e3128a323294fb5686f080/family1/9a7af808ccb44902a73d55acfdd2bad3, entries=1, sequenceid=41, filesize=4.9 K 2023-02-12 03:54:02,066 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 6868bac373e3128a323294fb5686f080 in 838ms, sequenceid=41, compaction requested=true 2023-02-12 03:54:02,067 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 6868bac373e3128a323294fb5686f080: 2023-02-12 03:54:02,067 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1676174030338.6868bac373e3128a323294fb5686f080. 2023-02-12 03:54:02,067 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-12 03:54:02,067 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-12 03:54:02,067 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:02,067 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-02-12 03:54:02,067 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-02-12 03:54:02,068 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:54:02,068 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:02,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:02,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:54:02,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:54:02,069 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:54:02,069 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 03:54:02,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:54:02,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:54:02,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-12 03:54:02,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:02,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:54:02,070 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-02-12 03:54:02,070 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@51f70be3[Count = 0] remaining members to acquire global barrier 2023-02-12 03:54:02,070 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-12 03:54:02,070 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:54:02,071 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:54:02,071 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:54:02,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:54:02,071 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-12 03:54:02,071 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-02-12 03:54:02,071 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,39639,1676173982450' in zk 2023-02-12 03:54:02,071 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:02,071 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-12 03:54:02,072 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-12 03:54:02,072 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:02,072 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:54:02,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:02,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:54:02,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:54:02,072 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-02-12 03:54:02,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:54:02,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:54:02,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-12 03:54:02,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:02,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:54:02,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-12 03:54:02,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:02,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,39639,1676173982450': 2023-02-12 03:54:02,075 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-12 03:54:02,075 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-02-12 03:54:02,075 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-12 03:54:02,075 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-12 03:54:02,075 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-02-12 03:54:02,075 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-12 03:54:02,076 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:54:02,076 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:54:02,076 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:54:02,076 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:54:02,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:54:02,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:54:02,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:54:02,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:54:02,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:54:02,077 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:54:02,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:54:02,077 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:02,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-12 03:54:02,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:54:02,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:54:02,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-12 03:54:02,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:02,078 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:02,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:54:02,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-12 03:54:02,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:02,081 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:02,081 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:54:02,081 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:54:02,081 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:54:02,081 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-02-12 03:54:02,081 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-12 03:54:02,081 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:54:02,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:54:02,081 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:54:02,081 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:02,081 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:54:02,081 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-12 03:54:02,081 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-12 03:54:02,081 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:54:02,081 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:54:02,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:54:02,081 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:54:02,081 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-12 03:54:02,181 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-12 03:54:02,182 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-12 03:54:02,184 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=40099] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyPolicy 2023-02-12 03:54:02,186 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676173985818] procedure2.ProcedureExecutor(1029): Stored pid=38, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-02-12 03:54:02,187 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=38, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-02-12 03:54:02,188 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=38, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1676174642188 2023-02-12 03:54:02,188 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676173985818] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-12 03:54:02,189 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676173985818] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-12 03:54:02,191 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676173985818] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyPolicy' and column 'family1' 2023-02-12 03:54:02,191 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676173985818] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-02-12 03:54:02,191 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676173985818] zookeeper.ReadOnlyZKClient(139): Connect 0x6329451c to 127.0.0.1:59556 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 03:54:02,196 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676173985818] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@374fa8c7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 03:54:02,197 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-02-12 03:54:03,042 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103e279f2970a874671ac3861fc2845706e to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160103e279f2970a874671ac3861fc2845706e 2023-02-12 03:54:03,043 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-02-12 03:54:03,058 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-12 03:54:03,059 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:39664, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-12 03:54:03,066 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-12 03:54:03,067 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:42796, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-12 03:54:03,075 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/c5e635428f7f42c18f1cafd2c2aa2d71 first=Optional[r3] last=Optional[r6] 2023-02-12 03:54:03,076 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyPolicy,,1676174030338.6868bac373e3128a323294fb5686f080., hostname=jenkins-hbase20.apache.org,39639,1676173982450, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/c5e635428f7f42c18f1cafd2c2aa2d71}] 2023-02-12 03:54:03,079 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/c5e635428f7f42c18f1cafd2c2aa2d71 for inclusion in 6868bac373e3128a323294fb5686f080/family1 2023-02-12 03:54:03,082 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-02-12 03:54:03,082 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HStore(777): Region bounds: first= last= 2023-02-12 03:54:03,082 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HRegion(2445): Flush status journal for 6868bac373e3128a323294fb5686f080: 2023-02-12 03:54:03,083 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/c5e635428f7f42c18f1cafd2c2aa2d71 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/staging/jenkins__testMajorCompactionWithWeeklyPolicy__d1cg1d0eoerjmd2e0hbrdvhflgs4m13kmvglgpn755c5aip7uaser9url2nkfmmi/family1/c5e635428f7f42c18f1cafd2c2aa2d71 2023-02-12 03:54:03,085 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/staging/jenkins__testMajorCompactionWithWeeklyPolicy__d1cg1d0eoerjmd2e0hbrdvhflgs4m13kmvglgpn755c5aip7uaser9url2nkfmmi/family1/c5e635428f7f42c18f1cafd2c2aa2d71 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyPolicy/6868bac373e3128a323294fb5686f080/family1/8481df8a6c9e4190a770765f9bbe25e3_SeqId_44_ 2023-02-12 03:54:03,086 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/staging/jenkins__testMajorCompactionWithWeeklyPolicy__d1cg1d0eoerjmd2e0hbrdvhflgs4m13kmvglgpn755c5aip7uaser9url2nkfmmi/family1/c5e635428f7f42c18f1cafd2c2aa2d71 into 6868bac373e3128a323294fb5686f080/family1 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyPolicy/6868bac373e3128a323294fb5686f080/family1/8481df8a6c9e4190a770765f9bbe25e3_SeqId_44_ - updating store file list. 2023-02-12 03:54:03,090 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyPolicy/6868bac373e3128a323294fb5686f080/family1/8481df8a6c9e4190a770765f9bbe25e3_SeqId_44_ into 6868bac373e3128a323294fb5686f080/family1 2023-02-12 03:54:03,090 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/staging/jenkins__testMajorCompactionWithWeeklyPolicy__d1cg1d0eoerjmd2e0hbrdvhflgs4m13kmvglgpn755c5aip7uaser9url2nkfmmi/family1/c5e635428f7f42c18f1cafd2c2aa2d71 into 6868bac373e3128a323294fb5686f080/family1 (new location: hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyPolicy/6868bac373e3128a323294fb5686f080/family1/8481df8a6c9e4190a770765f9bbe25e3_SeqId_44_) 2023-02-12 03:54:03,091 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/staging/jenkins__testMajorCompactionWithWeeklyPolicy__d1cg1d0eoerjmd2e0hbrdvhflgs4m13kmvglgpn755c5aip7uaser9url2nkfmmi/family1/c5e635428f7f42c18f1cafd2c2aa2d71 2023-02-12 03:54:03,091 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-02-12 03:54:03,094 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51214 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-02-12 03:54:03,094 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HStore(1912): 6868bac373e3128a323294fb5686f080/family1 is initiating minor compaction 2023-02-12 03:54:03,094 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@513f7ed4; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-12 03:54:03,094 INFO [RS:0;jenkins-hbase20:39639-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 6868bac373e3128a323294fb5686f080/family1 in testMajorCompactionWithWeeklyPolicy,,1676174030338.6868bac373e3128a323294fb5686f080. 2023-02-12 03:54:03,094 INFO [RS:0;jenkins-hbase20:39639-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyPolicy/6868bac373e3128a323294fb5686f080/family1/0eddbd0473ca47f9994fd1c008b9995d, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyPolicy/6868bac373e3128a323294fb5686f080/family1/fcdad7d7aab5419a93bb13d1f6429124, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyPolicy/6868bac373e3128a323294fb5686f080/family1/6ba4dd3abd3647a4a9e91dd2d627d624, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyPolicy/6868bac373e3128a323294fb5686f080/family1/5030db1b8e7a4b5ebe0d21831e227e5b, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyPolicy/6868bac373e3128a323294fb5686f080/family1/47fa6dc4dbac4d2e9a4532b3af6acb9a, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyPolicy/6868bac373e3128a323294fb5686f080/family1/bb9d2637d81142e4829dae3424e154b6, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyPolicy/6868bac373e3128a323294fb5686f080/family1/6606f48266a44fa39ca128bb10a6cfa3, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyPolicy/6868bac373e3128a323294fb5686f080/family1/cb2e3aed961b497aaf9e4b210d302968, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyPolicy/6868bac373e3128a323294fb5686f080/family1/9a7af808ccb44902a73d55acfdd2bad3, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyPolicy/6868bac373e3128a323294fb5686f080/family1/8481df8a6c9e4190a770765f9bbe25e3_SeqId_44_] into tmpdir=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyPolicy/6868bac373e3128a323294fb5686f080/.tmp, totalSize=50.0 K 2023-02-12 03:54:03,094 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] compactions.Compactor(207): Compacting 0eddbd0473ca47f9994fd1c008b9995d, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-02-12 03:54:03,094 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] compactions.Compactor(207): Compacting fcdad7d7aab5419a93bb13d1f6429124, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-02-12 03:54:03,094 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] compactions.Compactor(207): Compacting 6ba4dd3abd3647a4a9e91dd2d627d624, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-02-12 03:54:03,094 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] compactions.Compactor(207): Compacting 5030db1b8e7a4b5ebe0d21831e227e5b, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-02-12 03:54:03,094 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] compactions.Compactor(207): Compacting 47fa6dc4dbac4d2e9a4532b3af6acb9a, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-02-12 03:54:03,094 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] compactions.Compactor(207): Compacting bb9d2637d81142e4829dae3424e154b6, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-02-12 03:54:03,095 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] compactions.Compactor(207): Compacting 6606f48266a44fa39ca128bb10a6cfa3, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-02-12 03:54:03,095 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] compactions.Compactor(207): Compacting cb2e3aed961b497aaf9e4b210d302968, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-02-12 03:54:03,095 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] compactions.Compactor(207): Compacting 9a7af808ccb44902a73d55acfdd2bad3, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-02-12 03:54:03,095 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] compactions.Compactor(207): Compacting 8481df8a6c9e4190a770765f9bbe25e3_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-02-12 03:54:03,096 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-02-12 03:54:03,097 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-12 03:54:03,098 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512285399d565460e4a35a494fc0b54eb4d79 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512285399d565460e4a35a494fc0b54eb4d79 2023-02-12 03:54:03,099 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151231c62db91c83e1462bbc1f48cb3d983e30 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151231c62db91c83e1462bbc1f48cb3d983e30 2023-02-12 03:54:03,101 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2016010160c66052fe2b4772bee7d896fa884f99 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2016010160c66052fe2b4772bee7d896fa884f99 2023-02-12 03:54:03,102 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201601033d476d4fe3494a59bb4a707e45601a6a to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201601033d476d4fe3494a59bb4a707e45601a6a 2023-02-12 03:54:03,102 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyPolicy 4 expired mob files are deleted 2023-02-12 03:54:03,102 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-02-12 03:54:03,103 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-02-12 03:54:03,103 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-02-12 03:54:03,103 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-02-12 03:54:03,103 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-02-12 03:54:03,103 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-02-12 03:54:03,103 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-02-12 03:54:03,103 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-02-12 03:54:03,103 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-02-12 03:54:03,126 INFO [RS:0;jenkins-hbase20:39639-shortCompactions-0] throttle.PressureAwareThroughputController(145): 6868bac373e3128a323294fb5686f080#family1#compaction#49 average throughput is 1.36 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-12 03:54:03,955 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyPolicy/6868bac373e3128a323294fb5686f080/.tmp/family1/8ce2bb7f04474eaabe417a0b9bf496dc as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyPolicy/6868bac373e3128a323294fb5686f080/family1/8ce2bb7f04474eaabe417a0b9bf496dc 2023-02-12 03:54:03,963 INFO [RS:0;jenkins-hbase20:39639-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 6868bac373e3128a323294fb5686f080/family1 of 6868bac373e3128a323294fb5686f080 into 8ce2bb7f04474eaabe417a0b9bf496dc(size=6.6 K), total size for store is 171.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-12 03:54:03,963 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 6868bac373e3128a323294fb5686f080: 2023-02-12 03:54:03,964 INFO [RS:0;jenkins-hbase20:39639-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyPolicy,,1676174030338.6868bac373e3128a323294fb5686f080., storeName=family1, fileCount=10, fileSize=50.0 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.5 K), priority=2, time=1676174043094; duration=0sec 2023-02-12 03:54:03,964 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-12 03:54:03,965 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120596be26b60a934db6906f835dc45dcd34 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015120596be26b60a934db6906f835dc45dcd34 2023-02-12 03:54:03,966 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-02-12 03:54:03,989 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/e74c90d8e5f54017888ea46770c63df2 first=Optional[r00] last=Optional[r2] 2023-02-12 03:54:03,990 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyPolicy,,1676174030338.6868bac373e3128a323294fb5686f080., hostname=jenkins-hbase20.apache.org,39639,1676173982450, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/e74c90d8e5f54017888ea46770c63df2}] 2023-02-12 03:54:03,992 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/e74c90d8e5f54017888ea46770c63df2 for inclusion in 6868bac373e3128a323294fb5686f080/family1 2023-02-12 03:54:03,994 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-02-12 03:54:03,994 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HStore(777): Region bounds: first= last= 2023-02-12 03:54:03,994 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HRegion(2445): Flush status journal for 6868bac373e3128a323294fb5686f080: 2023-02-12 03:54:03,995 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/e74c90d8e5f54017888ea46770c63df2 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/staging/jenkins__testMajorCompactionWithWeeklyPolicy__srb9e3ph1iqqd5vobg1flajmg3ppeuvs8sts3t0es8hrpu6i9q5v0trdfdrul9n2/family1/e74c90d8e5f54017888ea46770c63df2 2023-02-12 03:54:03,997 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/staging/jenkins__testMajorCompactionWithWeeklyPolicy__srb9e3ph1iqqd5vobg1flajmg3ppeuvs8sts3t0es8hrpu6i9q5v0trdfdrul9n2/family1/e74c90d8e5f54017888ea46770c63df2 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyPolicy/6868bac373e3128a323294fb5686f080/family1/1ee99153017b441294735a7014aded24_SeqId_47_ 2023-02-12 03:54:03,997 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/staging/jenkins__testMajorCompactionWithWeeklyPolicy__srb9e3ph1iqqd5vobg1flajmg3ppeuvs8sts3t0es8hrpu6i9q5v0trdfdrul9n2/family1/e74c90d8e5f54017888ea46770c63df2 into 6868bac373e3128a323294fb5686f080/family1 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyPolicy/6868bac373e3128a323294fb5686f080/family1/1ee99153017b441294735a7014aded24_SeqId_47_ - updating store file list. 2023-02-12 03:54:04,000 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyPolicy/6868bac373e3128a323294fb5686f080/family1/1ee99153017b441294735a7014aded24_SeqId_47_ into 6868bac373e3128a323294fb5686f080/family1 2023-02-12 03:54:04,000 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/staging/jenkins__testMajorCompactionWithWeeklyPolicy__srb9e3ph1iqqd5vobg1flajmg3ppeuvs8sts3t0es8hrpu6i9q5v0trdfdrul9n2/family1/e74c90d8e5f54017888ea46770c63df2 into 6868bac373e3128a323294fb5686f080/family1 (new location: hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyPolicy/6868bac373e3128a323294fb5686f080/family1/1ee99153017b441294735a7014aded24_SeqId_47_) 2023-02-12 03:54:04,001 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/staging/jenkins__testMajorCompactionWithWeeklyPolicy__srb9e3ph1iqqd5vobg1flajmg3ppeuvs8sts3t0es8hrpu6i9q5v0trdfdrul9n2/family1/e74c90d8e5f54017888ea46770c63df2 2023-02-12 03:54:04,001 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-02-12 03:54:04,001 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 345120 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-02-12 03:54:04,002 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HStore(1912): 6868bac373e3128a323294fb5686f080/family1 is initiating minor compaction (all files) 2023-02-12 03:54:04,002 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@62b07e6e; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-12 03:54:04,002 INFO [RS:0;jenkins-hbase20:39639-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 6868bac373e3128a323294fb5686f080/family1 in testMajorCompactionWithWeeklyPolicy,,1676174030338.6868bac373e3128a323294fb5686f080. 2023-02-12 03:54:04,002 INFO [RS:0;jenkins-hbase20:39639-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyPolicy/6868bac373e3128a323294fb5686f080/family1/997fa36bced54aad88a65ff095582cb1, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyPolicy/6868bac373e3128a323294fb5686f080/family1/8ce2bb7f04474eaabe417a0b9bf496dc, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyPolicy/6868bac373e3128a323294fb5686f080/family1/1ee99153017b441294735a7014aded24_SeqId_47_] into tmpdir=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyPolicy/6868bac373e3128a323294fb5686f080/.tmp, totalSize=337.0 K 2023-02-12 03:54:04,002 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] compactions.Compactor(207): Compacting 997fa36bced54aad88a65ff095582cb1, keycount=1000, bloomtype=ROW, size=165.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878805947 2023-02-12 03:54:04,002 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] compactions.Compactor(207): Compacting 8ce2bb7f04474eaabe417a0b9bf496dc, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621205947 2023-02-12 03:54:04,003 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] compactions.Compactor(207): Compacting 1ee99153017b441294735a7014aded24_SeqId_47_, keycount=1002, bloomtype=ROW, size=165.4 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878805947 2023-02-12 03:54:04,003 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-02-12 03:54:04,004 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-12 03:54:04,005 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151130221c425e4dc946e386a44d8845f6e86f to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151130221c425e4dc946e386a44d8845f6e86f 2023-02-12 03:54:04,006 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512015a0e49d01a8843f8b8e248a5d7a42435 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512015a0e49d01a8843f8b8e248a5d7a42435 2023-02-12 03:54:04,007 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151205d186fb528b3d46d295abadd3ec6961cb to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151205d186fb528b3d46d295abadd3ec6961cb 2023-02-12 03:54:04,007 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyPolicy 3 expired mob files are deleted 2023-02-12 03:54:04,007 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-02-12 03:54:04,008 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-02-12 03:54:04,008 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676173985818] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-02-12 03:54:04,008 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676173985818] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-12 03:54:04,009 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=38, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-02-12 03:54:04,011 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=38, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE in 1.8240 sec 2023-02-12 03:54:04,019 INFO [RS:0;jenkins-hbase20:39639-shortCompactions-0] throttle.PressureAwareThroughputController(145): 6868bac373e3128a323294fb5686f080#family1#compaction#50 average throughput is 19.33 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 80.77 MB/second 2023-02-12 03:54:04,061 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyPolicy/6868bac373e3128a323294fb5686f080/family1/0eddbd0473ca47f9994fd1c008b9995d, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyPolicy/6868bac373e3128a323294fb5686f080/family1/fcdad7d7aab5419a93bb13d1f6429124, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyPolicy/6868bac373e3128a323294fb5686f080/family1/6ba4dd3abd3647a4a9e91dd2d627d624, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyPolicy/6868bac373e3128a323294fb5686f080/family1/5030db1b8e7a4b5ebe0d21831e227e5b, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyPolicy/6868bac373e3128a323294fb5686f080/family1/47fa6dc4dbac4d2e9a4532b3af6acb9a, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyPolicy/6868bac373e3128a323294fb5686f080/family1/bb9d2637d81142e4829dae3424e154b6, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyPolicy/6868bac373e3128a323294fb5686f080/family1/6606f48266a44fa39ca128bb10a6cfa3, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyPolicy/6868bac373e3128a323294fb5686f080/family1/cb2e3aed961b497aaf9e4b210d302968, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyPolicy/6868bac373e3128a323294fb5686f080/family1/9a7af808ccb44902a73d55acfdd2bad3, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyPolicy/6868bac373e3128a323294fb5686f080/family1/8481df8a6c9e4190a770765f9bbe25e3_SeqId_44_] to archive 2023-02-12 03:54:04,062 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-12 03:54:04,064 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyPolicy/6868bac373e3128a323294fb5686f080/family1/0eddbd0473ca47f9994fd1c008b9995d to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMajorCompactionWithWeeklyPolicy/6868bac373e3128a323294fb5686f080/family1/0eddbd0473ca47f9994fd1c008b9995d 2023-02-12 03:54:04,065 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyPolicy/6868bac373e3128a323294fb5686f080/family1/fcdad7d7aab5419a93bb13d1f6429124 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMajorCompactionWithWeeklyPolicy/6868bac373e3128a323294fb5686f080/family1/fcdad7d7aab5419a93bb13d1f6429124 2023-02-12 03:54:04,067 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyPolicy/6868bac373e3128a323294fb5686f080/family1/6ba4dd3abd3647a4a9e91dd2d627d624 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMajorCompactionWithWeeklyPolicy/6868bac373e3128a323294fb5686f080/family1/6ba4dd3abd3647a4a9e91dd2d627d624 2023-02-12 03:54:04,068 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyPolicy/6868bac373e3128a323294fb5686f080/family1/5030db1b8e7a4b5ebe0d21831e227e5b to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMajorCompactionWithWeeklyPolicy/6868bac373e3128a323294fb5686f080/family1/5030db1b8e7a4b5ebe0d21831e227e5b 2023-02-12 03:54:04,069 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyPolicy/6868bac373e3128a323294fb5686f080/family1/47fa6dc4dbac4d2e9a4532b3af6acb9a to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMajorCompactionWithWeeklyPolicy/6868bac373e3128a323294fb5686f080/family1/47fa6dc4dbac4d2e9a4532b3af6acb9a 2023-02-12 03:54:04,070 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyPolicy/6868bac373e3128a323294fb5686f080/family1/bb9d2637d81142e4829dae3424e154b6 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMajorCompactionWithWeeklyPolicy/6868bac373e3128a323294fb5686f080/family1/bb9d2637d81142e4829dae3424e154b6 2023-02-12 03:54:04,071 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyPolicy/6868bac373e3128a323294fb5686f080/family1/6606f48266a44fa39ca128bb10a6cfa3 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMajorCompactionWithWeeklyPolicy/6868bac373e3128a323294fb5686f080/family1/6606f48266a44fa39ca128bb10a6cfa3 2023-02-12 03:54:04,073 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyPolicy/6868bac373e3128a323294fb5686f080/family1/cb2e3aed961b497aaf9e4b210d302968 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMajorCompactionWithWeeklyPolicy/6868bac373e3128a323294fb5686f080/family1/cb2e3aed961b497aaf9e4b210d302968 2023-02-12 03:54:04,074 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyPolicy/6868bac373e3128a323294fb5686f080/family1/9a7af808ccb44902a73d55acfdd2bad3 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMajorCompactionWithWeeklyPolicy/6868bac373e3128a323294fb5686f080/family1/9a7af808ccb44902a73d55acfdd2bad3 2023-02-12 03:54:04,076 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyPolicy/6868bac373e3128a323294fb5686f080/family1/8481df8a6c9e4190a770765f9bbe25e3_SeqId_44_ to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMajorCompactionWithWeeklyPolicy/6868bac373e3128a323294fb5686f080/family1/8481df8a6c9e4190a770765f9bbe25e3_SeqId_44_ 2023-02-12 03:54:04,097 INFO [Listener at localhost.localdomain/41049] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyPolicy Thread=251 (was 251), OpenFileDescriptor=607 (was 605) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=304 (was 380), ProcessCount=164 (was 164), AvailableMemoryMB=4122 (was 4357) 2023-02-12 03:54:04,107 INFO [Listener at localhost.localdomain/41049] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly Thread=251, OpenFileDescriptor=607, MaxFileDescriptor=60000, SystemLoadAverage=304, ProcessCount=164, AvailableMemoryMB=4122 2023-02-12 03:54:04,109 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.HMaster$4(2102): Client=jenkins//148.251.75.209 create 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-02-12 03:54:04,110 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] procedure2.ProcedureExecutor(1029): Stored pid=39, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:04,112 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_PRE_OPERATION 2023-02-12 03:54:04,112 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(697): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly" procId is: 39 2023-02-12 03:54:04,113 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-12 03:54:04,113 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-02-12 03:54:04,114 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/008ac801462bd1c3f87556bf17bb0d46 2023-02-12 03:54:04,115 DEBUG [HFileArchiver-9] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/008ac801462bd1c3f87556bf17bb0d46 empty. 2023-02-12 03:54:04,115 DEBUG [HFileArchiver-9] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/008ac801462bd1c3f87556bf17bb0d46 2023-02-12 03:54:04,115 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly regions 2023-02-12 03:54:04,214 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-02-12 03:54:04,415 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-02-12 03:54:04,526 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000001 2023-02-12 03:54:04,529 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(7671): creating {ENCODED => 008ac801462bd1c3f87556bf17bb0d46, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676174044109.008ac801462bd1c3f87556bf17bb0d46.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/.tmp 2023-02-12 03:54:04,716 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-02-12 03:54:04,940 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676174044109.008ac801462bd1c3f87556bf17bb0d46.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:54:04,940 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1603): Closing 008ac801462bd1c3f87556bf17bb0d46, disabling compactions & flushes 2023-02-12 03:54:04,940 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676174044109.008ac801462bd1c3f87556bf17bb0d46. 2023-02-12 03:54:04,940 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676174044109.008ac801462bd1c3f87556bf17bb0d46. 2023-02-12 03:54:04,940 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676174044109.008ac801462bd1c3f87556bf17bb0d46. after waiting 0 ms 2023-02-12 03:54:04,940 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676174044109.008ac801462bd1c3f87556bf17bb0d46. 2023-02-12 03:54:04,941 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676174044109.008ac801462bd1c3f87556bf17bb0d46. 2023-02-12 03:54:04,941 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1557): Region close journal for 008ac801462bd1c3f87556bf17bb0d46: Waiting for close lock at 1676174044940Disabling compacts and flushes for region at 1676174044940Disabling writes for close at 1676174044940Writing region close event to WAL at 1676174044941 (+1 ms)Closed at 1676174044941 2023-02-12 03:54:04,947 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_ADD_TO_META 2023-02-12 03:54:04,950 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676174044109.008ac801462bd1c3f87556bf17bb0d46.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1676174044949"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676174044949"}]},"ts":"1676174044949"} 2023-02-12 03:54:04,953 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-12 03:54:04,954 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-12 03:54:04,954 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676174044954"}]},"ts":"1676174044954"} 2023-02-12 03:54:04,956 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, state=ENABLING in hbase:meta 2023-02-12 03:54:04,959 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=008ac801462bd1c3f87556bf17bb0d46, ASSIGN}] 2023-02-12 03:54:04,961 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=008ac801462bd1c3f87556bf17bb0d46, ASSIGN 2023-02-12 03:54:04,962 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=008ac801462bd1c3f87556bf17bb0d46, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,39639,1676173982450; forceNewPlan=false, retain=false 2023-02-12 03:54:05,113 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=008ac801462bd1c3f87556bf17bb0d46, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:05,114 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676174044109.008ac801462bd1c3f87556bf17bb0d46.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1676174045113"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676174045113"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676174045113"}]},"ts":"1676174045113"} 2023-02-12 03:54:05,116 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=41, ppid=40, state=RUNNABLE; OpenRegionProcedure 008ac801462bd1c3f87556bf17bb0d46, server=jenkins-hbase20.apache.org,39639,1676173982450}] 2023-02-12 03:54:05,217 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-02-12 03:54:05,252 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyPolicy/6868bac373e3128a323294fb5686f080/.tmp/family1/b96310c1fd354322b26b67beb531d6bd as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyPolicy/6868bac373e3128a323294fb5686f080/family1/b96310c1fd354322b26b67beb531d6bd 2023-02-12 03:54:05,260 INFO [RS:0;jenkins-hbase20:39639-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 6868bac373e3128a323294fb5686f080/family1 of 6868bac373e3128a323294fb5686f080 into b96310c1fd354322b26b67beb531d6bd(size=166.4 K), total size for store is 166.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-12 03:54:05,260 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 6868bac373e3128a323294fb5686f080: 2023-02-12 03:54:05,260 INFO [RS:0;jenkins-hbase20:39639-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyPolicy,,1676174030338.6868bac373e3128a323294fb5686f080., storeName=family1, fileCount=3, fileSize=337.0 K (165.1 K, 6.6 K, 165.4 K), priority=2, time=1676174044002; duration=1sec 2023-02-12 03:54:05,260 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-12 03:54:05,273 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676174044109.008ac801462bd1c3f87556bf17bb0d46. 2023-02-12 03:54:05,273 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 008ac801462bd1c3f87556bf17bb0d46, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676174044109.008ac801462bd1c3f87556bf17bb0d46.', STARTKEY => '', ENDKEY => ''} 2023-02-12 03:54:05,273 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 008ac801462bd1c3f87556bf17bb0d46 2023-02-12 03:54:05,273 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676174044109.008ac801462bd1c3f87556bf17bb0d46.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:54:05,273 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 008ac801462bd1c3f87556bf17bb0d46 2023-02-12 03:54:05,273 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 008ac801462bd1c3f87556bf17bb0d46 2023-02-12 03:54:05,274 INFO [StoreOpener-008ac801462bd1c3f87556bf17bb0d46-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 008ac801462bd1c3f87556bf17bb0d46 2023-02-12 03:54:05,276 DEBUG [StoreOpener-008ac801462bd1c3f87556bf17bb0d46-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/008ac801462bd1c3f87556bf17bb0d46/family1 2023-02-12 03:54:05,276 DEBUG [StoreOpener-008ac801462bd1c3f87556bf17bb0d46-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/008ac801462bd1c3f87556bf17bb0d46/family1 2023-02-12 03:54:05,276 INFO [StoreOpener-008ac801462bd1c3f87556bf17bb0d46-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 008ac801462bd1c3f87556bf17bb0d46 columnFamilyName family1 2023-02-12 03:54:05,278 INFO [StoreOpener-008ac801462bd1c3f87556bf17bb0d46-1] regionserver.HStore(310): Store=008ac801462bd1c3f87556bf17bb0d46/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:54:05,279 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/008ac801462bd1c3f87556bf17bb0d46 2023-02-12 03:54:05,279 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/008ac801462bd1c3f87556bf17bb0d46 2023-02-12 03:54:05,283 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 008ac801462bd1c3f87556bf17bb0d46 2023-02-12 03:54:05,286 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/008ac801462bd1c3f87556bf17bb0d46/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 03:54:05,287 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 008ac801462bd1c3f87556bf17bb0d46; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64180644, jitterRate=-0.043633878231048584}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-12 03:54:05,287 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 008ac801462bd1c3f87556bf17bb0d46: Running coprocessor pre-open hook at 1676174045273Writing region info on filesystem at 1676174045273Initializing all the Stores at 1676174045274 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} at 1676174045274Cleaning up temporary data from old regions at 1676174045280 (+6 ms)Cleaning up detritus from prior splits at 1676174045280Running coprocessor post-open hooks at 1676174045287 (+7 ms)Region opened successfully at 1676174045287 2023-02-12 03:54:05,288 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676174044109.008ac801462bd1c3f87556bf17bb0d46., pid=41, masterSystemTime=1676174045269 2023-02-12 03:54:05,290 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676174044109.008ac801462bd1c3f87556bf17bb0d46. 2023-02-12 03:54:05,290 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676174044109.008ac801462bd1c3f87556bf17bb0d46. 2023-02-12 03:54:05,290 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=008ac801462bd1c3f87556bf17bb0d46, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:05,291 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676174044109.008ac801462bd1c3f87556bf17bb0d46.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1676174045290"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676174045290"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676174045290"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676174045290"}]},"ts":"1676174045290"} 2023-02-12 03:54:05,295 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=41, resume processing ppid=40 2023-02-12 03:54:05,295 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=41, ppid=40, state=SUCCESS; OpenRegionProcedure 008ac801462bd1c3f87556bf17bb0d46, server=jenkins-hbase20.apache.org,39639,1676173982450 in 177 msec 2023-02-12 03:54:05,297 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=40, resume processing ppid=39 2023-02-12 03:54:05,297 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=39, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=008ac801462bd1c3f87556bf17bb0d46, ASSIGN in 336 msec 2023-02-12 03:54:05,298 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-12 03:54:05,298 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676174045298"}]},"ts":"1676174045298"} 2023-02-12 03:54:05,299 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, state=ENABLED in hbase:meta 2023-02-12 03:54:05,301 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_POST_OPERATION 2023-02-12 03:54:05,302 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=39, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 1.1920 sec 2023-02-12 03:54:05,356 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyPolicy/6868bac373e3128a323294fb5686f080/family1/997fa36bced54aad88a65ff095582cb1, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyPolicy/6868bac373e3128a323294fb5686f080/family1/8ce2bb7f04474eaabe417a0b9bf496dc, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyPolicy/6868bac373e3128a323294fb5686f080/family1/1ee99153017b441294735a7014aded24_SeqId_47_] to archive 2023-02-12 03:54:05,357 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-12 03:54:05,360 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyPolicy/6868bac373e3128a323294fb5686f080/family1/997fa36bced54aad88a65ff095582cb1 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMajorCompactionWithWeeklyPolicy/6868bac373e3128a323294fb5686f080/family1/997fa36bced54aad88a65ff095582cb1 2023-02-12 03:54:05,362 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyPolicy/6868bac373e3128a323294fb5686f080/family1/8ce2bb7f04474eaabe417a0b9bf496dc to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMajorCompactionWithWeeklyPolicy/6868bac373e3128a323294fb5686f080/family1/8ce2bb7f04474eaabe417a0b9bf496dc 2023-02-12 03:54:05,365 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyPolicy/6868bac373e3128a323294fb5686f080/family1/1ee99153017b441294735a7014aded24_SeqId_47_ to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMajorCompactionWithWeeklyPolicy/6868bac373e3128a323294fb5686f080/family1/1ee99153017b441294735a7014aded24_SeqId_47_ 2023-02-12 03:54:06,218 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-02-12 03:54:06,219 INFO [Listener at localhost.localdomain/41049] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, procId: 39 completed 2023-02-12 03:54:06,242 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-12 03:54:06,243 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:06,244 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-12 03:54:06,244 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:54:06,244 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-02-12 03:54:06,244 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-02-12 03:54:06,244 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:06,244 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:06,245 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:54:06,245 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:06,245 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:54:06,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:54:06,245 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:06,245 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-12 03:54:06,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:06,245 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:06,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-12 03:54:06,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:06,246 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:06,246 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:06,246 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-02-12 03:54:06,246 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:54:06,246 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-02-12 03:54:06,246 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-12 03:54:06,246 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-12 03:54:06,246 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676174044109.008ac801462bd1c3f87556bf17bb0d46. 2023-02-12 03:54:06,246 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676174044109.008ac801462bd1c3f87556bf17bb0d46. started... 2023-02-12 03:54:06,247 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 008ac801462bd1c3f87556bf17bb0d46 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-02-12 03:54:06,669 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130355eeffcb3674fbda0de4560a0df3b0c to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151130355eeffcb3674fbda0de4560a0df3b0c 2023-02-12 03:54:07,076 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/008ac801462bd1c3f87556bf17bb0d46/.tmp/family1/9db82be1f558448e85b26120c62b5cda 2023-02-12 03:54:07,086 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/008ac801462bd1c3f87556bf17bb0d46/.tmp/family1/9db82be1f558448e85b26120c62b5cda as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/008ac801462bd1c3f87556bf17bb0d46/family1/9db82be1f558448e85b26120c62b5cda 2023-02-12 03:54:07,093 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/008ac801462bd1c3f87556bf17bb0d46/family1/9db82be1f558448e85b26120c62b5cda, entries=1000, sequenceid=5, filesize=191.4 K 2023-02-12 03:54:07,094 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 008ac801462bd1c3f87556bf17bb0d46 in 847ms, sequenceid=5, compaction requested=false 2023-02-12 03:54:07,094 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-12 03:54:07,095 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 008ac801462bd1c3f87556bf17bb0d46: 2023-02-12 03:54:07,095 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676174044109.008ac801462bd1c3f87556bf17bb0d46. 2023-02-12 03:54:07,095 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-12 03:54:07,095 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-12 03:54:07,095 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:07,095 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-02-12 03:54:07,095 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-02-12 03:54:07,096 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:07,096 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:07,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:07,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:54:07,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:54:07,097 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:07,097 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 03:54:07,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:54:07,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:54:07,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:07,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:07,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:54:07,098 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-02-12 03:54:07,098 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@41cf0e49[Count = 0] remaining members to acquire global barrier 2023-02-12 03:54:07,098 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-02-12 03:54:07,098 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:07,099 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:07,099 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:07,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:07,099 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-02-12 03:54:07,099 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-02-12 03:54:07,099 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase20.apache.org,39639,1676173982450' in zk 2023-02-12 03:54:07,099 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:07,099 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-12 03:54:07,100 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-02-12 03:54:07,100 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:07,100 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:54:07,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:07,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:54:07,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:54:07,100 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-02-12 03:54:07,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:54:07,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:54:07,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:07,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:07,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:54:07,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:07,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:07,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase20.apache.org,39639,1676173982450': 2023-02-12 03:54:07,102 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-02-12 03:54:07,102 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-02-12 03:54:07,102 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-12 03:54:07,102 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-12 03:54:07,102 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:07,102 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-12 03:54:07,103 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:07,103 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:07,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:07,103 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:07,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:54:07,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:54:07,103 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:54:07,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:07,103 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:54:07,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:54:07,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:54:07,103 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:07,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:07,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:07,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:54:07,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:07,104 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:07,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:07,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:54:07,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:07,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:07,105 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:07,105 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:07,105 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:54:07,105 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:07,105 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:54:07,106 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-02-12 03:54:07,105 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:54:07,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:54:07,105 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:54:07,106 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-12 03:54:07,106 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-12 03:54:07,105 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:07,106 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:07,106 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:54:07,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:54:07,106 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-02-12 03:54:07,106 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-12 03:54:07,106 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:07,106 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:07,206 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-12 03:54:07,208 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-12 03:54:07,213 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-12 03:54:07,214 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-02-12 03:54:07,214 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:07,214 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-12 03:54:07,215 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:54:07,215 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-02-12 03:54:07,215 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-02-12 03:54:07,215 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:07,215 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:07,216 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:07,216 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:54:07,216 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:54:07,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:54:07,216 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:07,216 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-12 03:54:07,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:07,217 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:07,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-12 03:54:07,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:07,217 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:07,217 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-02-12 03:54:07,217 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:07,217 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-02-12 03:54:07,217 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:54:07,217 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-02-12 03:54:07,217 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-12 03:54:07,217 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-12 03:54:07,217 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676174044109.008ac801462bd1c3f87556bf17bb0d46. 2023-02-12 03:54:07,217 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676174044109.008ac801462bd1c3f87556bf17bb0d46. started... 2023-02-12 03:54:07,218 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 008ac801462bd1c3f87556bf17bb0d46 1/1 column families, dataSize=74 B heapSize=408 B 2023-02-12 03:54:07,634 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128d64665e51c8d4c9cabe0eea3f4812c23 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151128d64665e51c8d4c9cabe0eea3f4812c23 2023-02-12 03:54:08,041 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/008ac801462bd1c3f87556bf17bb0d46/.tmp/family1/a10839e238dd4ab89180fc129d656c32 2023-02-12 03:54:08,047 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/008ac801462bd1c3f87556bf17bb0d46/.tmp/family1/a10839e238dd4ab89180fc129d656c32 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/008ac801462bd1c3f87556bf17bb0d46/family1/a10839e238dd4ab89180fc129d656c32 2023-02-12 03:54:08,053 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/008ac801462bd1c3f87556bf17bb0d46/family1/a10839e238dd4ab89180fc129d656c32, entries=1, sequenceid=9, filesize=5.0 K 2023-02-12 03:54:08,054 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 008ac801462bd1c3f87556bf17bb0d46 in 836ms, sequenceid=9, compaction requested=false 2023-02-12 03:54:08,055 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 008ac801462bd1c3f87556bf17bb0d46: 2023-02-12 03:54:08,055 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676174044109.008ac801462bd1c3f87556bf17bb0d46. 2023-02-12 03:54:08,055 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-12 03:54:08,055 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-12 03:54:08,055 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:08,055 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-02-12 03:54:08,055 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-02-12 03:54:08,057 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:08,057 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:08,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:08,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:54:08,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:54:08,057 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:08,057 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 03:54:08,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:54:08,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:54:08,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:08,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:08,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:54:08,059 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-02-12 03:54:08,059 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7d3561a2[Count = 0] remaining members to acquire global barrier 2023-02-12 03:54:08,059 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-02-12 03:54:08,059 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:08,060 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:08,060 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:08,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:08,060 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-02-12 03:54:08,060 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-02-12 03:54:08,060 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase20.apache.org,39639,1676173982450' in zk 2023-02-12 03:54:08,060 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:08,060 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-12 03:54:08,061 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-02-12 03:54:08,061 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:54:08,061 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-02-12 03:54:08,061 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:08,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:08,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:54:08,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:54:08,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:54:08,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:54:08,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:08,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:08,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:54:08,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:08,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:08,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase20.apache.org,39639,1676173982450': 2023-02-12 03:54:08,065 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-02-12 03:54:08,065 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-02-12 03:54:08,065 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-12 03:54:08,065 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-12 03:54:08,065 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:08,066 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-12 03:54:08,067 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:08,067 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:54:08,067 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:08,067 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:08,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:08,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:54:08,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:54:08,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:08,068 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:54:08,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:54:08,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:54:08,068 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:08,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:08,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:08,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:54:08,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:08,069 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:08,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:08,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:54:08,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:08,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:08,071 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:08,071 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:08,071 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:08,072 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:08,072 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:54:08,072 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:54:08,072 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:08,072 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:54:08,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:54:08,072 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-12 03:54:08,072 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-12 03:54:08,072 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-02-12 03:54:08,072 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:54:08,072 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:08,072 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:54:08,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:54:08,072 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-02-12 03:54:08,072 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-12 03:54:08,072 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:08,172 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-12 03:54:08,174 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-12 03:54:08,183 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-12 03:54:08,186 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-02-12 03:54:08,186 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:08,186 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-12 03:54:08,187 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:54:08,187 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-02-12 03:54:08,187 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-02-12 03:54:08,188 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:08,188 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:08,189 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:54:08,189 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:08,189 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:54:08,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:54:08,190 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:08,190 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-12 03:54:08,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:08,190 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:08,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-12 03:54:08,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:08,191 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:08,191 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-02-12 03:54:08,191 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:08,191 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-02-12 03:54:08,192 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:54:08,192 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-02-12 03:54:08,192 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-12 03:54:08,192 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-12 03:54:08,192 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676174044109.008ac801462bd1c3f87556bf17bb0d46. 2023-02-12 03:54:08,192 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676174044109.008ac801462bd1c3f87556bf17bb0d46. started... 2023-02-12 03:54:08,192 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 008ac801462bd1c3f87556bf17bb0d46 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-12 03:54:08,611 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120106c556a723464b34927715ceb8c2c8dc to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015120106c556a723464b34927715ceb8c2c8dc 2023-02-12 03:54:09,017 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/008ac801462bd1c3f87556bf17bb0d46/.tmp/family1/7bb51d554b7b416c92ffa886125675d0 2023-02-12 03:54:09,028 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/008ac801462bd1c3f87556bf17bb0d46/.tmp/family1/7bb51d554b7b416c92ffa886125675d0 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/008ac801462bd1c3f87556bf17bb0d46/family1/7bb51d554b7b416c92ffa886125675d0 2023-02-12 03:54:09,034 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/008ac801462bd1c3f87556bf17bb0d46/family1/7bb51d554b7b416c92ffa886125675d0, entries=1, sequenceid=13, filesize=5.0 K 2023-02-12 03:54:09,034 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 008ac801462bd1c3f87556bf17bb0d46 in 842ms, sequenceid=13, compaction requested=true 2023-02-12 03:54:09,034 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 008ac801462bd1c3f87556bf17bb0d46: 2023-02-12 03:54:09,034 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676174044109.008ac801462bd1c3f87556bf17bb0d46. 2023-02-12 03:54:09,034 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-12 03:54:09,034 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-12 03:54:09,035 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:09,035 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-02-12 03:54:09,035 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-02-12 03:54:09,036 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:09,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:09,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:54:09,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:54:09,036 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:09,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:54:09,036 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:09,036 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 03:54:09,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:54:09,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:09,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:09,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:54:09,037 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-02-12 03:54:09,037 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@528ed8f7[Count = 0] remaining members to acquire global barrier 2023-02-12 03:54:09,037 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-02-12 03:54:09,037 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:09,038 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:09,038 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:09,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:09,038 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-02-12 03:54:09,038 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-02-12 03:54:09,038 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase20.apache.org,39639,1676173982450' in zk 2023-02-12 03:54:09,038 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:09,038 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-12 03:54:09,039 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:09,039 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-02-12 03:54:09,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:09,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:54:09,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:54:09,039 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:54:09,039 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-02-12 03:54:09,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:54:09,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:54:09,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:09,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:09,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:54:09,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:09,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:09,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase20.apache.org,39639,1676173982450': 2023-02-12 03:54:09,041 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-02-12 03:54:09,041 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-02-12 03:54:09,041 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-12 03:54:09,041 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-12 03:54:09,041 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:09,041 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-12 03:54:09,043 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:09,043 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:09,043 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:09,043 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:54:09,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:09,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:09,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:54:09,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:54:09,043 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:54:09,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:54:09,043 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:09,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:54:09,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:09,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:09,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:54:09,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:09,044 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:09,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:09,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:54:09,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:09,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:09,045 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:09,045 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:54:09,045 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:09,045 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:54:09,045 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:54:09,046 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-12 03:54:09,046 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-12 03:54:09,046 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:54:09,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:54:09,045 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:09,046 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-02-12 03:54:09,046 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:09,046 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:09,046 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:09,046 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-02-12 03:54:09,046 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:09,046 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:54:09,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:54:09,046 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-12 03:54:09,146 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-12 03:54:09,147 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-12 03:54:09,150 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-12 03:54:09,152 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-02-12 03:54:09,152 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:09,152 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-12 03:54:09,152 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:54:09,152 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-02-12 03:54:09,152 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-02-12 03:54:09,152 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:09,152 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:09,153 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:54:09,153 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:09,153 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:54:09,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:54:09,154 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:09,154 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-12 03:54:09,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:09,154 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:09,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-12 03:54:09,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:09,155 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:09,155 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-02-12 03:54:09,155 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:09,155 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-02-12 03:54:09,155 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:54:09,155 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-02-12 03:54:09,155 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-12 03:54:09,155 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-12 03:54:09,155 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676174044109.008ac801462bd1c3f87556bf17bb0d46. 2023-02-12 03:54:09,155 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676174044109.008ac801462bd1c3f87556bf17bb0d46. started... 2023-02-12 03:54:09,155 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 008ac801462bd1c3f87556bf17bb0d46 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-12 03:54:09,569 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205d4b8b13b06c245f2ab6d7284306b049b to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151205d4b8b13b06c245f2ab6d7284306b049b 2023-02-12 03:54:09,976 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/008ac801462bd1c3f87556bf17bb0d46/.tmp/family1/39f0574d78db42309641c2b01980ffd9 2023-02-12 03:54:09,980 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/008ac801462bd1c3f87556bf17bb0d46/.tmp/family1/39f0574d78db42309641c2b01980ffd9 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/008ac801462bd1c3f87556bf17bb0d46/family1/39f0574d78db42309641c2b01980ffd9 2023-02-12 03:54:09,985 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/008ac801462bd1c3f87556bf17bb0d46/family1/39f0574d78db42309641c2b01980ffd9, entries=1, sequenceid=17, filesize=5.0 K 2023-02-12 03:54:09,985 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 008ac801462bd1c3f87556bf17bb0d46 in 830ms, sequenceid=17, compaction requested=true 2023-02-12 03:54:09,986 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 008ac801462bd1c3f87556bf17bb0d46: 2023-02-12 03:54:09,986 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676174044109.008ac801462bd1c3f87556bf17bb0d46. 2023-02-12 03:54:09,986 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-12 03:54:09,986 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-12 03:54:09,986 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:09,986 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-02-12 03:54:09,986 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-02-12 03:54:09,987 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:09,987 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:09,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:09,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:54:09,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:54:09,987 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:09,987 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 03:54:09,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:54:09,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:54:09,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:09,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:09,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:54:09,989 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-02-12 03:54:09,989 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3b4f7956[Count = 0] remaining members to acquire global barrier 2023-02-12 03:54:09,989 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-02-12 03:54:09,989 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:09,989 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:09,989 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:09,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:09,990 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-02-12 03:54:09,990 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-02-12 03:54:09,990 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:09,990 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-12 03:54:09,990 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase20.apache.org,39639,1676173982450' in zk 2023-02-12 03:54:09,990 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:09,990 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-02-12 03:54:09,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:09,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:54:09,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:54:09,990 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:54:09,990 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-02-12 03:54:09,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:54:09,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:54:09,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:09,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:09,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:54:09,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:09,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:09,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase20.apache.org,39639,1676173982450': 2023-02-12 03:54:09,993 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-02-12 03:54:09,993 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-02-12 03:54:09,993 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-12 03:54:09,993 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-12 03:54:09,993 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:09,993 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-12 03:54:09,994 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:09,994 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:09,994 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:54:09,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:09,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:54:09,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:54:09,994 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:09,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:09,994 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:09,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:54:09,995 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:54:09,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:54:09,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:09,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:09,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:54:09,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:09,995 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:09,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:09,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:54:09,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:09,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:09,997 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:09,997 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:09,997 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:09,997 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:09,997 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:09,997 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:09,997 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:54:09,997 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-12 03:54:09,997 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-12 03:54:09,997 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:09,997 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:54:09,997 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:54:09,997 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:54:09,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:54:09,997 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-02-12 03:54:09,997 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-02-12 03:54:09,997 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-12 03:54:09,997 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:54:09,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:54:10,097 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-12 03:54:10,099 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-12 03:54:10,108 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-12 03:54:10,111 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-02-12 03:54:10,111 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:10,111 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-12 03:54:10,111 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:54:10,111 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-02-12 03:54:10,111 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-02-12 03:54:10,112 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:10,112 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:10,113 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:54:10,113 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:10,113 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:54:10,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:54:10,114 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:10,114 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-12 03:54:10,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:10,114 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:10,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-12 03:54:10,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:10,115 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:10,115 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-02-12 03:54:10,115 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:10,115 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-02-12 03:54:10,115 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:54:10,115 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-02-12 03:54:10,115 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-12 03:54:10,115 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-12 03:54:10,115 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676174044109.008ac801462bd1c3f87556bf17bb0d46. 2023-02-12 03:54:10,115 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676174044109.008ac801462bd1c3f87556bf17bb0d46. started... 2023-02-12 03:54:10,116 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 008ac801462bd1c3f87556bf17bb0d46 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-12 03:54:10,538 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015122864e34b6cb3b9494292c6b72f540815e7 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015122864e34b6cb3b9494292c6b72f540815e7 2023-02-12 03:54:10,806 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-12 03:54:10,945 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/008ac801462bd1c3f87556bf17bb0d46/.tmp/family1/a08e8c9dba7147a89859d9c5ad8bc559 2023-02-12 03:54:10,957 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/008ac801462bd1c3f87556bf17bb0d46/.tmp/family1/a08e8c9dba7147a89859d9c5ad8bc559 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/008ac801462bd1c3f87556bf17bb0d46/family1/a08e8c9dba7147a89859d9c5ad8bc559 2023-02-12 03:54:10,962 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/008ac801462bd1c3f87556bf17bb0d46/family1/a08e8c9dba7147a89859d9c5ad8bc559, entries=1, sequenceid=21, filesize=5.0 K 2023-02-12 03:54:10,963 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 008ac801462bd1c3f87556bf17bb0d46 in 848ms, sequenceid=21, compaction requested=true 2023-02-12 03:54:10,963 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 008ac801462bd1c3f87556bf17bb0d46: 2023-02-12 03:54:10,963 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676174044109.008ac801462bd1c3f87556bf17bb0d46. 2023-02-12 03:54:10,963 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-12 03:54:10,963 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-12 03:54:10,963 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:10,963 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-02-12 03:54:10,963 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-02-12 03:54:10,964 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:10,964 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:10,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:10,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:54:10,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:54:10,965 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:10,965 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 03:54:10,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:54:10,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:54:10,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:10,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:10,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:54:10,966 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-02-12 03:54:10,966 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@24b9530[Count = 0] remaining members to acquire global barrier 2023-02-12 03:54:10,966 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-02-12 03:54:10,966 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:10,967 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:10,967 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:10,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:10,967 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-02-12 03:54:10,967 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-02-12 03:54:10,967 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:10,967 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-12 03:54:10,967 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase20.apache.org,39639,1676173982450' in zk 2023-02-12 03:54:10,968 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:10,968 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-02-12 03:54:10,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:10,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:54:10,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:54:10,968 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:54:10,969 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-02-12 03:54:10,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:54:10,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:54:10,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:10,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:10,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:54:10,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:10,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:10,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase20.apache.org,39639,1676173982450': 2023-02-12 03:54:10,970 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-02-12 03:54:10,970 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-02-12 03:54:10,970 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-12 03:54:10,970 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-12 03:54:10,970 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:10,970 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-12 03:54:10,971 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:10,971 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:10,971 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:10,971 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:54:10,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:10,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:10,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:54:10,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:54:10,972 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:54:10,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:54:10,972 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:10,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:54:10,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:10,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:10,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:54:10,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:10,973 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:10,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:10,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:54:10,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:10,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:10,974 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:10,974 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:54:10,974 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:10,974 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:54:10,974 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-12 03:54:10,974 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-02-12 03:54:10,974 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-12 03:54:10,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:54:10,974 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:54:10,974 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:54:10,974 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:10,975 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:10,975 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:10,975 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:10,975 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:10,975 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:54:10,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:54:10,975 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-02-12 03:54:10,975 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-12 03:54:11,075 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-12 03:54:11,077 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-12 03:54:11,083 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-12 03:54:11,086 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-02-12 03:54:11,086 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:11,086 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-12 03:54:11,086 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:54:11,086 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-02-12 03:54:11,086 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-02-12 03:54:11,087 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:11,087 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:11,088 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:11,088 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:54:11,088 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:54:11,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:54:11,088 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:11,088 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-12 03:54:11,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:11,089 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:11,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-12 03:54:11,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:11,090 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:11,090 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-02-12 03:54:11,090 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:11,090 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-02-12 03:54:11,090 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:54:11,090 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-02-12 03:54:11,090 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-12 03:54:11,091 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-12 03:54:11,091 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676174044109.008ac801462bd1c3f87556bf17bb0d46. 2023-02-12 03:54:11,091 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676174044109.008ac801462bd1c3f87556bf17bb0d46. started... 2023-02-12 03:54:11,091 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 008ac801462bd1c3f87556bf17bb0d46 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-12 03:54:11,515 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015123194a1065e618848bdb37456469aa35583 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015123194a1065e618848bdb37456469aa35583 2023-02-12 03:54:11,923 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/008ac801462bd1c3f87556bf17bb0d46/.tmp/family1/89f0365d76004296ac762f2111a834be 2023-02-12 03:54:11,929 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/008ac801462bd1c3f87556bf17bb0d46/.tmp/family1/89f0365d76004296ac762f2111a834be as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/008ac801462bd1c3f87556bf17bb0d46/family1/89f0365d76004296ac762f2111a834be 2023-02-12 03:54:11,935 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/008ac801462bd1c3f87556bf17bb0d46/family1/89f0365d76004296ac762f2111a834be, entries=1, sequenceid=25, filesize=5.0 K 2023-02-12 03:54:11,936 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 008ac801462bd1c3f87556bf17bb0d46 in 845ms, sequenceid=25, compaction requested=true 2023-02-12 03:54:11,936 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 008ac801462bd1c3f87556bf17bb0d46: 2023-02-12 03:54:11,936 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676174044109.008ac801462bd1c3f87556bf17bb0d46. 2023-02-12 03:54:11,936 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-12 03:54:11,936 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-12 03:54:11,936 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:11,936 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-02-12 03:54:11,936 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-02-12 03:54:11,938 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:11,938 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:11,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:11,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:54:11,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:54:11,938 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:11,938 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 03:54:11,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:54:11,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:54:11,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:11,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:11,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:54:11,941 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-02-12 03:54:11,941 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@54a5dcaa[Count = 0] remaining members to acquire global barrier 2023-02-12 03:54:11,941 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-02-12 03:54:11,941 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:11,942 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:11,942 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:11,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:11,942 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-02-12 03:54:11,942 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-02-12 03:54:11,942 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase20.apache.org,39639,1676173982450' in zk 2023-02-12 03:54:11,942 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:11,942 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-12 03:54:11,943 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:11,943 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-02-12 03:54:11,944 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:54:11,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:11,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:54:11,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:54:11,944 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-02-12 03:54:11,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:54:11,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:54:11,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:11,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:11,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:54:11,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:11,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:11,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase20.apache.org,39639,1676173982450': 2023-02-12 03:54:11,947 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-02-12 03:54:11,947 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-02-12 03:54:11,947 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-12 03:54:11,947 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-12 03:54:11,948 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:11,948 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-12 03:54:11,953 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:11,953 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:11,954 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:54:11,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:11,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:54:11,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:54:11,954 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:11,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:11,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:54:11,954 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:54:11,954 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:11,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:54:11,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:11,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:11,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:54:11,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:11,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:11,956 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:11,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:54:11,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:11,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:11,962 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:11,962 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:54:11,962 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:11,962 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:54:11,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:54:11,962 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-12 03:54:11,962 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-12 03:54:11,962 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:54:11,962 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:54:11,962 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:11,962 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:11,962 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-02-12 03:54:11,963 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:54:11,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:54:11,963 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:11,963 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-12 03:54:11,963 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:11,963 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:12,063 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-12 03:54:12,064 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-12 03:54:12,068 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-12 03:54:12,069 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-02-12 03:54:12,069 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:12,069 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-12 03:54:12,069 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:54:12,069 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-02-12 03:54:12,069 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-02-12 03:54:12,070 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:12,070 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:12,070 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:12,070 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:54:12,070 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:54:12,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:54:12,071 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:12,071 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-12 03:54:12,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:12,071 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:12,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-12 03:54:12,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:12,071 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:12,071 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-02-12 03:54:12,071 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:12,072 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-02-12 03:54:12,072 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:54:12,072 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-02-12 03:54:12,072 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-12 03:54:12,072 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-12 03:54:12,072 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676174044109.008ac801462bd1c3f87556bf17bb0d46. 2023-02-12 03:54:12,072 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676174044109.008ac801462bd1c3f87556bf17bb0d46. started... 2023-02-12 03:54:12,072 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 008ac801462bd1c3f87556bf17bb0d46 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-12 03:54:12,488 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601018f57d291f9f4402498dc603d1efaa434 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201601018f57d291f9f4402498dc603d1efaa434 2023-02-12 03:54:12,896 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/008ac801462bd1c3f87556bf17bb0d46/.tmp/family1/2e82c30d76ca41609e5598df6457a594 2023-02-12 03:54:12,908 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/008ac801462bd1c3f87556bf17bb0d46/.tmp/family1/2e82c30d76ca41609e5598df6457a594 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/008ac801462bd1c3f87556bf17bb0d46/family1/2e82c30d76ca41609e5598df6457a594 2023-02-12 03:54:12,913 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/008ac801462bd1c3f87556bf17bb0d46/family1/2e82c30d76ca41609e5598df6457a594, entries=1, sequenceid=29, filesize=5.0 K 2023-02-12 03:54:12,914 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 008ac801462bd1c3f87556bf17bb0d46 in 842ms, sequenceid=29, compaction requested=true 2023-02-12 03:54:12,914 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 008ac801462bd1c3f87556bf17bb0d46: 2023-02-12 03:54:12,914 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676174044109.008ac801462bd1c3f87556bf17bb0d46. 2023-02-12 03:54:12,914 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-12 03:54:12,914 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-12 03:54:12,914 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:12,914 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-02-12 03:54:12,914 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-02-12 03:54:12,915 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:12,915 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:12,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:12,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:54:12,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:54:12,916 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:12,916 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 03:54:12,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:54:12,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:54:12,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:12,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:12,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:54:12,917 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-02-12 03:54:12,917 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7048efa9[Count = 0] remaining members to acquire global barrier 2023-02-12 03:54:12,917 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-02-12 03:54:12,917 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:12,918 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:12,918 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:12,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:12,918 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-02-12 03:54:12,918 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-02-12 03:54:12,918 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:12,918 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-12 03:54:12,918 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase20.apache.org,39639,1676173982450' in zk 2023-02-12 03:54:12,920 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-02-12 03:54:12,920 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:54:12,920 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-02-12 03:54:12,920 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:12,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:12,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:54:12,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:54:12,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:54:12,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:54:12,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:12,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:12,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:54:12,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:12,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:12,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase20.apache.org,39639,1676173982450': 2023-02-12 03:54:12,922 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-02-12 03:54:12,922 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-02-12 03:54:12,922 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-12 03:54:12,922 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-12 03:54:12,922 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:12,922 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-12 03:54:12,923 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:12,923 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:12,923 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:12,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:12,923 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:54:12,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:12,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:54:12,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:54:12,923 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:54:12,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:54:12,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:54:12,923 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:12,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:12,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:12,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:54:12,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:12,924 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:12,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:12,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:54:12,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:12,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:12,925 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:12,925 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:54:12,925 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:12,926 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:54:12,926 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:54:12,926 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:12,926 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:12,926 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:12,925 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:54:12,926 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:12,926 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:12,926 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-02-12 03:54:12,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:54:12,926 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-12 03:54:12,926 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-12 03:54:12,926 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:54:12,926 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-02-12 03:54:12,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:54:12,926 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-12 03:54:13,026 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-12 03:54:13,027 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-12 03:54:13,032 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-12 03:54:13,033 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-02-12 03:54:13,034 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:13,034 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-12 03:54:13,034 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:54:13,034 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-02-12 03:54:13,034 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-02-12 03:54:13,034 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:13,035 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:13,036 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:54:13,036 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:13,036 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:54:13,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:54:13,036 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:13,036 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-12 03:54:13,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:13,037 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:13,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-12 03:54:13,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:13,037 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:13,038 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-02-12 03:54:13,038 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:13,038 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-02-12 03:54:13,038 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:54:13,038 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-02-12 03:54:13,038 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-12 03:54:13,038 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-12 03:54:13,038 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676174044109.008ac801462bd1c3f87556bf17bb0d46. 2023-02-12 03:54:13,038 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676174044109.008ac801462bd1c3f87556bf17bb0d46. started... 2023-02-12 03:54:13,039 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 008ac801462bd1c3f87556bf17bb0d46 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-12 03:54:13,459 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601035bec220e9bf841fd8d1ddb613f8e6d57 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201601035bec220e9bf841fd8d1ddb613f8e6d57 2023-02-12 03:54:13,866 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/008ac801462bd1c3f87556bf17bb0d46/.tmp/family1/efda3a4e00a34df3ba13e996c917cdc5 2023-02-12 03:54:13,877 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/008ac801462bd1c3f87556bf17bb0d46/.tmp/family1/efda3a4e00a34df3ba13e996c917cdc5 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/008ac801462bd1c3f87556bf17bb0d46/family1/efda3a4e00a34df3ba13e996c917cdc5 2023-02-12 03:54:13,884 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/008ac801462bd1c3f87556bf17bb0d46/family1/efda3a4e00a34df3ba13e996c917cdc5, entries=1, sequenceid=33, filesize=5.0 K 2023-02-12 03:54:13,885 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 008ac801462bd1c3f87556bf17bb0d46 in 846ms, sequenceid=33, compaction requested=true 2023-02-12 03:54:13,885 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 008ac801462bd1c3f87556bf17bb0d46: 2023-02-12 03:54:13,885 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676174044109.008ac801462bd1c3f87556bf17bb0d46. 2023-02-12 03:54:13,885 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-12 03:54:13,885 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-12 03:54:13,885 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:13,886 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-02-12 03:54:13,886 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-02-12 03:54:13,887 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:13,887 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:13,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:13,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:54:13,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:54:13,888 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:13,888 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 03:54:13,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:54:13,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:54:13,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:13,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:13,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:54:13,890 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-02-12 03:54:13,890 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@300dad3f[Count = 0] remaining members to acquire global barrier 2023-02-12 03:54:13,890 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-02-12 03:54:13,890 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:13,891 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:13,891 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:13,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:13,891 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-02-12 03:54:13,892 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-02-12 03:54:13,892 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase20.apache.org,39639,1676173982450' in zk 2023-02-12 03:54:13,892 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:13,892 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-12 03:54:13,893 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:13,893 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-02-12 03:54:13,893 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:54:13,893 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-02-12 03:54:13,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:13,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:54:13,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:54:13,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:54:13,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:54:13,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:13,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:13,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:54:13,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:13,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:13,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase20.apache.org,39639,1676173982450': 2023-02-12 03:54:13,898 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-02-12 03:54:13,898 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-02-12 03:54:13,898 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-12 03:54:13,898 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-12 03:54:13,898 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:13,898 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-12 03:54:13,901 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:13,901 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:13,902 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:13,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:13,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:54:13,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:54:13,901 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:54:13,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:13,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:54:13,902 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:54:13,902 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:13,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:54:13,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:13,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:13,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:54:13,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:13,904 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:13,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:13,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:54:13,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:13,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:13,912 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:13,912 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:13,912 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:13,912 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:54:13,912 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:54:13,912 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:54:13,912 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:54:13,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:54:13,912 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-02-12 03:54:13,912 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-12 03:54:13,912 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-12 03:54:13,912 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:13,913 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:13,913 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:13,913 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:54:13,913 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-02-12 03:54:13,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:54:13,913 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:13,913 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-12 03:54:14,013 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-12 03:54:14,014 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-12 03:54:14,018 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-12 03:54:14,019 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-02-12 03:54:14,019 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:14,019 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-12 03:54:14,019 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:54:14,019 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-02-12 03:54:14,019 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-02-12 03:54:14,020 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:14,020 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:14,020 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:14,021 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:54:14,021 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:54:14,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:54:14,021 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:14,021 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-12 03:54:14,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:14,021 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:14,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-12 03:54:14,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:14,022 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:14,022 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-02-12 03:54:14,022 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:14,022 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-02-12 03:54:14,022 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:54:14,022 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-02-12 03:54:14,022 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-12 03:54:14,022 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-12 03:54:14,022 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676174044109.008ac801462bd1c3f87556bf17bb0d46. 2023-02-12 03:54:14,022 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676174044109.008ac801462bd1c3f87556bf17bb0d46. started... 2023-02-12 03:54:14,022 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 008ac801462bd1c3f87556bf17bb0d46 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-12 03:54:14,440 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907af34373aa8424559b219f6273f0bcca1 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20150907af34373aa8424559b219f6273f0bcca1 2023-02-12 03:54:14,847 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/008ac801462bd1c3f87556bf17bb0d46/.tmp/family1/af217d2940334ee4a55c896d11d37ac7 2023-02-12 03:54:14,860 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/008ac801462bd1c3f87556bf17bb0d46/.tmp/family1/af217d2940334ee4a55c896d11d37ac7 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/008ac801462bd1c3f87556bf17bb0d46/family1/af217d2940334ee4a55c896d11d37ac7 2023-02-12 03:54:14,868 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/008ac801462bd1c3f87556bf17bb0d46/family1/af217d2940334ee4a55c896d11d37ac7, entries=1, sequenceid=37, filesize=5.0 K 2023-02-12 03:54:14,868 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 008ac801462bd1c3f87556bf17bb0d46 in 846ms, sequenceid=37, compaction requested=true 2023-02-12 03:54:14,869 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 008ac801462bd1c3f87556bf17bb0d46: 2023-02-12 03:54:14,869 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676174044109.008ac801462bd1c3f87556bf17bb0d46. 2023-02-12 03:54:14,869 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-12 03:54:14,869 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-12 03:54:14,869 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:14,869 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-02-12 03:54:14,869 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-02-12 03:54:14,870 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:14,870 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:14,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:14,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:54:14,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:54:14,870 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:14,870 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 03:54:14,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:54:14,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:54:14,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:14,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:14,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:54:14,872 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-02-12 03:54:14,872 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6eb14c1b[Count = 0] remaining members to acquire global barrier 2023-02-12 03:54:14,872 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-02-12 03:54:14,872 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:14,873 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:14,873 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:14,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:14,873 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-02-12 03:54:14,873 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-02-12 03:54:14,873 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase20.apache.org,39639,1676173982450' in zk 2023-02-12 03:54:14,873 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:14,873 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-12 03:54:14,874 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:14,874 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-02-12 03:54:14,874 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:54:14,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:14,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:54:14,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:54:14,874 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-02-12 03:54:14,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:54:14,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:54:14,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:14,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:14,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:54:14,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:14,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:14,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase20.apache.org,39639,1676173982450': 2023-02-12 03:54:14,877 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-02-12 03:54:14,877 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-02-12 03:54:14,877 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-12 03:54:14,877 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-12 03:54:14,877 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:14,877 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-12 03:54:14,878 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:14,878 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:14,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:14,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:54:14,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:54:14,878 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:14,878 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:54:14,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:14,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:54:14,879 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:14,879 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:54:14,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:54:14,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:14,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:14,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:54:14,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:14,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:14,880 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:14,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:54:14,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:14,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:14,882 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:14,883 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:14,883 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:14,883 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:14,883 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:14,883 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:54:14,883 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:54:14,883 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:54:14,883 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:14,883 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:14,883 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-12 03:54:14,883 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-12 03:54:14,883 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:54:14,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:54:14,883 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-02-12 03:54:14,883 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-12 03:54:14,884 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:54:14,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:54:14,984 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-12 03:54:14,985 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-12 03:54:14,989 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-12 03:54:14,991 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-02-12 03:54:14,992 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:14,992 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-12 03:54:14,992 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:54:14,992 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-02-12 03:54:14,992 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-02-12 03:54:14,992 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:14,992 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:14,993 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:14,993 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:54:14,993 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:54:14,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:54:14,993 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:14,993 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-12 03:54:14,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:14,994 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:14,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-12 03:54:14,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:14,994 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:14,994 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-02-12 03:54:14,994 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:14,995 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-02-12 03:54:14,995 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:54:14,995 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-02-12 03:54:14,995 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-12 03:54:14,995 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-12 03:54:14,995 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676174044109.008ac801462bd1c3f87556bf17bb0d46. 2023-02-12 03:54:14,995 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676174044109.008ac801462bd1c3f87556bf17bb0d46. started... 2023-02-12 03:54:14,995 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 008ac801462bd1c3f87556bf17bb0d46 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-12 03:54:15,417 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112051af1ffa19534979878cc37409ff9d6e to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015112051af1ffa19534979878cc37409ff9d6e 2023-02-12 03:54:15,826 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/008ac801462bd1c3f87556bf17bb0d46/.tmp/family1/fbf85ac316904eb499c755fb5cf80b74 2023-02-12 03:54:15,837 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/008ac801462bd1c3f87556bf17bb0d46/.tmp/family1/fbf85ac316904eb499c755fb5cf80b74 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/008ac801462bd1c3f87556bf17bb0d46/family1/fbf85ac316904eb499c755fb5cf80b74 2023-02-12 03:54:15,842 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/008ac801462bd1c3f87556bf17bb0d46/family1/fbf85ac316904eb499c755fb5cf80b74, entries=1, sequenceid=41, filesize=5.0 K 2023-02-12 03:54:15,842 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 008ac801462bd1c3f87556bf17bb0d46 in 847ms, sequenceid=41, compaction requested=true 2023-02-12 03:54:15,842 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 008ac801462bd1c3f87556bf17bb0d46: 2023-02-12 03:54:15,842 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676174044109.008ac801462bd1c3f87556bf17bb0d46. 2023-02-12 03:54:15,842 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-12 03:54:15,842 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-12 03:54:15,842 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:15,843 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-02-12 03:54:15,843 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-02-12 03:54:15,844 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:15,844 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:15,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:15,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:54:15,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:54:15,844 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:15,844 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 03:54:15,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:54:15,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:54:15,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:15,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:15,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:54:15,845 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-02-12 03:54:15,845 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@140b9deb[Count = 0] remaining members to acquire global barrier 2023-02-12 03:54:15,845 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-02-12 03:54:15,845 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:15,846 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:15,846 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:15,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:15,846 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-02-12 03:54:15,846 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-02-12 03:54:15,846 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase20.apache.org,39639,1676173982450' in zk 2023-02-12 03:54:15,846 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:15,846 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-12 03:54:15,847 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:15,847 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-02-12 03:54:15,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:15,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:54:15,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:54:15,847 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:54:15,847 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-02-12 03:54:15,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:54:15,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:54:15,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:15,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:15,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:54:15,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:15,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:15,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase20.apache.org,39639,1676173982450': 2023-02-12 03:54:15,849 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-02-12 03:54:15,849 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-02-12 03:54:15,849 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-12 03:54:15,849 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-12 03:54:15,849 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:15,849 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-12 03:54:15,850 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:15,850 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:15,850 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:15,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:15,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:54:15,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:54:15,850 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:54:15,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:15,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:54:15,851 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:54:15,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:54:15,851 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:15,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:15,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:15,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:54:15,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:15,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:15,852 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:15,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:54:15,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:15,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:15,853 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:15,853 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:54:15,853 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:54:15,853 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:15,853 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:54:15,853 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:15,853 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-12 03:54:15,853 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-12 03:54:15,853 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:54:15,853 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:15,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:54:15,853 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:15,853 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:15,853 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:15,853 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-02-12 03:54:15,854 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:54:15,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:54:15,854 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-12 03:54:15,954 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-12 03:54:15,955 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-12 03:54:15,956 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=40099] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:15,957 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676173985818] procedure2.ProcedureExecutor(1029): Stored pid=42, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-02-12 03:54:15,958 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=42, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-02-12 03:54:15,958 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676173985818] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-12 03:54:15,958 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=42, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1676174655958 2023-02-12 03:54:15,960 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676173985818] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-12 03:54:15,962 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676173985818] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-02-12 03:54:15,962 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676173985818] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-12 03:54:15,962 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676173985818] zookeeper.ReadOnlyZKClient(139): Connect 0x40cff254 to 127.0.0.1:59556 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 03:54:15,965 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676173985818] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3d22fecf, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 03:54:15,965 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-12 03:54:16,812 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010319f748b2ed8e402cb92a55cd3969c047 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2016010319f748b2ed8e402cb92a55cd3969c047 2023-02-12 03:54:16,813 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-12 03:54:16,823 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-12 03:54:16,824 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:52002, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-12 03:54:16,830 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-12 03:54:16,832 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:38292, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-12 03:54:16,843 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/c05b5ce8d0fa48eeb38878463f20de83 first=Optional[r3] last=Optional[r6] 2023-02-12 03:54:16,844 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676174044109.008ac801462bd1c3f87556bf17bb0d46., hostname=jenkins-hbase20.apache.org,39639,1676173982450, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/c05b5ce8d0fa48eeb38878463f20de83}] 2023-02-12 03:54:16,848 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/c05b5ce8d0fa48eeb38878463f20de83 for inclusion in 008ac801462bd1c3f87556bf17bb0d46/family1 2023-02-12 03:54:16,851 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-02-12 03:54:16,851 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HStore(777): Region bounds: first= last= 2023-02-12 03:54:16,851 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HRegion(2445): Flush status journal for 008ac801462bd1c3f87556bf17bb0d46: 2023-02-12 03:54:16,852 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/c05b5ce8d0fa48eeb38878463f20de83 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__69uhkb7eel8r7g9051g6qlp114i29umqv3khhvbcfkv6sfq6nvb9j2qm52uij8as/family1/c05b5ce8d0fa48eeb38878463f20de83 2023-02-12 03:54:16,854 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__69uhkb7eel8r7g9051g6qlp114i29umqv3khhvbcfkv6sfq6nvb9j2qm52uij8as/family1/c05b5ce8d0fa48eeb38878463f20de83 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/008ac801462bd1c3f87556bf17bb0d46/family1/0c90bf87bb0f49f1a88da985fffb6a82_SeqId_44_ 2023-02-12 03:54:16,855 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__69uhkb7eel8r7g9051g6qlp114i29umqv3khhvbcfkv6sfq6nvb9j2qm52uij8as/family1/c05b5ce8d0fa48eeb38878463f20de83 into 008ac801462bd1c3f87556bf17bb0d46/family1 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/008ac801462bd1c3f87556bf17bb0d46/family1/0c90bf87bb0f49f1a88da985fffb6a82_SeqId_44_ - updating store file list. 2023-02-12 03:54:16,858 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/008ac801462bd1c3f87556bf17bb0d46/family1/0c90bf87bb0f49f1a88da985fffb6a82_SeqId_44_ into 008ac801462bd1c3f87556bf17bb0d46/family1 2023-02-12 03:54:16,858 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__69uhkb7eel8r7g9051g6qlp114i29umqv3khhvbcfkv6sfq6nvb9j2qm52uij8as/family1/c05b5ce8d0fa48eeb38878463f20de83 into 008ac801462bd1c3f87556bf17bb0d46/family1 (new location: hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/008ac801462bd1c3f87556bf17bb0d46/family1/0c90bf87bb0f49f1a88da985fffb6a82_SeqId_44_) 2023-02-12 03:54:16,859 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__69uhkb7eel8r7g9051g6qlp114i29umqv3khhvbcfkv6sfq6nvb9j2qm52uij8as/family1/c05b5ce8d0fa48eeb38878463f20de83 2023-02-12 03:54:16,859 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-02-12 03:54:16,861 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51565 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-02-12 03:54:16,861 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HStore(1912): 008ac801462bd1c3f87556bf17bb0d46/family1 is initiating minor compaction 2023-02-12 03:54:16,861 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@5ee4c64c; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-12 03:54:16,862 INFO [RS:0;jenkins-hbase20:39639-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 008ac801462bd1c3f87556bf17bb0d46/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676174044109.008ac801462bd1c3f87556bf17bb0d46. 2023-02-12 03:54:16,862 INFO [RS:0;jenkins-hbase20:39639-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/008ac801462bd1c3f87556bf17bb0d46/family1/a10839e238dd4ab89180fc129d656c32, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/008ac801462bd1c3f87556bf17bb0d46/family1/7bb51d554b7b416c92ffa886125675d0, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/008ac801462bd1c3f87556bf17bb0d46/family1/39f0574d78db42309641c2b01980ffd9, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/008ac801462bd1c3f87556bf17bb0d46/family1/a08e8c9dba7147a89859d9c5ad8bc559, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/008ac801462bd1c3f87556bf17bb0d46/family1/89f0365d76004296ac762f2111a834be, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/008ac801462bd1c3f87556bf17bb0d46/family1/2e82c30d76ca41609e5598df6457a594, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/008ac801462bd1c3f87556bf17bb0d46/family1/efda3a4e00a34df3ba13e996c917cdc5, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/008ac801462bd1c3f87556bf17bb0d46/family1/af217d2940334ee4a55c896d11d37ac7, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/008ac801462bd1c3f87556bf17bb0d46/family1/fbf85ac316904eb499c755fb5cf80b74, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/008ac801462bd1c3f87556bf17bb0d46/family1/0c90bf87bb0f49f1a88da985fffb6a82_SeqId_44_] into tmpdir=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/008ac801462bd1c3f87556bf17bb0d46/.tmp, totalSize=50.4 K 2023-02-12 03:54:16,862 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] compactions.Compactor(207): Compacting a10839e238dd4ab89180fc129d656c32, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-02-12 03:54:16,862 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] compactions.Compactor(207): Compacting 7bb51d554b7b416c92ffa886125675d0, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-02-12 03:54:16,862 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] compactions.Compactor(207): Compacting 39f0574d78db42309641c2b01980ffd9, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-02-12 03:54:16,862 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] compactions.Compactor(207): Compacting a08e8c9dba7147a89859d9c5ad8bc559, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-02-12 03:54:16,862 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] compactions.Compactor(207): Compacting 89f0365d76004296ac762f2111a834be, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-02-12 03:54:16,862 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] compactions.Compactor(207): Compacting 2e82c30d76ca41609e5598df6457a594, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-02-12 03:54:16,862 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] compactions.Compactor(207): Compacting efda3a4e00a34df3ba13e996c917cdc5, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-02-12 03:54:16,862 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] compactions.Compactor(207): Compacting af217d2940334ee4a55c896d11d37ac7, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-02-12 03:54:16,862 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] compactions.Compactor(207): Compacting fbf85ac316904eb499c755fb5cf80b74, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-02-12 03:54:16,862 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] compactions.Compactor(207): Compacting 0c90bf87bb0f49f1a88da985fffb6a82_SeqId_44_, keycount=4, bloomtype=ROW, size=5.6 K, encoding=NONE, compression=NONE, seqNum=45 2023-02-12 03:54:16,863 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-12 03:54:16,864 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-12 03:54:16,865 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015122864e34b6cb3b9494292c6b72f540815e7 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015122864e34b6cb3b9494292c6b72f540815e7 2023-02-12 03:54:16,866 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015123194a1065e618848bdb37456469aa35583 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015123194a1065e618848bdb37456469aa35583 2023-02-12 03:54:16,867 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201601018f57d291f9f4402498dc603d1efaa434 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201601018f57d291f9f4402498dc603d1efaa434 2023-02-12 03:54:16,868 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201601035bec220e9bf841fd8d1ddb613f8e6d57 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201601035bec220e9bf841fd8d1ddb613f8e6d57 2023-02-12 03:54:16,868 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 4 expired mob files are deleted 2023-02-12 03:54:16,868 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-02-12 03:54:16,868 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-12 03:54:16,868 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-12 03:54:16,868 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-12 03:54:16,868 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-12 03:54:16,868 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-12 03:54:16,868 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-12 03:54:16,868 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-12 03:54:16,868 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-12 03:54:16,881 INFO [RS:0;jenkins-hbase20:39639-shortCompactions-0] throttle.PressureAwareThroughputController(145): 008ac801462bd1c3f87556bf17bb0d46#family1#compaction#61 average throughput is 0.79 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 80.77 MB/second 2023-02-12 03:54:17,697 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/008ac801462bd1c3f87556bf17bb0d46/.tmp/family1/c314538567794b138a523ddf4d12dfee as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/008ac801462bd1c3f87556bf17bb0d46/family1/c314538567794b138a523ddf4d12dfee 2023-02-12 03:54:17,703 INFO [RS:0;jenkins-hbase20:39639-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 008ac801462bd1c3f87556bf17bb0d46/family1 of 008ac801462bd1c3f87556bf17bb0d46 into c314538567794b138a523ddf4d12dfee(size=6.8 K), total size for store is 198.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-12 03:54:17,704 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 008ac801462bd1c3f87556bf17bb0d46: 2023-02-12 03:54:17,704 INFO [RS:0;jenkins-hbase20:39639-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676174044109.008ac801462bd1c3f87556bf17bb0d46., storeName=family1, fileCount=10, fileSize=50.4 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.6 K), priority=2, time=1676174056861; duration=0sec 2023-02-12 03:54:17,704 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-12 03:54:17,708 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120529476045785a4c2a811cdd9739c7cfaf to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015120529476045785a4c2a811cdd9739c7cfaf 2023-02-12 03:54:17,709 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-12 03:54:17,729 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/f9535dae03784b93af1b75fb34b2079e first=Optional[r00] last=Optional[r2] 2023-02-12 03:54:17,730 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676174044109.008ac801462bd1c3f87556bf17bb0d46., hostname=jenkins-hbase20.apache.org,39639,1676173982450, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/f9535dae03784b93af1b75fb34b2079e}] 2023-02-12 03:54:17,732 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/f9535dae03784b93af1b75fb34b2079e for inclusion in 008ac801462bd1c3f87556bf17bb0d46/family1 2023-02-12 03:54:17,734 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-02-12 03:54:17,734 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HStore(777): Region bounds: first= last= 2023-02-12 03:54:17,735 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HRegion(2445): Flush status journal for 008ac801462bd1c3f87556bf17bb0d46: 2023-02-12 03:54:17,735 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/f9535dae03784b93af1b75fb34b2079e to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__2kg0gjpk9dgpp45u1n4srq93gecmfal5kcltlj2cgsthv7f6ief95lv0jpknc298/family1/f9535dae03784b93af1b75fb34b2079e 2023-02-12 03:54:17,737 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__2kg0gjpk9dgpp45u1n4srq93gecmfal5kcltlj2cgsthv7f6ief95lv0jpknc298/family1/f9535dae03784b93af1b75fb34b2079e as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/008ac801462bd1c3f87556bf17bb0d46/family1/00ebf44d312d4fbeb177f49bdc15df7d_SeqId_47_ 2023-02-12 03:54:17,738 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__2kg0gjpk9dgpp45u1n4srq93gecmfal5kcltlj2cgsthv7f6ief95lv0jpknc298/family1/f9535dae03784b93af1b75fb34b2079e into 008ac801462bd1c3f87556bf17bb0d46/family1 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/008ac801462bd1c3f87556bf17bb0d46/family1/00ebf44d312d4fbeb177f49bdc15df7d_SeqId_47_ - updating store file list. 2023-02-12 03:54:17,741 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/008ac801462bd1c3f87556bf17bb0d46/family1/00ebf44d312d4fbeb177f49bdc15df7d_SeqId_47_ into 008ac801462bd1c3f87556bf17bb0d46/family1 2023-02-12 03:54:17,741 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__2kg0gjpk9dgpp45u1n4srq93gecmfal5kcltlj2cgsthv7f6ief95lv0jpknc298/family1/f9535dae03784b93af1b75fb34b2079e into 008ac801462bd1c3f87556bf17bb0d46/family1 (new location: hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/008ac801462bd1c3f87556bf17bb0d46/family1/00ebf44d312d4fbeb177f49bdc15df7d_SeqId_47_) 2023-02-12 03:54:17,742 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__2kg0gjpk9dgpp45u1n4srq93gecmfal5kcltlj2cgsthv7f6ief95lv0jpknc298/family1/f9535dae03784b93af1b75fb34b2079e 2023-02-12 03:54:17,742 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-02-12 03:54:17,743 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 399433 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-02-12 03:54:17,743 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HStore(1912): 008ac801462bd1c3f87556bf17bb0d46/family1 is initiating minor compaction (all files) 2023-02-12 03:54:17,743 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@792c82f9; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-12 03:54:17,743 INFO [RS:0;jenkins-hbase20:39639-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 008ac801462bd1c3f87556bf17bb0d46/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676174044109.008ac801462bd1c3f87556bf17bb0d46. 2023-02-12 03:54:17,743 INFO [RS:0;jenkins-hbase20:39639-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/008ac801462bd1c3f87556bf17bb0d46/family1/9db82be1f558448e85b26120c62b5cda, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/008ac801462bd1c3f87556bf17bb0d46/family1/c314538567794b138a523ddf4d12dfee, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/008ac801462bd1c3f87556bf17bb0d46/family1/00ebf44d312d4fbeb177f49bdc15df7d_SeqId_47_] into tmpdir=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/008ac801462bd1c3f87556bf17bb0d46/.tmp, totalSize=390.1 K 2023-02-12 03:54:17,744 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] compactions.Compactor(207): Compacting 9db82be1f558448e85b26120c62b5cda, keycount=1000, bloomtype=ROW, size=191.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878805947 2023-02-12 03:54:17,744 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] compactions.Compactor(207): Compacting c314538567794b138a523ddf4d12dfee, keycount=9, bloomtype=ROW, size=6.8 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621205947 2023-02-12 03:54:17,745 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] compactions.Compactor(207): Compacting 00ebf44d312d4fbeb177f49bdc15df7d_SeqId_47_, keycount=1002, bloomtype=ROW, size=191.8 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878805947 2023-02-12 03:54:17,745 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-12 03:54:17,746 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-12 03:54:17,747 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151130355eeffcb3674fbda0de4560a0df3b0c to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151130355eeffcb3674fbda0de4560a0df3b0c 2023-02-12 03:54:17,749 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015120106c556a723464b34927715ceb8c2c8dc to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015120106c556a723464b34927715ceb8c2c8dc 2023-02-12 03:54:17,750 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151205d4b8b13b06c245f2ab6d7284306b049b to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151205d4b8b13b06c245f2ab6d7284306b049b 2023-02-12 03:54:17,750 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 3 expired mob files are deleted 2023-02-12 03:54:17,750 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-02-12 03:54:17,751 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-12 03:54:17,751 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676173985818] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-12 03:54:17,751 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676173985818] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-12 03:54:17,752 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=42, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-02-12 03:54:17,759 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=42, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 1.7960 sec 2023-02-12 03:54:17,761 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/008ac801462bd1c3f87556bf17bb0d46/family1/a10839e238dd4ab89180fc129d656c32, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/008ac801462bd1c3f87556bf17bb0d46/family1/7bb51d554b7b416c92ffa886125675d0, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/008ac801462bd1c3f87556bf17bb0d46/family1/39f0574d78db42309641c2b01980ffd9, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/008ac801462bd1c3f87556bf17bb0d46/family1/a08e8c9dba7147a89859d9c5ad8bc559, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/008ac801462bd1c3f87556bf17bb0d46/family1/89f0365d76004296ac762f2111a834be, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/008ac801462bd1c3f87556bf17bb0d46/family1/2e82c30d76ca41609e5598df6457a594, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/008ac801462bd1c3f87556bf17bb0d46/family1/efda3a4e00a34df3ba13e996c917cdc5, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/008ac801462bd1c3f87556bf17bb0d46/family1/af217d2940334ee4a55c896d11d37ac7, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/008ac801462bd1c3f87556bf17bb0d46/family1/fbf85ac316904eb499c755fb5cf80b74, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/008ac801462bd1c3f87556bf17bb0d46/family1/0c90bf87bb0f49f1a88da985fffb6a82_SeqId_44_] to archive 2023-02-12 03:54:17,762 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-12 03:54:17,764 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/008ac801462bd1c3f87556bf17bb0d46/family1/a10839e238dd4ab89180fc129d656c32 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/008ac801462bd1c3f87556bf17bb0d46/family1/a10839e238dd4ab89180fc129d656c32 2023-02-12 03:54:17,767 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/008ac801462bd1c3f87556bf17bb0d46/family1/7bb51d554b7b416c92ffa886125675d0 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/008ac801462bd1c3f87556bf17bb0d46/family1/7bb51d554b7b416c92ffa886125675d0 2023-02-12 03:54:17,769 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/008ac801462bd1c3f87556bf17bb0d46/family1/39f0574d78db42309641c2b01980ffd9 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/008ac801462bd1c3f87556bf17bb0d46/family1/39f0574d78db42309641c2b01980ffd9 2023-02-12 03:54:17,770 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/008ac801462bd1c3f87556bf17bb0d46/family1/a08e8c9dba7147a89859d9c5ad8bc559 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/008ac801462bd1c3f87556bf17bb0d46/family1/a08e8c9dba7147a89859d9c5ad8bc559 2023-02-12 03:54:17,773 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/008ac801462bd1c3f87556bf17bb0d46/family1/89f0365d76004296ac762f2111a834be to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/008ac801462bd1c3f87556bf17bb0d46/family1/89f0365d76004296ac762f2111a834be 2023-02-12 03:54:17,775 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/008ac801462bd1c3f87556bf17bb0d46/family1/2e82c30d76ca41609e5598df6457a594 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/008ac801462bd1c3f87556bf17bb0d46/family1/2e82c30d76ca41609e5598df6457a594 2023-02-12 03:54:17,777 INFO [RS:0;jenkins-hbase20:39639-shortCompactions-0] throttle.PressureAwareThroughputController(145): 008ac801462bd1c3f87556bf17bb0d46#family1#compaction#62 average throughput is 13.89 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 80.77 MB/second 2023-02-12 03:54:17,778 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/008ac801462bd1c3f87556bf17bb0d46/family1/efda3a4e00a34df3ba13e996c917cdc5 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/008ac801462bd1c3f87556bf17bb0d46/family1/efda3a4e00a34df3ba13e996c917cdc5 2023-02-12 03:54:17,779 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/008ac801462bd1c3f87556bf17bb0d46/family1/af217d2940334ee4a55c896d11d37ac7 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/008ac801462bd1c3f87556bf17bb0d46/family1/af217d2940334ee4a55c896d11d37ac7 2023-02-12 03:54:17,780 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/008ac801462bd1c3f87556bf17bb0d46/family1/fbf85ac316904eb499c755fb5cf80b74 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/008ac801462bd1c3f87556bf17bb0d46/family1/fbf85ac316904eb499c755fb5cf80b74 2023-02-12 03:54:17,782 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/008ac801462bd1c3f87556bf17bb0d46/family1/0c90bf87bb0f49f1a88da985fffb6a82_SeqId_44_ to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/008ac801462bd1c3f87556bf17bb0d46/family1/0c90bf87bb0f49f1a88da985fffb6a82_SeqId_44_ 2023-02-12 03:54:17,788 DEBUG [hfile_cleaner-dir-scan-pool-0] cleaner.CleanerChore(483): Couldn't delete 'hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/008ac801462bd1c3f87556bf17bb0d46/family1' yet because it isn't empty w/exception. org.apache.hadoop.fs.PathIsNotEmptyDirectoryException: ``/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/008ac801462bd1c3f87556bf17bb0d46/family1 is non empty': Directory is not empty at org.apache.hadoop.hdfs.server.namenode.FSDirDeleteOp.delete(FSDirDeleteOp.java:115) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.delete(FSNamesystem.java:2873) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.delete(NameNodeRpcServer.java:1101) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.delete(ClientNamenodeProtocolServerSideTranslatorPB.java:648) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) ': Directory is not empty: `/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/008ac801462bd1c3f87556bf17bb0d46/family1 is non empty': Directory is not empty at org.apache.hadoop.hdfs.server.namenode.FSDirDeleteOp.delete(FSDirDeleteOp.java:115) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.delete(FSNamesystem.java:2873) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.delete(NameNodeRpcServer.java:1101) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.delete(ClientNamenodeProtocolServerSideTranslatorPB.java:648) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.delete(DFSClient.java:1595) at org.apache.hadoop.hdfs.DistributedFileSystem$19.doCall(DistributedFileSystem.java:881) at org.apache.hadoop.hdfs.DistributedFileSystem$19.doCall(DistributedFileSystem.java:878) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.delete(DistributedFileSystem.java:878) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.lambda$null$4(CleanerChore.java:453) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.deleteAction(CleanerChore.java:478) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.lambda$traverseAndDelete$5(CleanerChore.java:453) at org.apache.hadoop.hbase.util.FutureUtils.lambda$addListener$0(FutureUtils.java:68) at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774) at java.util.concurrent.CompletableFuture.uniWhenCompleteStage(CompletableFuture.java:792) at java.util.concurrent.CompletableFuture.whenComplete(CompletableFuture.java:2153) at org.apache.hadoop.hbase.util.FutureUtils.addListener(FutureUtils.java:61) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.traverseAndDelete(CleanerChore.java:439) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.lambda$null$2(CleanerChore.java:432) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.fs.PathIsNotEmptyDirectoryException): `/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/008ac801462bd1c3f87556bf17bb0d46/family1 is non empty': Directory is not empty at org.apache.hadoop.hdfs.server.namenode.FSDirDeleteOp.delete(FSDirDeleteOp.java:115) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.delete(FSNamesystem.java:2873) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.delete(NameNodeRpcServer.java:1101) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.delete(ClientNamenodeProtocolServerSideTranslatorPB.java:648) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy29.delete(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.delete(ClientNamenodeProtocolTranslatorPB.java:572) at sun.reflect.GeneratedMethodAccessor7.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy30.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor7.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor7.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor7.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor7.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor7.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor7.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.delete(DFSClient.java:1593) ... 17 more 2023-02-12 03:54:17,833 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.HMaster$12(2441): Client=jenkins//148.251.75.209 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-02-12 03:54:17,834 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] procedure2.ProcedureExecutor(1029): Stored pid=43, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:18,244 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-02-12 03:54:18,245 DEBUG [PEWorker-5] util.FSTableDescriptors(519): Deleted hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000001 2023-02-12 03:54:18,245 INFO [PEWorker-5] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-02-12 03:54:18,247 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=44, ppid=43, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly}] 2023-02-12 03:54:18,249 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=008ac801462bd1c3f87556bf17bb0d46, REOPEN/MOVE}] 2023-02-12 03:54:18,250 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=008ac801462bd1c3f87556bf17bb0d46, REOPEN/MOVE 2023-02-12 03:54:18,251 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=008ac801462bd1c3f87556bf17bb0d46, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:18,251 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676174044109.008ac801462bd1c3f87556bf17bb0d46.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1676174058251"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676174058251"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676174058251"}]},"ts":"1676174058251"} 2023-02-12 03:54:18,252 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=45, state=RUNNABLE; CloseRegionProcedure 008ac801462bd1c3f87556bf17bb0d46, server=jenkins-hbase20.apache.org,39639,1676173982450}] 2023-02-12 03:54:18,405 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(109): Close 008ac801462bd1c3f87556bf17bb0d46 2023-02-12 03:54:18,405 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 008ac801462bd1c3f87556bf17bb0d46, disabling compactions & flushes 2023-02-12 03:54:18,405 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1857): waiting for 1 compactions to complete for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676174044109.008ac801462bd1c3f87556bf17bb0d46. 2023-02-12 03:54:19,008 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/008ac801462bd1c3f87556bf17bb0d46/.tmp/family1/122871e2fc7a4b0baf9cfbf457563de0 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/008ac801462bd1c3f87556bf17bb0d46/family1/122871e2fc7a4b0baf9cfbf457563de0 2023-02-12 03:54:19,015 INFO [RS:0;jenkins-hbase20:39639-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 008ac801462bd1c3f87556bf17bb0d46/family1 of 008ac801462bd1c3f87556bf17bb0d46 into 122871e2fc7a4b0baf9cfbf457563de0(size=193.0 K), total size for store is 193.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-12 03:54:19,015 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 008ac801462bd1c3f87556bf17bb0d46: 2023-02-12 03:54:19,015 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676174044109.008ac801462bd1c3f87556bf17bb0d46. 2023-02-12 03:54:19,015 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676174044109.008ac801462bd1c3f87556bf17bb0d46. 2023-02-12 03:54:19,015 INFO [RS:0;jenkins-hbase20:39639-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676174044109.008ac801462bd1c3f87556bf17bb0d46., storeName=family1, fileCount=3, fileSize=390.1 K (191.4 K, 6.8 K, 191.8 K), priority=2, time=1676174057743; duration=1sec 2023-02-12 03:54:19,015 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676174044109.008ac801462bd1c3f87556bf17bb0d46. after waiting 0 ms 2023-02-12 03:54:19,015 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-12 03:54:19,015 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676174044109.008ac801462bd1c3f87556bf17bb0d46. 2023-02-12 03:54:19,016 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676174044109.008ac801462bd1c3f87556bf17bb0d46.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/008ac801462bd1c3f87556bf17bb0d46/family1/9db82be1f558448e85b26120c62b5cda, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/008ac801462bd1c3f87556bf17bb0d46/family1/c314538567794b138a523ddf4d12dfee, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/008ac801462bd1c3f87556bf17bb0d46/family1/00ebf44d312d4fbeb177f49bdc15df7d_SeqId_47_] to archive 2023-02-12 03:54:19,017 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676174044109.008ac801462bd1c3f87556bf17bb0d46.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-02-12 03:54:19,019 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676174044109.008ac801462bd1c3f87556bf17bb0d46.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/008ac801462bd1c3f87556bf17bb0d46/family1/9db82be1f558448e85b26120c62b5cda to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/008ac801462bd1c3f87556bf17bb0d46/family1/9db82be1f558448e85b26120c62b5cda 2023-02-12 03:54:19,021 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676174044109.008ac801462bd1c3f87556bf17bb0d46.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/008ac801462bd1c3f87556bf17bb0d46/family1/c314538567794b138a523ddf4d12dfee to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/008ac801462bd1c3f87556bf17bb0d46/family1/c314538567794b138a523ddf4d12dfee 2023-02-12 03:54:19,022 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676174044109.008ac801462bd1c3f87556bf17bb0d46.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/008ac801462bd1c3f87556bf17bb0d46/family1/00ebf44d312d4fbeb177f49bdc15df7d_SeqId_47_ to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/008ac801462bd1c3f87556bf17bb0d46/family1/00ebf44d312d4fbeb177f49bdc15df7d_SeqId_47_ 2023-02-12 03:54:19,029 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/008ac801462bd1c3f87556bf17bb0d46/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-02-12 03:54:19,030 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676174044109.008ac801462bd1c3f87556bf17bb0d46. 2023-02-12 03:54:19,030 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 008ac801462bd1c3f87556bf17bb0d46: Waiting for close lock at 1676174058405Running coprocessor pre-close hooks at 1676174058405Disabling compacts and flushes for region at 1676174058405Disabling writes for close at 1676174059015 (+610 ms)Writing region close event to WAL at 1676174059025 (+10 ms)Running coprocessor post-close hooks at 1676174059030 (+5 ms)Closed at 1676174059030 2023-02-12 03:54:19,030 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(3509): Not adding moved region record: 008ac801462bd1c3f87556bf17bb0d46 to self. 2023-02-12 03:54:19,032 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(147): Closed 008ac801462bd1c3f87556bf17bb0d46 2023-02-12 03:54:19,033 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=008ac801462bd1c3f87556bf17bb0d46, regionState=CLOSED 2023-02-12 03:54:19,033 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676174044109.008ac801462bd1c3f87556bf17bb0d46.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1676174059033"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676174059033"}]},"ts":"1676174059033"} 2023-02-12 03:54:19,037 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=45 2023-02-12 03:54:19,037 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=45, state=SUCCESS; CloseRegionProcedure 008ac801462bd1c3f87556bf17bb0d46, server=jenkins-hbase20.apache.org,39639,1676173982450 in 783 msec 2023-02-12 03:54:19,038 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=008ac801462bd1c3f87556bf17bb0d46, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase20.apache.org,39639,1676173982450; forceNewPlan=false, retain=true 2023-02-12 03:54:19,189 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=008ac801462bd1c3f87556bf17bb0d46, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:19,189 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676174044109.008ac801462bd1c3f87556bf17bb0d46.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1676174059189"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676174059189"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676174059189"}]},"ts":"1676174059189"} 2023-02-12 03:54:19,191 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=47, ppid=45, state=RUNNABLE; OpenRegionProcedure 008ac801462bd1c3f87556bf17bb0d46, server=jenkins-hbase20.apache.org,39639,1676173982450}] 2023-02-12 03:54:19,349 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676174044109.008ac801462bd1c3f87556bf17bb0d46. 2023-02-12 03:54:19,350 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 008ac801462bd1c3f87556bf17bb0d46, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676174044109.008ac801462bd1c3f87556bf17bb0d46.', STARTKEY => '', ENDKEY => ''} 2023-02-12 03:54:19,350 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 008ac801462bd1c3f87556bf17bb0d46 2023-02-12 03:54:19,350 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676174044109.008ac801462bd1c3f87556bf17bb0d46.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:54:19,351 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 008ac801462bd1c3f87556bf17bb0d46 2023-02-12 03:54:19,351 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 008ac801462bd1c3f87556bf17bb0d46 2023-02-12 03:54:19,353 INFO [StoreOpener-008ac801462bd1c3f87556bf17bb0d46-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 008ac801462bd1c3f87556bf17bb0d46 2023-02-12 03:54:19,355 DEBUG [StoreOpener-008ac801462bd1c3f87556bf17bb0d46-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/008ac801462bd1c3f87556bf17bb0d46/family1 2023-02-12 03:54:19,355 DEBUG [StoreOpener-008ac801462bd1c3f87556bf17bb0d46-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/008ac801462bd1c3f87556bf17bb0d46/family1 2023-02-12 03:54:19,356 INFO [StoreOpener-008ac801462bd1c3f87556bf17bb0d46-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 008ac801462bd1c3f87556bf17bb0d46 columnFamilyName family1 2023-02-12 03:54:19,368 DEBUG [StoreOpener-008ac801462bd1c3f87556bf17bb0d46-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/008ac801462bd1c3f87556bf17bb0d46/family1/122871e2fc7a4b0baf9cfbf457563de0 2023-02-12 03:54:19,368 INFO [StoreOpener-008ac801462bd1c3f87556bf17bb0d46-1] regionserver.HStore(310): Store=008ac801462bd1c3f87556bf17bb0d46/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:54:19,370 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/008ac801462bd1c3f87556bf17bb0d46 2023-02-12 03:54:19,371 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/008ac801462bd1c3f87556bf17bb0d46 2023-02-12 03:54:19,376 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 008ac801462bd1c3f87556bf17bb0d46 2023-02-12 03:54:19,377 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 008ac801462bd1c3f87556bf17bb0d46; next sequenceid=51; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60329617, jitterRate=-0.10101865231990814}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-12 03:54:19,377 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 008ac801462bd1c3f87556bf17bb0d46: Running coprocessor pre-open hook at 1676174059351Writing region info on filesystem at 1676174059351Initializing all the Stores at 1676174059352 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} at 1676174059353 (+1 ms)Cleaning up temporary data from old regions at 1676174059372 (+19 ms)Cleaning up detritus from prior splits at 1676174059373 (+1 ms)Running coprocessor post-open hooks at 1676174059377 (+4 ms)Region opened successfully at 1676174059377 2023-02-12 03:54:19,378 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676174044109.008ac801462bd1c3f87556bf17bb0d46., pid=47, masterSystemTime=1676174059343 2023-02-12 03:54:19,380 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676174044109.008ac801462bd1c3f87556bf17bb0d46. 2023-02-12 03:54:19,380 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676174044109.008ac801462bd1c3f87556bf17bb0d46. 2023-02-12 03:54:19,380 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=008ac801462bd1c3f87556bf17bb0d46, regionState=OPEN, openSeqNum=51, regionLocation=jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:19,380 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676174044109.008ac801462bd1c3f87556bf17bb0d46.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1676174059380"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676174059380"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676174059380"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676174059380"}]},"ts":"1676174059380"} 2023-02-12 03:54:19,384 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=47, resume processing ppid=45 2023-02-12 03:54:19,384 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=47, ppid=45, state=SUCCESS; OpenRegionProcedure 008ac801462bd1c3f87556bf17bb0d46, server=jenkins-hbase20.apache.org,39639,1676173982450 in 191 msec 2023-02-12 03:54:19,385 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=44 2023-02-12 03:54:19,385 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=44, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=008ac801462bd1c3f87556bf17bb0d46, REOPEN/MOVE in 1.1350 sec 2023-02-12 03:54:19,387 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=43 2023-02-12 03:54:19,387 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=43, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 1.1390 sec 2023-02-12 03:54:19,389 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=43, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 1.5550 sec 2023-02-12 03:54:19,390 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(1227): Checking to see if procedure is done pid=43 2023-02-12 03:54:19,392 INFO [Listener at localhost.localdomain/41049] compactions.TestMobCompactor(278): alter status finished 2023-02-12 03:54:19,393 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=40099] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:19,395 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676173985818] procedure2.ProcedureExecutor(1029): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-02-12 03:54:19,396 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-02-12 03:54:19,397 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1676174659397 2023-02-12 03:54:19,397 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676173985818] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-12 03:54:19,398 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676173985818] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-12 03:54:19,399 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676173985818] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-02-12 03:54:19,399 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676173985818] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-12 03:54:19,400 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676173985818] zookeeper.ReadOnlyZKClient(139): Connect 0x6e021d5e to 127.0.0.1:59556 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 03:54:19,403 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676173985818] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@447c52d7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 03:54:19,404 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-12 03:54:19,404 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-12 03:54:19,404 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-12 03:54:19,404 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-12 03:54:19,404 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-12 03:54:20,234 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128651d42cefc984a13855e85c24d782681 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151128651d42cefc984a13855e85c24d782681 2023-02-12 03:54:20,235 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-12 03:54:20,248 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-12 03:54:20,249 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:52010, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-12 03:54:20,256 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-12 03:54:20,257 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:38304, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-12 03:54:20,267 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/11cd01bdff0e43e08857cde13e2dcae5 first=Optional[r05] last=Optional[r8] 2023-02-12 03:54:20,267 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676174044109.008ac801462bd1c3f87556bf17bb0d46., hostname=jenkins-hbase20.apache.org,39639,1676173982450, seqNum=51 for row with hfile group [{family1,hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/11cd01bdff0e43e08857cde13e2dcae5}] 2023-02-12 03:54:20,273 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/11cd01bdff0e43e08857cde13e2dcae5 for inclusion in 008ac801462bd1c3f87556bf17bb0d46/family1 2023-02-12 03:54:20,275 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-02-12 03:54:20,275 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HStore(777): Region bounds: first= last= 2023-02-12 03:54:20,276 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HRegion(2445): Flush status journal for 008ac801462bd1c3f87556bf17bb0d46: 2023-02-12 03:54:20,277 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/11cd01bdff0e43e08857cde13e2dcae5 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__lkndvfu7kh3b1k3fj5u2vlb0o66ktll7vo9k85doahcsperkgf8aplo1mg709p30/family1/11cd01bdff0e43e08857cde13e2dcae5 2023-02-12 03:54:20,280 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__lkndvfu7kh3b1k3fj5u2vlb0o66ktll7vo9k85doahcsperkgf8aplo1mg709p30/family1/11cd01bdff0e43e08857cde13e2dcae5 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/008ac801462bd1c3f87556bf17bb0d46/family1/1ce004d116514acf8bfcf3a49cc8de3d_SeqId_53_ 2023-02-12 03:54:20,281 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__lkndvfu7kh3b1k3fj5u2vlb0o66ktll7vo9k85doahcsperkgf8aplo1mg709p30/family1/11cd01bdff0e43e08857cde13e2dcae5 into 008ac801462bd1c3f87556bf17bb0d46/family1 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/008ac801462bd1c3f87556bf17bb0d46/family1/1ce004d116514acf8bfcf3a49cc8de3d_SeqId_53_ - updating store file list. 2023-02-12 03:54:20,285 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/008ac801462bd1c3f87556bf17bb0d46/family1/1ce004d116514acf8bfcf3a49cc8de3d_SeqId_53_ into 008ac801462bd1c3f87556bf17bb0d46/family1 2023-02-12 03:54:20,285 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__lkndvfu7kh3b1k3fj5u2vlb0o66ktll7vo9k85doahcsperkgf8aplo1mg709p30/family1/11cd01bdff0e43e08857cde13e2dcae5 into 008ac801462bd1c3f87556bf17bb0d46/family1 (new location: hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/008ac801462bd1c3f87556bf17bb0d46/family1/1ce004d116514acf8bfcf3a49cc8de3d_SeqId_53_) 2023-02-12 03:54:20,286 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__lkndvfu7kh3b1k3fj5u2vlb0o66ktll7vo9k85doahcsperkgf8aplo1mg709p30/family1/11cd01bdff0e43e08857cde13e2dcae5 2023-02-12 03:54:20,288 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-12 03:54:20,289 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-12 03:54:20,290 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015112051af1ffa19534979878cc37409ff9d6e to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015112051af1ffa19534979878cc37409ff9d6e 2023-02-12 03:54:20,292 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151128d64665e51c8d4c9cabe0eea3f4812c23 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151128d64665e51c8d4c9cabe0eea3f4812c23 2023-02-12 03:54:20,292 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2 expired mob files are deleted 2023-02-12 03:54:20,292 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-02-12 03:54:20,292 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-12 03:54:20,292 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-12 03:54:20,292 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-12 03:54:20,292 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676173985818] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-12 03:54:20,292 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676173985818] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-12 03:54:20,293 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-02-12 03:54:20,295 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 899 msec 2023-02-12 03:54:20,360 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.HMaster$12(2441): Client=jenkins//148.251.75.209 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-02-12 03:54:20,361 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] procedure2.ProcedureExecutor(1029): Stored pid=49, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:20,773 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000003 2023-02-12 03:54:20,775 DEBUG [PEWorker-2] util.FSTableDescriptors(519): Deleted hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-02-12 03:54:20,776 INFO [PEWorker-2] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000003 2023-02-12 03:54:20,780 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=50, ppid=49, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly}] 2023-02-12 03:54:20,784 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=008ac801462bd1c3f87556bf17bb0d46, REOPEN/MOVE}] 2023-02-12 03:54:20,785 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=008ac801462bd1c3f87556bf17bb0d46, REOPEN/MOVE 2023-02-12 03:54:20,786 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=008ac801462bd1c3f87556bf17bb0d46, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:20,786 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676174044109.008ac801462bd1c3f87556bf17bb0d46.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1676174060786"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676174060786"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676174060786"}]},"ts":"1676174060786"} 2023-02-12 03:54:20,789 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE; CloseRegionProcedure 008ac801462bd1c3f87556bf17bb0d46, server=jenkins-hbase20.apache.org,39639,1676173982450}] 2023-02-12 03:54:20,941 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(109): Close 008ac801462bd1c3f87556bf17bb0d46 2023-02-12 03:54:20,942 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 008ac801462bd1c3f87556bf17bb0d46, disabling compactions & flushes 2023-02-12 03:54:20,942 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676174044109.008ac801462bd1c3f87556bf17bb0d46. 2023-02-12 03:54:20,942 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676174044109.008ac801462bd1c3f87556bf17bb0d46. 2023-02-12 03:54:20,942 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676174044109.008ac801462bd1c3f87556bf17bb0d46. after waiting 0 ms 2023-02-12 03:54:20,942 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676174044109.008ac801462bd1c3f87556bf17bb0d46. 2023-02-12 03:54:20,949 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/008ac801462bd1c3f87556bf17bb0d46/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=50 2023-02-12 03:54:20,950 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676174044109.008ac801462bd1c3f87556bf17bb0d46. 2023-02-12 03:54:20,950 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 008ac801462bd1c3f87556bf17bb0d46: Waiting for close lock at 1676174060942Running coprocessor pre-close hooks at 1676174060942Disabling compacts and flushes for region at 1676174060942Disabling writes for close at 1676174060942Writing region close event to WAL at 1676174060945 (+3 ms)Running coprocessor post-close hooks at 1676174060950 (+5 ms)Closed at 1676174060950 2023-02-12 03:54:20,950 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(3509): Not adding moved region record: 008ac801462bd1c3f87556bf17bb0d46 to self. 2023-02-12 03:54:20,952 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(147): Closed 008ac801462bd1c3f87556bf17bb0d46 2023-02-12 03:54:20,953 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=008ac801462bd1c3f87556bf17bb0d46, regionState=CLOSED 2023-02-12 03:54:20,953 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676174044109.008ac801462bd1c3f87556bf17bb0d46.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1676174060953"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676174060953"}]},"ts":"1676174060953"} 2023-02-12 03:54:20,957 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=51 2023-02-12 03:54:20,957 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=51, state=SUCCESS; CloseRegionProcedure 008ac801462bd1c3f87556bf17bb0d46, server=jenkins-hbase20.apache.org,39639,1676173982450 in 166 msec 2023-02-12 03:54:20,958 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=008ac801462bd1c3f87556bf17bb0d46, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase20.apache.org,39639,1676173982450; forceNewPlan=false, retain=true 2023-02-12 03:54:21,108 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=008ac801462bd1c3f87556bf17bb0d46, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:21,109 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676174044109.008ac801462bd1c3f87556bf17bb0d46.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1676174061108"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676174061108"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676174061108"}]},"ts":"1676174061108"} 2023-02-12 03:54:21,112 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=53, ppid=51, state=RUNNABLE; OpenRegionProcedure 008ac801462bd1c3f87556bf17bb0d46, server=jenkins-hbase20.apache.org,39639,1676173982450}] 2023-02-12 03:54:21,271 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676174044109.008ac801462bd1c3f87556bf17bb0d46. 2023-02-12 03:54:21,271 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 008ac801462bd1c3f87556bf17bb0d46, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676174044109.008ac801462bd1c3f87556bf17bb0d46.', STARTKEY => '', ENDKEY => ''} 2023-02-12 03:54:21,272 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 008ac801462bd1c3f87556bf17bb0d46 2023-02-12 03:54:21,272 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676174044109.008ac801462bd1c3f87556bf17bb0d46.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:54:21,272 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 008ac801462bd1c3f87556bf17bb0d46 2023-02-12 03:54:21,272 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 008ac801462bd1c3f87556bf17bb0d46 2023-02-12 03:54:21,275 INFO [StoreOpener-008ac801462bd1c3f87556bf17bb0d46-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 008ac801462bd1c3f87556bf17bb0d46 2023-02-12 03:54:21,277 DEBUG [StoreOpener-008ac801462bd1c3f87556bf17bb0d46-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/008ac801462bd1c3f87556bf17bb0d46/family1 2023-02-12 03:54:21,277 DEBUG [StoreOpener-008ac801462bd1c3f87556bf17bb0d46-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/008ac801462bd1c3f87556bf17bb0d46/family1 2023-02-12 03:54:21,277 INFO [StoreOpener-008ac801462bd1c3f87556bf17bb0d46-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 008ac801462bd1c3f87556bf17bb0d46 columnFamilyName family1 2023-02-12 03:54:21,288 DEBUG [StoreOpener-008ac801462bd1c3f87556bf17bb0d46-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/008ac801462bd1c3f87556bf17bb0d46/family1/122871e2fc7a4b0baf9cfbf457563de0 2023-02-12 03:54:21,294 DEBUG [StoreOpener-008ac801462bd1c3f87556bf17bb0d46-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/008ac801462bd1c3f87556bf17bb0d46/family1/1ce004d116514acf8bfcf3a49cc8de3d_SeqId_53_ 2023-02-12 03:54:21,294 INFO [StoreOpener-008ac801462bd1c3f87556bf17bb0d46-1] regionserver.HStore(310): Store=008ac801462bd1c3f87556bf17bb0d46/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:54:21,296 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/008ac801462bd1c3f87556bf17bb0d46 2023-02-12 03:54:21,298 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/008ac801462bd1c3f87556bf17bb0d46 2023-02-12 03:54:21,301 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 008ac801462bd1c3f87556bf17bb0d46 2023-02-12 03:54:21,302 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 008ac801462bd1c3f87556bf17bb0d46; next sequenceid=56; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68771653, jitterRate=0.02477748692035675}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-12 03:54:21,302 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 008ac801462bd1c3f87556bf17bb0d46: Running coprocessor pre-open hook at 1676174061272Writing region info on filesystem at 1676174061272Initializing all the Stores at 1676174061274 (+2 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} at 1676174061274Cleaning up temporary data from old regions at 1676174061298 (+24 ms)Cleaning up detritus from prior splits at 1676174061299 (+1 ms)Running coprocessor post-open hooks at 1676174061302 (+3 ms)Region opened successfully at 1676174061302 2023-02-12 03:54:21,303 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676174044109.008ac801462bd1c3f87556bf17bb0d46., pid=53, masterSystemTime=1676174061266 2023-02-12 03:54:21,304 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676174044109.008ac801462bd1c3f87556bf17bb0d46. 2023-02-12 03:54:21,304 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676174044109.008ac801462bd1c3f87556bf17bb0d46. 2023-02-12 03:54:21,305 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=008ac801462bd1c3f87556bf17bb0d46, regionState=OPEN, openSeqNum=56, regionLocation=jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:21,305 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676174044109.008ac801462bd1c3f87556bf17bb0d46.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1676174061305"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676174061305"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676174061305"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676174061305"}]},"ts":"1676174061305"} 2023-02-12 03:54:21,308 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=51 2023-02-12 03:54:21,308 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=51, state=SUCCESS; OpenRegionProcedure 008ac801462bd1c3f87556bf17bb0d46, server=jenkins-hbase20.apache.org,39639,1676173982450 in 194 msec 2023-02-12 03:54:21,310 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=51, resume processing ppid=50 2023-02-12 03:54:21,310 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=51, ppid=50, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=008ac801462bd1c3f87556bf17bb0d46, REOPEN/MOVE in 524 msec 2023-02-12 03:54:21,312 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=50, resume processing ppid=49 2023-02-12 03:54:21,312 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=50, ppid=49, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 530 msec 2023-02-12 03:54:21,314 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=49, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 952 msec 2023-02-12 03:54:21,315 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(1227): Checking to see if procedure is done pid=49 2023-02-12 03:54:21,316 INFO [Listener at localhost.localdomain/41049] compactions.TestMobCompactor(278): alter status finished 2023-02-12 03:54:21,317 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=40099] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-12 03:54:21,318 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676173985818] procedure2.ProcedureExecutor(1029): Stored pid=54, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-02-12 03:54:21,318 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=54, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-02-12 03:54:21,319 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676173985818] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-12 03:54:21,319 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=54, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1676174661319 2023-02-12 03:54:21,320 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676173985818] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-12 03:54:21,320 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676173985818] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 4 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-02-12 03:54:21,320 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676173985818] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-12 03:54:21,321 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676173985818] zookeeper.ReadOnlyZKClient(139): Connect 0x6a9448d4 to 127.0.0.1:59556 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 03:54:21,324 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676173985818] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4cd845bb, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 03:54:21,324 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-12 03:54:21,324 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-12 03:54:21,324 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-12 03:54:21,324 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-12 03:54:21,324 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-12 03:54:21,324 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-12 03:54:21,325 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-12 03:54:21,325 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-12 03:54:21,325 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676173985818] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-12 03:54:21,325 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676173985818] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-12 03:54:21,326 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=54, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-02-12 03:54:21,328 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=54, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 9 msec 2023-02-12 03:54:21,385 INFO [Listener at localhost.localdomain/41049] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly Thread=243 (was 251), OpenFileDescriptor=615 (was 607) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=244 (was 304), ProcessCount=164 (was 164), AvailableMemoryMB=4111 (was 4122) 2023-02-12 03:54:21,395 INFO [Listener at localhost.localdomain/41049] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily Thread=243, OpenFileDescriptor=615, MaxFileDescriptor=60000, SystemLoadAverage=244, ProcessCount=164, AvailableMemoryMB=4110 2023-02-12 03:54:21,397 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.HMaster$4(2102): Client=jenkins//148.251.75.209 create 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-02-12 03:54:21,397 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] procedure2.ProcedureExecutor(1029): Stored pid=55, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:21,399 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_PRE_OPERATION 2023-02-12 03:54:21,399 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(697): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily" procId is: 55 2023-02-12 03:54:21,399 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-12 03:54:21,400 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-02-12 03:54:21,401 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/38bfa684335ca214a06d15565b8cb87b 2023-02-12 03:54:21,401 DEBUG [HFileArchiver-10] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/38bfa684335ca214a06d15565b8cb87b empty. 2023-02-12 03:54:21,401 DEBUG [HFileArchiver-10] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/38bfa684335ca214a06d15565b8cb87b 2023-02-12 03:54:21,401 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily regions 2023-02-12 03:54:21,501 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-02-12 03:54:21,703 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-02-12 03:54:21,809 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000001 2023-02-12 03:54:21,811 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(7671): creating {ENCODED => 38bfa684335ca214a06d15565b8cb87b, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676174061396.38bfa684335ca214a06d15565b8cb87b.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/.tmp 2023-02-12 03:54:22,005 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-02-12 03:54:22,220 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676174061396.38bfa684335ca214a06d15565b8cb87b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:54:22,221 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1603): Closing 38bfa684335ca214a06d15565b8cb87b, disabling compactions & flushes 2023-02-12 03:54:22,221 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676174061396.38bfa684335ca214a06d15565b8cb87b. 2023-02-12 03:54:22,221 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676174061396.38bfa684335ca214a06d15565b8cb87b. 2023-02-12 03:54:22,221 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676174061396.38bfa684335ca214a06d15565b8cb87b. after waiting 0 ms 2023-02-12 03:54:22,221 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676174061396.38bfa684335ca214a06d15565b8cb87b. 2023-02-12 03:54:22,221 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676174061396.38bfa684335ca214a06d15565b8cb87b. 2023-02-12 03:54:22,222 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1557): Region close journal for 38bfa684335ca214a06d15565b8cb87b: Waiting for close lock at 1676174062221Disabling compacts and flushes for region at 1676174062221Disabling writes for close at 1676174062221Writing region close event to WAL at 1676174062221Closed at 1676174062221 2023-02-12 03:54:22,224 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_ADD_TO_META 2023-02-12 03:54:22,225 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676174061396.38bfa684335ca214a06d15565b8cb87b.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1676174062224"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676174062224"}]},"ts":"1676174062224"} 2023-02-12 03:54:22,226 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-12 03:54:22,226 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-12 03:54:22,226 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676174062226"}]},"ts":"1676174062226"} 2023-02-12 03:54:22,227 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, state=ENABLING in hbase:meta 2023-02-12 03:54:22,229 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=38bfa684335ca214a06d15565b8cb87b, ASSIGN}] 2023-02-12 03:54:22,230 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=38bfa684335ca214a06d15565b8cb87b, ASSIGN 2023-02-12 03:54:22,230 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=38bfa684335ca214a06d15565b8cb87b, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,39639,1676173982450; forceNewPlan=false, retain=false 2023-02-12 03:54:22,382 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=56 updating hbase:meta row=38bfa684335ca214a06d15565b8cb87b, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:22,383 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676174061396.38bfa684335ca214a06d15565b8cb87b.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1676174062382"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676174062382"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676174062382"}]},"ts":"1676174062382"} 2023-02-12 03:54:22,386 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=57, ppid=56, state=RUNNABLE; OpenRegionProcedure 38bfa684335ca214a06d15565b8cb87b, server=jenkins-hbase20.apache.org,39639,1676173982450}] 2023-02-12 03:54:22,507 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-02-12 03:54:22,544 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676174061396.38bfa684335ca214a06d15565b8cb87b. 2023-02-12 03:54:22,544 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 38bfa684335ca214a06d15565b8cb87b, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676174061396.38bfa684335ca214a06d15565b8cb87b.', STARTKEY => '', ENDKEY => ''} 2023-02-12 03:54:22,545 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 38bfa684335ca214a06d15565b8cb87b 2023-02-12 03:54:22,545 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676174061396.38bfa684335ca214a06d15565b8cb87b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:54:22,545 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 38bfa684335ca214a06d15565b8cb87b 2023-02-12 03:54:22,545 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 38bfa684335ca214a06d15565b8cb87b 2023-02-12 03:54:22,547 INFO [StoreOpener-38bfa684335ca214a06d15565b8cb87b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 38bfa684335ca214a06d15565b8cb87b 2023-02-12 03:54:22,550 DEBUG [StoreOpener-38bfa684335ca214a06d15565b8cb87b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/38bfa684335ca214a06d15565b8cb87b/family1 2023-02-12 03:54:22,550 DEBUG [StoreOpener-38bfa684335ca214a06d15565b8cb87b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/38bfa684335ca214a06d15565b8cb87b/family1 2023-02-12 03:54:22,551 INFO [StoreOpener-38bfa684335ca214a06d15565b8cb87b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 38bfa684335ca214a06d15565b8cb87b columnFamilyName family1 2023-02-12 03:54:22,554 INFO [StoreOpener-38bfa684335ca214a06d15565b8cb87b-1] regionserver.HStore(310): Store=38bfa684335ca214a06d15565b8cb87b/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:54:22,556 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/38bfa684335ca214a06d15565b8cb87b 2023-02-12 03:54:22,557 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/38bfa684335ca214a06d15565b8cb87b 2023-02-12 03:54:22,564 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 38bfa684335ca214a06d15565b8cb87b 2023-02-12 03:54:22,567 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/38bfa684335ca214a06d15565b8cb87b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 03:54:22,568 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 38bfa684335ca214a06d15565b8cb87b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73010252, jitterRate=0.08793753385543823}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-12 03:54:22,568 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 38bfa684335ca214a06d15565b8cb87b: Running coprocessor pre-open hook at 1676174062545Writing region info on filesystem at 1676174062545Initializing all the Stores at 1676174062546 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} at 1676174062547 (+1 ms)Cleaning up temporary data from old regions at 1676174062558 (+11 ms)Cleaning up detritus from prior splits at 1676174062559 (+1 ms)Running coprocessor post-open hooks at 1676174062568 (+9 ms)Region opened successfully at 1676174062568 2023-02-12 03:54:22,568 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676174061396.38bfa684335ca214a06d15565b8cb87b., pid=57, masterSystemTime=1676174062540 2023-02-12 03:54:22,570 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676174061396.38bfa684335ca214a06d15565b8cb87b. 2023-02-12 03:54:22,570 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676174061396.38bfa684335ca214a06d15565b8cb87b. 2023-02-12 03:54:22,570 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=56 updating hbase:meta row=38bfa684335ca214a06d15565b8cb87b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:22,570 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676174061396.38bfa684335ca214a06d15565b8cb87b.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1676174062570"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676174062570"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676174062570"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676174062570"}]},"ts":"1676174062570"} 2023-02-12 03:54:22,573 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=57, resume processing ppid=56 2023-02-12 03:54:22,573 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=57, ppid=56, state=SUCCESS; OpenRegionProcedure 38bfa684335ca214a06d15565b8cb87b, server=jenkins-hbase20.apache.org,39639,1676173982450 in 186 msec 2023-02-12 03:54:22,575 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=56, resume processing ppid=55 2023-02-12 03:54:22,575 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=56, ppid=55, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=38bfa684335ca214a06d15565b8cb87b, ASSIGN in 344 msec 2023-02-12 03:54:22,575 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-12 03:54:22,576 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676174062576"}]},"ts":"1676174062576"} 2023-02-12 03:54:22,577 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, state=ENABLED in hbase:meta 2023-02-12 03:54:22,579 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_POST_OPERATION 2023-02-12 03:54:22,580 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=55, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 1.1820 sec 2023-02-12 03:54:23,508 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-02-12 03:54:23,509 INFO [Listener at localhost.localdomain/41049] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, procId: 55 completed 2023-02-12 03:54:23,535 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-12 03:54:23,544 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:23,544 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-12 03:54:23,544 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:54:23,544 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-02-12 03:54:23,544 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-02-12 03:54:23,544 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:23,544 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:23,545 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:23,545 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:54:23,545 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:54:23,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:54:23,545 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:23,545 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-12 03:54:23,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:23,545 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:23,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-12 03:54:23,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:23,546 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:23,546 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:23,546 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-02-12 03:54:23,546 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:54:23,546 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-02-12 03:54:23,546 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-12 03:54:23,546 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-12 03:54:23,546 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676174061396.38bfa684335ca214a06d15565b8cb87b. 2023-02-12 03:54:23,546 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676174061396.38bfa684335ca214a06d15565b8cb87b. started... 2023-02-12 03:54:23,547 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 38bfa684335ca214a06d15565b8cb87b 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-02-12 03:54:23,973 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015113013c6859167184c2e954f1eb1e34a2fd7 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015113013c6859167184c2e954f1eb1e34a2fd7 2023-02-12 03:54:24,377 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/38bfa684335ca214a06d15565b8cb87b/.tmp/family1/79b25bb0af414d92b854ab244f1efe9e 2023-02-12 03:54:24,384 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/38bfa684335ca214a06d15565b8cb87b/.tmp/family1/79b25bb0af414d92b854ab244f1efe9e as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/38bfa684335ca214a06d15565b8cb87b/family1/79b25bb0af414d92b854ab244f1efe9e 2023-02-12 03:54:24,390 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/38bfa684335ca214a06d15565b8cb87b/family1/79b25bb0af414d92b854ab244f1efe9e, entries=1000, sequenceid=5, filesize=190.5 K 2023-02-12 03:54:24,391 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 38bfa684335ca214a06d15565b8cb87b in 844ms, sequenceid=5, compaction requested=false 2023-02-12 03:54:24,391 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-12 03:54:24,408 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 38bfa684335ca214a06d15565b8cb87b: 2023-02-12 03:54:24,408 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676174061396.38bfa684335ca214a06d15565b8cb87b. 2023-02-12 03:54:24,408 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-12 03:54:24,408 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-12 03:54:24,408 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6e021d5e to 127.0.0.1:59556 2023-02-12 03:54:24,408 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-12 03:54:24,408 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:24,408 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 03:54:24,408 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-02-12 03:54:24,408 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-02-12 03:54:24,408 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6a9448d4 to 127.0.0.1:59556 2023-02-12 03:54:24,408 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 03:54:24,408 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-12 03:54:24,408 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x40cff254 to 127.0.0.1:59556 2023-02-12 03:54:24,408 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 03:54:24,409 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-12 03:54:24,409 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6329451c to 127.0.0.1:59556 2023-02-12 03:54:24,409 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 03:54:24,410 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:24,410 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:24,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:24,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:54:24,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:54:24,410 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:24,410 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 03:54:24,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:54:24,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:54:24,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:24,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:24,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:54:24,411 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-02-12 03:54:24,411 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@23090d64[Count = 0] remaining members to acquire global barrier 2023-02-12 03:54:24,411 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-02-12 03:54:24,411 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:24,412 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:24,412 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:24,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:24,412 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-02-12 03:54:24,412 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-02-12 03:54:24,412 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase20.apache.org,39639,1676173982450' in zk 2023-02-12 03:54:24,412 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:24,412 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-12 03:54:24,413 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-02-12 03:54:24,413 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:24,413 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:54:24,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:24,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:54:24,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:54:24,413 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-02-12 03:54:24,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:54:24,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:54:24,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:24,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:24,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:54:24,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:24,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:24,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase20.apache.org,39639,1676173982450': 2023-02-12 03:54:24,414 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-02-12 03:54:24,414 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-02-12 03:54:24,414 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-12 03:54:24,414 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-12 03:54:24,414 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:24,414 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-12 03:54:24,415 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:24,415 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:54:24,415 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:24,415 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:24,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:24,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:24,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:54:24,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:54:24,415 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:54:24,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:54:24,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:54:24,416 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:24,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:24,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:24,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:54:24,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:24,416 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:24,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:24,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:54:24,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:24,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:24,419 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:24,419 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:54:24,419 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:54:24,419 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-12 03:54:24,419 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-12 03:54:24,419 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:24,419 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-02-12 03:54:24,419 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:54:24,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:54:24,419 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:54:24,419 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-02-12 03:54:24,419 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:24,419 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:54:24,419 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:24,419 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-12 03:54:24,419 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:24,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:54:24,419 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:24,419 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:24,520 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-12 03:54:24,520 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-12 03:54:24,526 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-12 03:54:24,528 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-02-12 03:54:24,528 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:24,528 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-12 03:54:24,528 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:54:24,528 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-02-12 03:54:24,528 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-02-12 03:54:24,529 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:24,529 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:24,530 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:54:24,530 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:24,531 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:54:24,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:54:24,531 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:24,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:24,531 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-12 03:54:24,532 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:24,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-12 03:54:24,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:24,533 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:24,533 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-02-12 03:54:24,533 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:24,533 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-02-12 03:54:24,533 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:54:24,533 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-02-12 03:54:24,534 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-12 03:54:24,534 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-12 03:54:24,534 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676174061396.38bfa684335ca214a06d15565b8cb87b. 2023-02-12 03:54:24,534 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676174061396.38bfa684335ca214a06d15565b8cb87b. started... 2023-02-12 03:54:24,534 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 38bfa684335ca214a06d15565b8cb87b 1/1 column families, dataSize=74 B heapSize=408 B 2023-02-12 03:54:24,559 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-12 03:54:24,952 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112805151fd9f74e4cbf9386cfc0674da79e to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015112805151fd9f74e4cbf9386cfc0674da79e 2023-02-12 03:54:25,361 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/38bfa684335ca214a06d15565b8cb87b/.tmp/family1/6bdcb92d66d24f978619baff0d929043 2023-02-12 03:54:25,368 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/38bfa684335ca214a06d15565b8cb87b/.tmp/family1/6bdcb92d66d24f978619baff0d929043 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/38bfa684335ca214a06d15565b8cb87b/family1/6bdcb92d66d24f978619baff0d929043 2023-02-12 03:54:25,375 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/38bfa684335ca214a06d15565b8cb87b/family1/6bdcb92d66d24f978619baff0d929043, entries=1, sequenceid=9, filesize=5.0 K 2023-02-12 03:54:25,376 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 38bfa684335ca214a06d15565b8cb87b in 842ms, sequenceid=9, compaction requested=false 2023-02-12 03:54:25,376 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 38bfa684335ca214a06d15565b8cb87b: 2023-02-12 03:54:25,376 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676174061396.38bfa684335ca214a06d15565b8cb87b. 2023-02-12 03:54:25,376 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-12 03:54:25,376 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-12 03:54:25,376 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:25,376 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-02-12 03:54:25,376 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-02-12 03:54:25,378 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:25,378 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:25,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:25,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:54:25,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:54:25,378 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:25,378 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 03:54:25,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:54:25,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:54:25,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:25,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:25,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:54:25,380 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-02-12 03:54:25,380 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7eb0386f[Count = 0] remaining members to acquire global barrier 2023-02-12 03:54:25,380 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-02-12 03:54:25,381 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:25,381 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:25,381 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:25,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:25,382 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-02-12 03:54:25,382 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-02-12 03:54:25,382 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:25,382 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-12 03:54:25,382 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase20.apache.org,39639,1676173982450' in zk 2023-02-12 03:54:25,383 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:25,383 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-02-12 03:54:25,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:25,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:54:25,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:54:25,383 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:54:25,383 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-02-12 03:54:25,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:54:25,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:54:25,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:25,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:25,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:54:25,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:25,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:25,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase20.apache.org,39639,1676173982450': 2023-02-12 03:54:25,386 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-02-12 03:54:25,386 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-02-12 03:54:25,386 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-12 03:54:25,386 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-12 03:54:25,386 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:25,386 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-12 03:54:25,387 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:25,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:25,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:54:25,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:54:25,387 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:25,387 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:54:25,387 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:25,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:25,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:54:25,387 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:54:25,387 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:25,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:54:25,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:25,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:25,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:54:25,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:25,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:25,389 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:25,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:54:25,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:25,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:25,390 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:25,390 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:54:25,390 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:25,390 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:54:25,390 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:54:25,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:54:25,390 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-12 03:54:25,390 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-12 03:54:25,390 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:54:25,390 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:25,391 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:25,391 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:25,391 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:25,391 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:25,391 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-02-12 03:54:25,391 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:54:25,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:54:25,391 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-12 03:54:25,491 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-12 03:54:25,493 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-12 03:54:25,500 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-12 03:54:25,503 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-02-12 03:54:25,503 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:25,504 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-12 03:54:25,504 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:54:25,504 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-02-12 03:54:25,504 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-02-12 03:54:25,505 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:25,505 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:25,507 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:25,507 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:54:25,507 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:54:25,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:54:25,507 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:25,508 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-12 03:54:25,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:25,509 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:25,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-12 03:54:25,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:25,510 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:25,510 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-02-12 03:54:25,510 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:25,510 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-02-12 03:54:25,510 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:54:25,510 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-02-12 03:54:25,511 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-12 03:54:25,511 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-12 03:54:25,511 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676174061396.38bfa684335ca214a06d15565b8cb87b. 2023-02-12 03:54:25,511 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676174061396.38bfa684335ca214a06d15565b8cb87b. started... 2023-02-12 03:54:25,511 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 38bfa684335ca214a06d15565b8cb87b 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-12 03:54:25,932 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120123045d7499fd41a9876ea2cf5f9d3f6e to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015120123045d7499fd41a9876ea2cf5f9d3f6e 2023-02-12 03:54:26,342 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/38bfa684335ca214a06d15565b8cb87b/.tmp/family1/46096d1e86af4ab1ba3b08f24f377f41 2023-02-12 03:54:26,350 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/38bfa684335ca214a06d15565b8cb87b/.tmp/family1/46096d1e86af4ab1ba3b08f24f377f41 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/38bfa684335ca214a06d15565b8cb87b/family1/46096d1e86af4ab1ba3b08f24f377f41 2023-02-12 03:54:26,357 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/38bfa684335ca214a06d15565b8cb87b/family1/46096d1e86af4ab1ba3b08f24f377f41, entries=1, sequenceid=13, filesize=5.0 K 2023-02-12 03:54:26,358 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 38bfa684335ca214a06d15565b8cb87b in 847ms, sequenceid=13, compaction requested=true 2023-02-12 03:54:26,358 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 38bfa684335ca214a06d15565b8cb87b: 2023-02-12 03:54:26,358 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676174061396.38bfa684335ca214a06d15565b8cb87b. 2023-02-12 03:54:26,358 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-12 03:54:26,358 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-12 03:54:26,358 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:26,358 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-02-12 03:54:26,358 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-02-12 03:54:26,360 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:26,360 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:26,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:26,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:54:26,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:54:26,360 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:26,360 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 03:54:26,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:54:26,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:54:26,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:26,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:26,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:54:26,364 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-02-12 03:54:26,364 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1a056236[Count = 0] remaining members to acquire global barrier 2023-02-12 03:54:26,364 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-02-12 03:54:26,364 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:26,365 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:26,365 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:26,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:26,365 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-02-12 03:54:26,365 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-02-12 03:54:26,365 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase20.apache.org,39639,1676173982450' in zk 2023-02-12 03:54:26,366 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:26,366 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-12 03:54:26,367 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:26,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:26,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:54:26,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:54:26,367 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-02-12 03:54:26,367 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:54:26,367 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-02-12 03:54:26,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:54:26,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:54:26,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:26,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:26,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:54:26,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:26,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:26,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase20.apache.org,39639,1676173982450': 2023-02-12 03:54:26,371 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-02-12 03:54:26,371 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-02-12 03:54:26,371 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-12 03:54:26,371 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-12 03:54:26,372 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:26,372 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-12 03:54:26,376 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:26,376 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:26,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:26,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:54:26,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:54:26,376 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:26,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:26,376 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:54:26,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:54:26,377 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:54:26,377 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:26,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:54:26,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:26,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:26,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:54:26,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:26,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:26,379 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:26,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:54:26,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:26,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:26,386 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:26,386 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:54:26,386 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:26,386 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:54:26,386 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:26,387 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:26,387 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:26,387 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:26,386 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-12 03:54:26,387 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-12 03:54:26,386 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:54:26,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:54:26,386 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:54:26,387 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-02-12 03:54:26,387 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-12 03:54:26,387 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:26,388 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:54:26,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:54:26,488 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-12 03:54:26,489 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-12 03:54:26,497 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-12 03:54:26,500 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-02-12 03:54:26,500 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:26,500 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-12 03:54:26,500 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:54:26,500 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-02-12 03:54:26,500 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-02-12 03:54:26,501 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:26,501 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:26,503 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:54:26,503 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:26,503 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:54:26,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:54:26,504 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:26,504 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-12 03:54:26,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:26,505 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:26,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-12 03:54:26,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:26,506 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:26,506 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-02-12 03:54:26,506 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:26,506 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-02-12 03:54:26,506 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:54:26,506 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-02-12 03:54:26,507 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-12 03:54:26,507 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-12 03:54:26,507 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676174061396.38bfa684335ca214a06d15565b8cb87b. 2023-02-12 03:54:26,507 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676174061396.38bfa684335ca214a06d15565b8cb87b. started... 2023-02-12 03:54:26,507 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 38bfa684335ca214a06d15565b8cb87b 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-12 03:54:26,930 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512050e40b4147ff945b3a465b56ba096d61f to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512050e40b4147ff945b3a465b56ba096d61f 2023-02-12 03:54:27,337 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/38bfa684335ca214a06d15565b8cb87b/.tmp/family1/056597f271b144b2b4ad8b54db2ab726 2023-02-12 03:54:27,345 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/38bfa684335ca214a06d15565b8cb87b/.tmp/family1/056597f271b144b2b4ad8b54db2ab726 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/38bfa684335ca214a06d15565b8cb87b/family1/056597f271b144b2b4ad8b54db2ab726 2023-02-12 03:54:27,350 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/38bfa684335ca214a06d15565b8cb87b/family1/056597f271b144b2b4ad8b54db2ab726, entries=1, sequenceid=17, filesize=5.0 K 2023-02-12 03:54:27,351 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 38bfa684335ca214a06d15565b8cb87b in 844ms, sequenceid=17, compaction requested=true 2023-02-12 03:54:27,351 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 38bfa684335ca214a06d15565b8cb87b: 2023-02-12 03:54:27,351 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676174061396.38bfa684335ca214a06d15565b8cb87b. 2023-02-12 03:54:27,351 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-12 03:54:27,351 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-12 03:54:27,351 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:27,351 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-02-12 03:54:27,351 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-02-12 03:54:27,353 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:27,353 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:27,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:27,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:54:27,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:54:27,353 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:27,353 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 03:54:27,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:54:27,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:54:27,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:27,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:27,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:54:27,355 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-02-12 03:54:27,355 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@52a95058[Count = 0] remaining members to acquire global barrier 2023-02-12 03:54:27,355 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-02-12 03:54:27,355 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:27,356 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:27,356 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:27,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:27,356 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-02-12 03:54:27,356 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-02-12 03:54:27,356 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase20.apache.org,39639,1676173982450' in zk 2023-02-12 03:54:27,356 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:27,356 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-12 03:54:27,357 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:27,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:27,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:54:27,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:54:27,357 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-02-12 03:54:27,357 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:54:27,357 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-02-12 03:54:27,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:54:27,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:54:27,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:27,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:27,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:54:27,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:27,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:27,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase20.apache.org,39639,1676173982450': 2023-02-12 03:54:27,361 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-02-12 03:54:27,361 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-02-12 03:54:27,361 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-12 03:54:27,361 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-12 03:54:27,361 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:27,362 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-12 03:54:27,363 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:27,363 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:54:27,363 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:27,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:27,363 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:27,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:27,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:54:27,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:54:27,364 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:54:27,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:54:27,364 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:27,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:54:27,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:27,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:27,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:54:27,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:27,365 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:27,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:27,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:54:27,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:27,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:27,368 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:27,368 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:54:27,368 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:54:27,368 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-12 03:54:27,368 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-12 03:54:27,368 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:27,368 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:54:27,368 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:54:27,368 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:27,368 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-02-12 03:54:27,368 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:27,368 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:27,368 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:27,368 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:27,368 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-02-12 03:54:27,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:54:27,368 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-12 03:54:27,369 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:54:27,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:54:27,469 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-12 03:54:27,471 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-12 03:54:27,479 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-12 03:54:27,481 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-02-12 03:54:27,481 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:27,481 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-12 03:54:27,481 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:54:27,481 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-02-12 03:54:27,482 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-02-12 03:54:27,482 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:27,482 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:27,483 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:54:27,483 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:27,484 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:54:27,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:54:27,484 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:27,484 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-12 03:54:27,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:27,485 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:27,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-12 03:54:27,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:27,485 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:27,486 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-02-12 03:54:27,486 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:27,486 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-02-12 03:54:27,486 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:54:27,486 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-02-12 03:54:27,486 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-12 03:54:27,486 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-12 03:54:27,486 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676174061396.38bfa684335ca214a06d15565b8cb87b. 2023-02-12 03:54:27,486 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676174061396.38bfa684335ca214a06d15565b8cb87b. started... 2023-02-12 03:54:27,487 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 38bfa684335ca214a06d15565b8cb87b 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-12 03:54:27,902 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512281c16d5e1876749a995d0516309ed4838 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512281c16d5e1876749a995d0516309ed4838 2023-02-12 03:54:28,307 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/38bfa684335ca214a06d15565b8cb87b/.tmp/family1/bd4a81b5db774f8dbd9e8919c0c679f3 2023-02-12 03:54:28,315 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/38bfa684335ca214a06d15565b8cb87b/.tmp/family1/bd4a81b5db774f8dbd9e8919c0c679f3 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/38bfa684335ca214a06d15565b8cb87b/family1/bd4a81b5db774f8dbd9e8919c0c679f3 2023-02-12 03:54:28,320 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/38bfa684335ca214a06d15565b8cb87b/family1/bd4a81b5db774f8dbd9e8919c0c679f3, entries=1, sequenceid=21, filesize=5.0 K 2023-02-12 03:54:28,320 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 38bfa684335ca214a06d15565b8cb87b in 833ms, sequenceid=21, compaction requested=true 2023-02-12 03:54:28,321 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 38bfa684335ca214a06d15565b8cb87b: 2023-02-12 03:54:28,321 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676174061396.38bfa684335ca214a06d15565b8cb87b. 2023-02-12 03:54:28,321 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-12 03:54:28,321 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-12 03:54:28,321 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:28,321 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-02-12 03:54:28,321 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-02-12 03:54:28,322 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:28,322 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:28,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:28,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:54:28,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:54:28,322 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:28,322 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 03:54:28,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:54:28,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:54:28,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:28,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:28,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:54:28,324 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-02-12 03:54:28,324 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@39a00544[Count = 0] remaining members to acquire global barrier 2023-02-12 03:54:28,324 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-02-12 03:54:28,324 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:28,324 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:28,324 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:28,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:28,324 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-02-12 03:54:28,325 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:28,325 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-12 03:54:28,325 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-02-12 03:54:28,325 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase20.apache.org,39639,1676173982450' in zk 2023-02-12 03:54:28,325 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:28,325 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-02-12 03:54:28,325 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:54:28,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:28,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:54:28,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:54:28,325 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-02-12 03:54:28,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:54:28,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:54:28,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:28,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:28,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:54:28,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:28,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:28,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase20.apache.org,39639,1676173982450': 2023-02-12 03:54:28,327 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-02-12 03:54:28,327 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-02-12 03:54:28,327 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-12 03:54:28,327 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-12 03:54:28,327 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:28,327 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-12 03:54:28,328 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:28,328 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:28,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:28,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:54:28,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:54:28,328 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:28,328 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:54:28,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:28,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:54:28,329 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:28,329 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:54:28,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:54:28,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:28,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:28,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:54:28,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:28,329 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:28,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:28,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:54:28,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:28,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:28,331 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:28,331 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:28,331 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:28,331 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:28,331 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:28,331 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:54:28,331 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:54:28,331 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-02-12 03:54:28,331 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-12 03:54:28,331 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-12 03:54:28,331 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:28,331 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:54:28,331 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:54:28,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:54:28,331 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:28,331 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-02-12 03:54:28,331 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-12 03:54:28,331 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:54:28,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:54:28,431 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-12 03:54:28,432 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-12 03:54:28,435 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-12 03:54:28,437 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-02-12 03:54:28,437 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:28,437 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-12 03:54:28,437 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:54:28,437 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-02-12 03:54:28,437 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-02-12 03:54:28,437 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:28,437 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:28,438 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:28,438 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:54:28,438 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:54:28,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:54:28,439 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:28,439 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-12 03:54:28,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:28,439 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:28,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-12 03:54:28,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:28,440 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:28,440 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-02-12 03:54:28,440 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:28,440 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-02-12 03:54:28,440 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:54:28,440 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-02-12 03:54:28,440 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-12 03:54:28,440 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-12 03:54:28,440 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676174061396.38bfa684335ca214a06d15565b8cb87b. 2023-02-12 03:54:28,441 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676174061396.38bfa684335ca214a06d15565b8cb87b. started... 2023-02-12 03:54:28,441 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 38bfa684335ca214a06d15565b8cb87b 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-12 03:54:28,862 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231a04e4708b4d64b8e8f1332c2093cdb80 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151231a04e4708b4d64b8e8f1332c2093cdb80 2023-02-12 03:54:29,269 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/38bfa684335ca214a06d15565b8cb87b/.tmp/family1/b5ef6ad4b96542f2b4c634335d514566 2023-02-12 03:54:29,278 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/38bfa684335ca214a06d15565b8cb87b/.tmp/family1/b5ef6ad4b96542f2b4c634335d514566 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/38bfa684335ca214a06d15565b8cb87b/family1/b5ef6ad4b96542f2b4c634335d514566 2023-02-12 03:54:29,283 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/38bfa684335ca214a06d15565b8cb87b/family1/b5ef6ad4b96542f2b4c634335d514566, entries=1, sequenceid=25, filesize=5.0 K 2023-02-12 03:54:29,284 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 38bfa684335ca214a06d15565b8cb87b in 843ms, sequenceid=25, compaction requested=true 2023-02-12 03:54:29,284 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 38bfa684335ca214a06d15565b8cb87b: 2023-02-12 03:54:29,284 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676174061396.38bfa684335ca214a06d15565b8cb87b. 2023-02-12 03:54:29,284 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-12 03:54:29,284 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-12 03:54:29,284 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:29,284 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-02-12 03:54:29,285 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-02-12 03:54:29,286 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:29,286 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:29,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:29,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:54:29,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:54:29,286 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:29,286 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 03:54:29,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:54:29,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:54:29,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:29,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:29,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:54:29,288 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-02-12 03:54:29,289 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@46ac215f[Count = 0] remaining members to acquire global barrier 2023-02-12 03:54:29,289 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-02-12 03:54:29,289 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:29,289 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:29,289 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:29,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:29,290 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-02-12 03:54:29,290 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-02-12 03:54:29,290 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase20.apache.org,39639,1676173982450' in zk 2023-02-12 03:54:29,290 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:29,290 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-12 03:54:29,292 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:29,292 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-02-12 03:54:29,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:29,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:54:29,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:54:29,292 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:54:29,292 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-02-12 03:54:29,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:54:29,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:54:29,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:29,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:29,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:54:29,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:29,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:29,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase20.apache.org,39639,1676173982450': 2023-02-12 03:54:29,296 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-02-12 03:54:29,296 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-02-12 03:54:29,296 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-12 03:54:29,296 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-12 03:54:29,296 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:29,296 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-12 03:54:29,301 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:29,302 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:29,302 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:54:29,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:29,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:54:29,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:54:29,302 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:29,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:29,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:54:29,303 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:54:29,303 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:29,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:54:29,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:29,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:29,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:54:29,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:29,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:29,305 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:29,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:54:29,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:29,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:29,310 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:29,310 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:54:29,310 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:54:29,310 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:29,310 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:54:29,310 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-12 03:54:29,310 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-12 03:54:29,310 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:54:29,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:54:29,310 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:29,311 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:29,311 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-02-12 03:54:29,311 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-12 03:54:29,311 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:54:29,311 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:29,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:54:29,311 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:29,311 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:29,411 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-12 03:54:29,414 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-12 03:54:29,424 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-12 03:54:29,427 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-02-12 03:54:29,427 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:29,427 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-12 03:54:29,427 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:54:29,427 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-02-12 03:54:29,427 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-02-12 03:54:29,428 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:29,429 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:29,430 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:54:29,430 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:29,430 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:54:29,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:54:29,431 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:29,431 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-12 03:54:29,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:29,432 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:29,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-12 03:54:29,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:29,433 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:29,434 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-02-12 03:54:29,434 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:29,434 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-02-12 03:54:29,434 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:54:29,434 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-02-12 03:54:29,434 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-12 03:54:29,434 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-12 03:54:29,434 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676174061396.38bfa684335ca214a06d15565b8cb87b. 2023-02-12 03:54:29,435 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676174061396.38bfa684335ca214a06d15565b8cb87b. started... 2023-02-12 03:54:29,435 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 38bfa684335ca214a06d15565b8cb87b 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-12 03:54:29,852 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101564542da19254c3eaa3b67c0445ca18f to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160101564542da19254c3eaa3b67c0445ca18f 2023-02-12 03:54:30,261 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/38bfa684335ca214a06d15565b8cb87b/.tmp/family1/747991da956f4a9b81d256c8119d8822 2023-02-12 03:54:30,272 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/38bfa684335ca214a06d15565b8cb87b/.tmp/family1/747991da956f4a9b81d256c8119d8822 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/38bfa684335ca214a06d15565b8cb87b/family1/747991da956f4a9b81d256c8119d8822 2023-02-12 03:54:30,279 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/38bfa684335ca214a06d15565b8cb87b/family1/747991da956f4a9b81d256c8119d8822, entries=1, sequenceid=29, filesize=5.0 K 2023-02-12 03:54:30,280 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 38bfa684335ca214a06d15565b8cb87b in 845ms, sequenceid=29, compaction requested=true 2023-02-12 03:54:30,280 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 38bfa684335ca214a06d15565b8cb87b: 2023-02-12 03:54:30,280 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676174061396.38bfa684335ca214a06d15565b8cb87b. 2023-02-12 03:54:30,280 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-12 03:54:30,280 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-12 03:54:30,280 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:30,280 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-02-12 03:54:30,280 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-02-12 03:54:30,282 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:30,282 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:30,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:30,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:54:30,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:54:30,282 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:30,282 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 03:54:30,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:54:30,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:54:30,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:30,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:30,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:54:30,284 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-02-12 03:54:30,284 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7709ff6e[Count = 0] remaining members to acquire global barrier 2023-02-12 03:54:30,284 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-02-12 03:54:30,284 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:30,284 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:30,284 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:30,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:30,284 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-02-12 03:54:30,285 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-02-12 03:54:30,285 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase20.apache.org,39639,1676173982450' in zk 2023-02-12 03:54:30,285 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:30,285 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-12 03:54:30,285 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:30,285 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-02-12 03:54:30,285 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:54:30,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:30,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:54:30,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:54:30,285 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-02-12 03:54:30,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:54:30,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:54:30,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:30,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:30,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:54:30,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:30,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:30,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase20.apache.org,39639,1676173982450': 2023-02-12 03:54:30,287 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-02-12 03:54:30,287 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-02-12 03:54:30,288 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-12 03:54:30,288 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-12 03:54:30,288 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:30,288 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-12 03:54:30,288 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:30,288 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:30,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:30,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:54:30,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:54:30,289 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:30,289 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:54:30,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:30,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:54:30,289 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:30,289 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:54:30,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:54:30,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:30,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:30,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:54:30,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:30,290 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:30,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:30,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:54:30,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:30,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:30,291 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:30,291 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:30,291 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:30,291 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:54:30,291 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-12 03:54:30,291 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-12 03:54:30,291 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:54:30,291 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:30,291 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:54:30,291 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-02-12 03:54:30,292 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-02-12 03:54:30,292 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-12 03:54:30,291 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:54:30,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:54:30,292 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:30,292 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:30,292 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:30,292 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:54:30,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:54:30,392 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-12 03:54:30,393 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-12 03:54:30,399 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-12 03:54:30,401 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-02-12 03:54:30,401 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:30,401 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-12 03:54:30,401 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:54:30,401 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-02-12 03:54:30,401 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-02-12 03:54:30,402 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:30,402 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:30,403 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:54:30,403 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:30,403 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:54:30,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:54:30,403 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:30,403 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-12 03:54:30,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:30,404 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:30,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-12 03:54:30,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:30,404 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:30,404 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-02-12 03:54:30,404 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:30,404 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-02-12 03:54:30,404 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:54:30,404 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-02-12 03:54:30,405 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-12 03:54:30,405 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-12 03:54:30,405 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676174061396.38bfa684335ca214a06d15565b8cb87b. 2023-02-12 03:54:30,405 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676174061396.38bfa684335ca214a06d15565b8cb87b. started... 2023-02-12 03:54:30,405 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 38bfa684335ca214a06d15565b8cb87b 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-12 03:54:30,821 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103706287a528b34cb1a0408d15d82e8030 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160103706287a528b34cb1a0408d15d82e8030 2023-02-12 03:54:31,230 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/38bfa684335ca214a06d15565b8cb87b/.tmp/family1/243528e2f9b04d08b5a67c47eb616fa2 2023-02-12 03:54:31,240 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/38bfa684335ca214a06d15565b8cb87b/.tmp/family1/243528e2f9b04d08b5a67c47eb616fa2 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/38bfa684335ca214a06d15565b8cb87b/family1/243528e2f9b04d08b5a67c47eb616fa2 2023-02-12 03:54:31,246 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/38bfa684335ca214a06d15565b8cb87b/family1/243528e2f9b04d08b5a67c47eb616fa2, entries=1, sequenceid=33, filesize=5.0 K 2023-02-12 03:54:31,247 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 38bfa684335ca214a06d15565b8cb87b in 842ms, sequenceid=33, compaction requested=true 2023-02-12 03:54:31,247 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 38bfa684335ca214a06d15565b8cb87b: 2023-02-12 03:54:31,247 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676174061396.38bfa684335ca214a06d15565b8cb87b. 2023-02-12 03:54:31,248 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-12 03:54:31,248 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-12 03:54:31,248 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:31,248 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-02-12 03:54:31,248 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-02-12 03:54:31,249 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:31,249 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:31,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:31,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:54:31,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:54:31,249 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:31,249 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 03:54:31,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:54:31,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:54:31,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:31,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:31,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:54:31,251 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-02-12 03:54:31,251 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6fba4a47[Count = 0] remaining members to acquire global barrier 2023-02-12 03:54:31,251 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-02-12 03:54:31,251 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:31,251 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:31,251 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:31,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:31,251 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-02-12 03:54:31,251 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-02-12 03:54:31,251 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase20.apache.org,39639,1676173982450' in zk 2023-02-12 03:54:31,251 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:31,252 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-12 03:54:31,252 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:31,252 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-02-12 03:54:31,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:31,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:54:31,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:54:31,252 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:54:31,252 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-02-12 03:54:31,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:54:31,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:54:31,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:31,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:31,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:54:31,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:31,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:31,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase20.apache.org,39639,1676173982450': 2023-02-12 03:54:31,254 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-02-12 03:54:31,254 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-02-12 03:54:31,255 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-12 03:54:31,255 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-12 03:54:31,255 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:31,255 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-12 03:54:31,256 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:31,256 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:31,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:31,256 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:31,256 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:54:31,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:31,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:54:31,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:54:31,256 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:54:31,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:54:31,256 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:31,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:54:31,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:31,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:31,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:54:31,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:31,257 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:31,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:31,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:54:31,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:31,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:31,259 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:31,259 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:31,259 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:54:31,259 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:31,259 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:54:31,259 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-02-12 03:54:31,259 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:31,259 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-12 03:54:31,259 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-12 03:54:31,259 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:54:31,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:54:31,259 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:54:31,259 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:31,259 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:31,259 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:31,259 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-02-12 03:54:31,259 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-12 03:54:31,259 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:54:31,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:54:31,359 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-12 03:54:31,360 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-12 03:54:31,366 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-12 03:54:31,368 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-02-12 03:54:31,368 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:31,368 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-12 03:54:31,369 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:54:31,369 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-02-12 03:54:31,369 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-02-12 03:54:31,369 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:31,369 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:31,370 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:54:31,370 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:31,370 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:54:31,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:54:31,371 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:31,371 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-12 03:54:31,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:31,372 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:31,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-12 03:54:31,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:31,373 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:31,373 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-02-12 03:54:31,373 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:31,373 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-02-12 03:54:31,373 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:54:31,373 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-02-12 03:54:31,374 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-12 03:54:31,374 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-12 03:54:31,374 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676174061396.38bfa684335ca214a06d15565b8cb87b. 2023-02-12 03:54:31,374 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676174061396.38bfa684335ca214a06d15565b8cb87b. started... 2023-02-12 03:54:31,374 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 38bfa684335ca214a06d15565b8cb87b 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-12 03:54:31,805 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907fc8c7168ad794ca5bc5a8a97b355b3e9 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20150907fc8c7168ad794ca5bc5a8a97b355b3e9 2023-02-12 03:54:31,815 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/38bfa684335ca214a06d15565b8cb87b/.tmp/family1/6b791f3c8b4746aab15cce2d4f09d330 2023-02-12 03:54:31,821 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/38bfa684335ca214a06d15565b8cb87b/.tmp/family1/6b791f3c8b4746aab15cce2d4f09d330 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/38bfa684335ca214a06d15565b8cb87b/family1/6b791f3c8b4746aab15cce2d4f09d330 2023-02-12 03:54:31,825 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/38bfa684335ca214a06d15565b8cb87b/family1/6b791f3c8b4746aab15cce2d4f09d330, entries=1, sequenceid=37, filesize=5.0 K 2023-02-12 03:54:31,826 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 38bfa684335ca214a06d15565b8cb87b in 452ms, sequenceid=37, compaction requested=true 2023-02-12 03:54:31,826 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 38bfa684335ca214a06d15565b8cb87b: 2023-02-12 03:54:31,826 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676174061396.38bfa684335ca214a06d15565b8cb87b. 2023-02-12 03:54:31,826 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-12 03:54:31,826 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-12 03:54:31,826 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:31,826 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-02-12 03:54:31,827 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-02-12 03:54:31,828 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:31,828 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:31,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:31,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:54:31,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:54:31,828 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:31,828 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 03:54:31,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:54:31,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:54:31,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:31,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:31,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:54:31,829 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-02-12 03:54:31,829 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5689f8d1[Count = 0] remaining members to acquire global barrier 2023-02-12 03:54:31,829 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-02-12 03:54:31,829 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:31,830 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:31,830 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:31,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:31,830 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-02-12 03:54:31,830 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-02-12 03:54:31,830 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase20.apache.org,39639,1676173982450' in zk 2023-02-12 03:54:31,830 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:31,830 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-12 03:54:31,831 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-02-12 03:54:31,831 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:31,831 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:54:31,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:31,831 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-02-12 03:54:31,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:54:31,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:54:31,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:54:31,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:54:31,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:31,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:31,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:54:31,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:31,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:31,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase20.apache.org,39639,1676173982450': 2023-02-12 03:54:31,833 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-02-12 03:54:31,833 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-02-12 03:54:31,833 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-12 03:54:31,833 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-12 03:54:31,833 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:31,833 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-12 03:54:31,834 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:31,834 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:31,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:31,835 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:31,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:31,835 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:54:31,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:54:31,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:54:31,835 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:54:31,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:54:31,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:54:31,835 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:31,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:31,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:31,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:54:31,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:31,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:31,837 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:31,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:54:31,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:31,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:31,838 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:31,838 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:54:31,838 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:54:31,838 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:31,838 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:54:31,838 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:31,838 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:54:31,838 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-12 03:54:31,839 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-12 03:54:31,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:54:31,839 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:31,839 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:31,839 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:31,839 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:31,839 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-02-12 03:54:31,839 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-12 03:54:31,839 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:54:31,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:54:31,939 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-12 03:54:31,941 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-12 03:54:31,949 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-12 03:54:31,951 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-02-12 03:54:31,951 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:31,951 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-12 03:54:31,952 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:54:31,952 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-02-12 03:54:31,952 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-02-12 03:54:31,952 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:31,952 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:31,953 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:54:31,953 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:31,953 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:54:31,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:54:31,953 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:31,953 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-12 03:54:31,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:31,954 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:31,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-12 03:54:31,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:31,954 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:31,954 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-02-12 03:54:31,955 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:31,955 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-02-12 03:54:31,955 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:54:31,955 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-02-12 03:54:31,955 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-12 03:54:31,955 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-12 03:54:31,955 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676174061396.38bfa684335ca214a06d15565b8cb87b. 2023-02-12 03:54:31,955 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676174061396.38bfa684335ca214a06d15565b8cb87b. started... 2023-02-12 03:54:31,955 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 38bfa684335ca214a06d15565b8cb87b 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-12 03:54:32,371 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511207914f1fc73e74319915579ace9f72309 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511207914f1fc73e74319915579ace9f72309 2023-02-12 03:54:32,778 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/38bfa684335ca214a06d15565b8cb87b/.tmp/family1/6ffb2ac2b116488381db0ced1e8b6118 2023-02-12 03:54:32,788 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/38bfa684335ca214a06d15565b8cb87b/.tmp/family1/6ffb2ac2b116488381db0ced1e8b6118 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/38bfa684335ca214a06d15565b8cb87b/family1/6ffb2ac2b116488381db0ced1e8b6118 2023-02-12 03:54:32,796 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/38bfa684335ca214a06d15565b8cb87b/family1/6ffb2ac2b116488381db0ced1e8b6118, entries=1, sequenceid=41, filesize=5.0 K 2023-02-12 03:54:32,797 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 38bfa684335ca214a06d15565b8cb87b in 842ms, sequenceid=41, compaction requested=true 2023-02-12 03:54:32,798 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 38bfa684335ca214a06d15565b8cb87b: 2023-02-12 03:54:32,798 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676174061396.38bfa684335ca214a06d15565b8cb87b. 2023-02-12 03:54:32,798 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-12 03:54:32,798 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-12 03:54:32,798 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:32,798 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-02-12 03:54:32,798 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-02-12 03:54:32,799 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:32,799 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:32,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:32,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:54:32,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:54:32,800 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:32,800 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 03:54:32,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:54:32,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:54:32,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:32,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:32,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:54:32,801 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-02-12 03:54:32,801 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@71888d86[Count = 0] remaining members to acquire global barrier 2023-02-12 03:54:32,801 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-02-12 03:54:32,801 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:32,802 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:32,802 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:32,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:32,802 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-02-12 03:54:32,802 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-02-12 03:54:32,802 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase20.apache.org,39639,1676173982450' in zk 2023-02-12 03:54:32,802 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:32,802 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-12 03:54:32,803 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:32,803 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-02-12 03:54:32,803 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:54:32,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:32,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:54:32,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:54:32,803 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-02-12 03:54:32,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:54:32,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:54:32,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:32,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:32,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:54:32,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:32,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:32,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase20.apache.org,39639,1676173982450': 2023-02-12 03:54:32,806 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-02-12 03:54:32,806 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-02-12 03:54:32,806 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-12 03:54:32,806 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-12 03:54:32,806 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:32,806 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-12 03:54:32,807 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:32,807 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:32,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:32,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:54:32,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:54:32,807 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:32,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:32,807 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:54:32,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:54:32,808 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:54:32,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:54:32,808 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:32,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:32,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:32,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:54:32,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:32,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:32,809 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:32,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:54:32,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:32,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:32,811 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:32,811 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:54:32,812 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:32,812 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:54:32,812 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-02-12 03:54:32,812 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:54:32,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:54:32,812 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:54:32,812 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:32,812 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-12 03:54:32,812 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-12 03:54:32,812 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:32,812 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:32,812 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:32,812 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:32,812 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-02-12 03:54:32,812 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:54:32,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:54:32,812 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-12 03:54:32,913 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-12 03:54:32,914 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-12 03:54:32,916 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=40099] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:32,919 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676173985818] procedure2.ProcedureExecutor(1029): Stored pid=58, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-02-12 03:54:32,920 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=58, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-02-12 03:54:32,921 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676173985818] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-12 03:54:32,921 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=58, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1676174672921 2023-02-12 03:54:32,923 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676173985818] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-12 03:54:32,925 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676173985818] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-02-12 03:54:32,925 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676173985818] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-12 03:54:32,927 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676173985818] zookeeper.ReadOnlyZKClient(139): Connect 0x4b9578b9 to 127.0.0.1:59556 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 03:54:32,931 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676173985818] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3d2a98ba, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 03:54:32,931 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-12 03:54:33,781 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103291c3a3e6e984745948ad76b43952600 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160103291c3a3e6e984745948ad76b43952600 2023-02-12 03:54:33,781 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-12 03:54:33,798 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-12 03:54:33,799 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:37560, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-12 03:54:33,807 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-12 03:54:33,808 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:39162, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-12 03:54:33,818 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/5299ae4d904642e282d3e5bf20663fb4 first=Optional[r3] last=Optional[r6] 2023-02-12 03:54:33,819 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676174061396.38bfa684335ca214a06d15565b8cb87b., hostname=jenkins-hbase20.apache.org,39639,1676173982450, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/5299ae4d904642e282d3e5bf20663fb4}] 2023-02-12 03:54:33,824 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/5299ae4d904642e282d3e5bf20663fb4 for inclusion in 38bfa684335ca214a06d15565b8cb87b/family1 2023-02-12 03:54:33,826 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-02-12 03:54:33,826 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HStore(777): Region bounds: first= last= 2023-02-12 03:54:33,826 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HRegion(2445): Flush status journal for 38bfa684335ca214a06d15565b8cb87b: 2023-02-12 03:54:33,827 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/5299ae4d904642e282d3e5bf20663fb4 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__ma5tuhra0gm08tc31il1lr1kkujr13qjffpkloq40g1a1fnb287ao3d9k3996sdq/family1/5299ae4d904642e282d3e5bf20663fb4 2023-02-12 03:54:33,829 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__ma5tuhra0gm08tc31il1lr1kkujr13qjffpkloq40g1a1fnb287ao3d9k3996sdq/family1/5299ae4d904642e282d3e5bf20663fb4 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/38bfa684335ca214a06d15565b8cb87b/family1/f6ae834ebbf345d78787d28481c9f965_SeqId_44_ 2023-02-12 03:54:33,829 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__ma5tuhra0gm08tc31il1lr1kkujr13qjffpkloq40g1a1fnb287ao3d9k3996sdq/family1/5299ae4d904642e282d3e5bf20663fb4 into 38bfa684335ca214a06d15565b8cb87b/family1 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/38bfa684335ca214a06d15565b8cb87b/family1/f6ae834ebbf345d78787d28481c9f965_SeqId_44_ - updating store file list. 2023-02-12 03:54:33,833 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/38bfa684335ca214a06d15565b8cb87b/family1/f6ae834ebbf345d78787d28481c9f965_SeqId_44_ into 38bfa684335ca214a06d15565b8cb87b/family1 2023-02-12 03:54:33,833 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__ma5tuhra0gm08tc31il1lr1kkujr13qjffpkloq40g1a1fnb287ao3d9k3996sdq/family1/5299ae4d904642e282d3e5bf20663fb4 into 38bfa684335ca214a06d15565b8cb87b/family1 (new location: hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/38bfa684335ca214a06d15565b8cb87b/family1/f6ae834ebbf345d78787d28481c9f965_SeqId_44_) 2023-02-12 03:54:33,833 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__ma5tuhra0gm08tc31il1lr1kkujr13qjffpkloq40g1a1fnb287ao3d9k3996sdq/family1/5299ae4d904642e282d3e5bf20663fb4 2023-02-12 03:54:33,833 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-02-12 03:54:33,836 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51552 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-02-12 03:54:33,836 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HStore(1912): 38bfa684335ca214a06d15565b8cb87b/family1 is initiating minor compaction 2023-02-12 03:54:33,836 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@584a8edb; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-12 03:54:33,836 INFO [RS:0;jenkins-hbase20:39639-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 38bfa684335ca214a06d15565b8cb87b/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676174061396.38bfa684335ca214a06d15565b8cb87b. 2023-02-12 03:54:33,836 INFO [RS:0;jenkins-hbase20:39639-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/38bfa684335ca214a06d15565b8cb87b/family1/6bdcb92d66d24f978619baff0d929043, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/38bfa684335ca214a06d15565b8cb87b/family1/46096d1e86af4ab1ba3b08f24f377f41, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/38bfa684335ca214a06d15565b8cb87b/family1/056597f271b144b2b4ad8b54db2ab726, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/38bfa684335ca214a06d15565b8cb87b/family1/bd4a81b5db774f8dbd9e8919c0c679f3, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/38bfa684335ca214a06d15565b8cb87b/family1/b5ef6ad4b96542f2b4c634335d514566, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/38bfa684335ca214a06d15565b8cb87b/family1/747991da956f4a9b81d256c8119d8822, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/38bfa684335ca214a06d15565b8cb87b/family1/243528e2f9b04d08b5a67c47eb616fa2, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/38bfa684335ca214a06d15565b8cb87b/family1/6b791f3c8b4746aab15cce2d4f09d330, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/38bfa684335ca214a06d15565b8cb87b/family1/6ffb2ac2b116488381db0ced1e8b6118, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/38bfa684335ca214a06d15565b8cb87b/family1/f6ae834ebbf345d78787d28481c9f965_SeqId_44_] into tmpdir=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/38bfa684335ca214a06d15565b8cb87b/.tmp, totalSize=50.3 K 2023-02-12 03:54:33,836 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] compactions.Compactor(207): Compacting 6bdcb92d66d24f978619baff0d929043, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-02-12 03:54:33,837 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] compactions.Compactor(207): Compacting 46096d1e86af4ab1ba3b08f24f377f41, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-02-12 03:54:33,837 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] compactions.Compactor(207): Compacting 056597f271b144b2b4ad8b54db2ab726, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-02-12 03:54:33,837 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] compactions.Compactor(207): Compacting bd4a81b5db774f8dbd9e8919c0c679f3, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-02-12 03:54:33,837 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] compactions.Compactor(207): Compacting b5ef6ad4b96542f2b4c634335d514566, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-02-12 03:54:33,837 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] compactions.Compactor(207): Compacting 747991da956f4a9b81d256c8119d8822, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-02-12 03:54:33,837 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] compactions.Compactor(207): Compacting 243528e2f9b04d08b5a67c47eb616fa2, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-02-12 03:54:33,837 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] compactions.Compactor(207): Compacting 6b791f3c8b4746aab15cce2d4f09d330, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-02-12 03:54:33,837 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] compactions.Compactor(207): Compacting 6ffb2ac2b116488381db0ced1e8b6118, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-02-12 03:54:33,837 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] compactions.Compactor(207): Compacting f6ae834ebbf345d78787d28481c9f965_SeqId_44_, keycount=4, bloomtype=ROW, size=5.6 K, encoding=NONE, compression=NONE, seqNum=45 2023-02-12 03:54:33,838 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-12 03:54:33,839 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-12 03:54:33,840 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512281c16d5e1876749a995d0516309ed4838 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512281c16d5e1876749a995d0516309ed4838 2023-02-12 03:54:33,842 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151231a04e4708b4d64b8e8f1332c2093cdb80 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151231a04e4708b4d64b8e8f1332c2093cdb80 2023-02-12 03:54:33,842 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160101564542da19254c3eaa3b67c0445ca18f to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160101564542da19254c3eaa3b67c0445ca18f 2023-02-12 03:54:33,843 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160103706287a528b34cb1a0408d15d82e8030 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160103706287a528b34cb1a0408d15d82e8030 2023-02-12 03:54:33,843 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 4 expired mob files are deleted 2023-02-12 03:54:33,844 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-02-12 03:54:33,844 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-12 03:54:33,844 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-12 03:54:33,844 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-12 03:54:33,844 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-12 03:54:33,844 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-12 03:54:33,844 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-12 03:54:33,844 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-12 03:54:33,844 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-12 03:54:33,878 INFO [RS:0;jenkins-hbase20:39639-shortCompactions-0] throttle.PressureAwareThroughputController(145): 38bfa684335ca214a06d15565b8cb87b#family1#compaction#73 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 80.77 MB/second 2023-02-12 03:54:34,703 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/38bfa684335ca214a06d15565b8cb87b/.tmp/family1/08d08741fd5a4d018e816e138adfad76 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/38bfa684335ca214a06d15565b8cb87b/family1/08d08741fd5a4d018e816e138adfad76 2023-02-12 03:54:34,710 INFO [RS:0;jenkins-hbase20:39639-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 38bfa684335ca214a06d15565b8cb87b/family1 of 38bfa684335ca214a06d15565b8cb87b into 08d08741fd5a4d018e816e138adfad76(size=6.8 K), total size for store is 197.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-12 03:54:34,710 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 38bfa684335ca214a06d15565b8cb87b: 2023-02-12 03:54:34,711 INFO [RS:0;jenkins-hbase20:39639-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676174061396.38bfa684335ca214a06d15565b8cb87b., storeName=family1, fileCount=10, fileSize=50.3 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.6 K), priority=2, time=1676174073836; duration=0sec 2023-02-12 03:54:34,711 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-12 03:54:34,720 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512052e3364f6b8c74d85867a39162c72fe4a to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512052e3364f6b8c74d85867a39162c72fe4a 2023-02-12 03:54:34,721 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-12 03:54:34,740 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/60ee04ca805c472b9fa5481a6b901b80 first=Optional[r00] last=Optional[r2] 2023-02-12 03:54:34,741 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676174061396.38bfa684335ca214a06d15565b8cb87b., hostname=jenkins-hbase20.apache.org,39639,1676173982450, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/60ee04ca805c472b9fa5481a6b901b80}] 2023-02-12 03:54:34,743 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/60ee04ca805c472b9fa5481a6b901b80 for inclusion in 38bfa684335ca214a06d15565b8cb87b/family1 2023-02-12 03:54:34,746 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-02-12 03:54:34,746 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HStore(777): Region bounds: first= last= 2023-02-12 03:54:34,746 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HRegion(2445): Flush status journal for 38bfa684335ca214a06d15565b8cb87b: 2023-02-12 03:54:34,747 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/60ee04ca805c472b9fa5481a6b901b80 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__je8tjrngc0v5lg5426h1his867t1m81guve8f4g47m5buvutububj8iaaub7pi69/family1/60ee04ca805c472b9fa5481a6b901b80 2023-02-12 03:54:34,749 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__je8tjrngc0v5lg5426h1his867t1m81guve8f4g47m5buvutububj8iaaub7pi69/family1/60ee04ca805c472b9fa5481a6b901b80 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/38bfa684335ca214a06d15565b8cb87b/family1/5b5cfcb605d148acafa531fd3d667858_SeqId_47_ 2023-02-12 03:54:34,750 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__je8tjrngc0v5lg5426h1his867t1m81guve8f4g47m5buvutububj8iaaub7pi69/family1/60ee04ca805c472b9fa5481a6b901b80 into 38bfa684335ca214a06d15565b8cb87b/family1 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/38bfa684335ca214a06d15565b8cb87b/family1/5b5cfcb605d148acafa531fd3d667858_SeqId_47_ - updating store file list. 2023-02-12 03:54:34,753 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/38bfa684335ca214a06d15565b8cb87b/family1/5b5cfcb605d148acafa531fd3d667858_SeqId_47_ into 38bfa684335ca214a06d15565b8cb87b/family1 2023-02-12 03:54:34,753 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__je8tjrngc0v5lg5426h1his867t1m81guve8f4g47m5buvutububj8iaaub7pi69/family1/60ee04ca805c472b9fa5481a6b901b80 into 38bfa684335ca214a06d15565b8cb87b/family1 (new location: hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/38bfa684335ca214a06d15565b8cb87b/family1/5b5cfcb605d148acafa531fd3d667858_SeqId_47_) 2023-02-12 03:54:34,754 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__je8tjrngc0v5lg5426h1his867t1m81guve8f4g47m5buvutububj8iaaub7pi69/family1/60ee04ca805c472b9fa5481a6b901b80 2023-02-12 03:54:34,754 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-02-12 03:54:34,755 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 397422 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-02-12 03:54:34,755 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HStore(1912): 38bfa684335ca214a06d15565b8cb87b/family1 is initiating minor compaction (all files) 2023-02-12 03:54:34,755 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@35330b08; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-02-12 03:54:34,755 INFO [RS:0;jenkins-hbase20:39639-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 38bfa684335ca214a06d15565b8cb87b/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676174061396.38bfa684335ca214a06d15565b8cb87b. 2023-02-12 03:54:34,755 INFO [RS:0;jenkins-hbase20:39639-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/38bfa684335ca214a06d15565b8cb87b/family1/79b25bb0af414d92b854ab244f1efe9e, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/38bfa684335ca214a06d15565b8cb87b/family1/08d08741fd5a4d018e816e138adfad76, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/38bfa684335ca214a06d15565b8cb87b/family1/5b5cfcb605d148acafa531fd3d667858_SeqId_47_] into tmpdir=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/38bfa684335ca214a06d15565b8cb87b/.tmp, totalSize=388.1 K 2023-02-12 03:54:34,756 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] compactions.Compactor(207): Compacting 79b25bb0af414d92b854ab244f1efe9e, keycount=1000, bloomtype=ROW, size=190.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878805947 2023-02-12 03:54:34,756 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] compactions.Compactor(207): Compacting 08d08741fd5a4d018e816e138adfad76, keycount=9, bloomtype=ROW, size=6.8 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621205947 2023-02-12 03:54:34,756 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] compactions.Compactor(207): Compacting 5b5cfcb605d148acafa531fd3d667858_SeqId_47_, keycount=1002, bloomtype=ROW, size=190.9 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878805947 2023-02-12 03:54:34,757 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-12 03:54:34,757 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-12 03:54:34,759 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015113013c6859167184c2e954f1eb1e34a2fd7 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015113013c6859167184c2e954f1eb1e34a2fd7 2023-02-12 03:54:34,760 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015120123045d7499fd41a9876ea2cf5f9d3f6e to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015120123045d7499fd41a9876ea2cf5f9d3f6e 2023-02-12 03:54:34,765 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512050e40b4147ff945b3a465b56ba096d61f to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512050e40b4147ff945b3a465b56ba096d61f 2023-02-12 03:54:34,766 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 3 expired mob files are deleted 2023-02-12 03:54:34,766 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-02-12 03:54:34,773 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-12 03:54:34,773 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676173985818] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-12 03:54:34,774 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676173985818] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-12 03:54:34,780 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=58, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-02-12 03:54:34,780 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/38bfa684335ca214a06d15565b8cb87b/family1/6bdcb92d66d24f978619baff0d929043, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/38bfa684335ca214a06d15565b8cb87b/family1/46096d1e86af4ab1ba3b08f24f377f41, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/38bfa684335ca214a06d15565b8cb87b/family1/056597f271b144b2b4ad8b54db2ab726, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/38bfa684335ca214a06d15565b8cb87b/family1/bd4a81b5db774f8dbd9e8919c0c679f3, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/38bfa684335ca214a06d15565b8cb87b/family1/b5ef6ad4b96542f2b4c634335d514566, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/38bfa684335ca214a06d15565b8cb87b/family1/747991da956f4a9b81d256c8119d8822, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/38bfa684335ca214a06d15565b8cb87b/family1/243528e2f9b04d08b5a67c47eb616fa2, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/38bfa684335ca214a06d15565b8cb87b/family1/6b791f3c8b4746aab15cce2d4f09d330, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/38bfa684335ca214a06d15565b8cb87b/family1/6ffb2ac2b116488381db0ced1e8b6118, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/38bfa684335ca214a06d15565b8cb87b/family1/f6ae834ebbf345d78787d28481c9f965_SeqId_44_] to archive 2023-02-12 03:54:34,781 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-12 03:54:34,781 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=58, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 1.8630 sec 2023-02-12 03:54:34,783 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/38bfa684335ca214a06d15565b8cb87b/family1/6bdcb92d66d24f978619baff0d929043 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/38bfa684335ca214a06d15565b8cb87b/family1/6bdcb92d66d24f978619baff0d929043 2023-02-12 03:54:34,784 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/38bfa684335ca214a06d15565b8cb87b/family1/46096d1e86af4ab1ba3b08f24f377f41 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/38bfa684335ca214a06d15565b8cb87b/family1/46096d1e86af4ab1ba3b08f24f377f41 2023-02-12 03:54:34,785 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/38bfa684335ca214a06d15565b8cb87b/family1/056597f271b144b2b4ad8b54db2ab726 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/38bfa684335ca214a06d15565b8cb87b/family1/056597f271b144b2b4ad8b54db2ab726 2023-02-12 03:54:34,785 INFO [RS:0;jenkins-hbase20:39639-shortCompactions-0] throttle.PressureAwareThroughputController(145): 38bfa684335ca214a06d15565b8cb87b#family1#compaction#74 average throughput is 19.96 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 80.77 MB/second 2023-02-12 03:54:34,786 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/38bfa684335ca214a06d15565b8cb87b/family1/bd4a81b5db774f8dbd9e8919c0c679f3 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/38bfa684335ca214a06d15565b8cb87b/family1/bd4a81b5db774f8dbd9e8919c0c679f3 2023-02-12 03:54:34,788 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/38bfa684335ca214a06d15565b8cb87b/family1/b5ef6ad4b96542f2b4c634335d514566 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/38bfa684335ca214a06d15565b8cb87b/family1/b5ef6ad4b96542f2b4c634335d514566 2023-02-12 03:54:34,789 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/38bfa684335ca214a06d15565b8cb87b/family1/747991da956f4a9b81d256c8119d8822 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/38bfa684335ca214a06d15565b8cb87b/family1/747991da956f4a9b81d256c8119d8822 2023-02-12 03:54:34,790 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/38bfa684335ca214a06d15565b8cb87b/family1/243528e2f9b04d08b5a67c47eb616fa2 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/38bfa684335ca214a06d15565b8cb87b/family1/243528e2f9b04d08b5a67c47eb616fa2 2023-02-12 03:54:34,791 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/38bfa684335ca214a06d15565b8cb87b/family1/6b791f3c8b4746aab15cce2d4f09d330 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/38bfa684335ca214a06d15565b8cb87b/family1/6b791f3c8b4746aab15cce2d4f09d330 2023-02-12 03:54:34,792 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/38bfa684335ca214a06d15565b8cb87b/family1/6ffb2ac2b116488381db0ced1e8b6118 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/38bfa684335ca214a06d15565b8cb87b/family1/6ffb2ac2b116488381db0ced1e8b6118 2023-02-12 03:54:34,793 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/38bfa684335ca214a06d15565b8cb87b/family1/f6ae834ebbf345d78787d28481c9f965_SeqId_44_ to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/38bfa684335ca214a06d15565b8cb87b/family1/f6ae834ebbf345d78787d28481c9f965_SeqId_44_ 2023-02-12 03:54:34,797 DEBUG [hfile_cleaner-dir-scan-pool-1] cleaner.CleanerChore(483): Couldn't delete 'hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/38bfa684335ca214a06d15565b8cb87b/family1' yet because it isn't empty w/exception. org.apache.hadoop.fs.PathIsNotEmptyDirectoryException: ``/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/38bfa684335ca214a06d15565b8cb87b/family1 is non empty': Directory is not empty at org.apache.hadoop.hdfs.server.namenode.FSDirDeleteOp.delete(FSDirDeleteOp.java:115) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.delete(FSNamesystem.java:2873) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.delete(NameNodeRpcServer.java:1101) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.delete(ClientNamenodeProtocolServerSideTranslatorPB.java:648) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) ': Directory is not empty: `/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/38bfa684335ca214a06d15565b8cb87b/family1 is non empty': Directory is not empty at org.apache.hadoop.hdfs.server.namenode.FSDirDeleteOp.delete(FSDirDeleteOp.java:115) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.delete(FSNamesystem.java:2873) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.delete(NameNodeRpcServer.java:1101) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.delete(ClientNamenodeProtocolServerSideTranslatorPB.java:648) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.delete(DFSClient.java:1595) at org.apache.hadoop.hdfs.DistributedFileSystem$19.doCall(DistributedFileSystem.java:881) at org.apache.hadoop.hdfs.DistributedFileSystem$19.doCall(DistributedFileSystem.java:878) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.delete(DistributedFileSystem.java:878) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.lambda$null$4(CleanerChore.java:453) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.deleteAction(CleanerChore.java:478) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.lambda$traverseAndDelete$5(CleanerChore.java:453) at org.apache.hadoop.hbase.util.FutureUtils.lambda$addListener$0(FutureUtils.java:68) at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774) at java.util.concurrent.CompletableFuture.uniWhenCompleteStage(CompletableFuture.java:792) at java.util.concurrent.CompletableFuture.whenComplete(CompletableFuture.java:2153) at org.apache.hadoop.hbase.util.FutureUtils.addListener(FutureUtils.java:61) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.traverseAndDelete(CleanerChore.java:439) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.lambda$null$2(CleanerChore.java:432) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.fs.PathIsNotEmptyDirectoryException): `/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/38bfa684335ca214a06d15565b8cb87b/family1 is non empty': Directory is not empty at org.apache.hadoop.hdfs.server.namenode.FSDirDeleteOp.delete(FSDirDeleteOp.java:115) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.delete(FSNamesystem.java:2873) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.delete(NameNodeRpcServer.java:1101) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.delete(ClientNamenodeProtocolServerSideTranslatorPB.java:648) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy29.delete(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.delete(ClientNamenodeProtocolTranslatorPB.java:572) at sun.reflect.GeneratedMethodAccessor7.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy30.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor7.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor7.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor7.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor7.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor7.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor7.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.delete(DFSClient.java:1593) ... 17 more 2023-02-12 03:54:34,843 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.HMaster$12(2441): Client=jenkins//148.251.75.209 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-02-12 03:54:34,844 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] procedure2.ProcedureExecutor(1029): Stored pid=59, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:35,255 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-02-12 03:54:35,257 DEBUG [PEWorker-4] util.FSTableDescriptors(519): Deleted hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000001 2023-02-12 03:54:35,257 INFO [PEWorker-4] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-02-12 03:54:35,260 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=60, ppid=59, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily}] 2023-02-12 03:54:35,264 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=38bfa684335ca214a06d15565b8cb87b, REOPEN/MOVE}] 2023-02-12 03:54:35,265 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=38bfa684335ca214a06d15565b8cb87b, REOPEN/MOVE 2023-02-12 03:54:35,266 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=38bfa684335ca214a06d15565b8cb87b, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:35,266 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676174061396.38bfa684335ca214a06d15565b8cb87b.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1676174075266"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676174075266"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676174075266"}]},"ts":"1676174075266"} 2023-02-12 03:54:35,268 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=62, ppid=61, state=RUNNABLE; CloseRegionProcedure 38bfa684335ca214a06d15565b8cb87b, server=jenkins-hbase20.apache.org,39639,1676173982450}] 2023-02-12 03:54:35,420 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(109): Close 38bfa684335ca214a06d15565b8cb87b 2023-02-12 03:54:35,420 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 38bfa684335ca214a06d15565b8cb87b, disabling compactions & flushes 2023-02-12 03:54:35,420 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1857): waiting for 1 compactions to complete for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676174061396.38bfa684335ca214a06d15565b8cb87b. 2023-02-12 03:54:36,016 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/38bfa684335ca214a06d15565b8cb87b/.tmp/family1/151f602f336f4bb5bfc7b074acb76a6d as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/38bfa684335ca214a06d15565b8cb87b/family1/151f602f336f4bb5bfc7b074acb76a6d 2023-02-12 03:54:36,023 INFO [RS:0;jenkins-hbase20:39639-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 38bfa684335ca214a06d15565b8cb87b/family1 of 38bfa684335ca214a06d15565b8cb87b into 151f602f336f4bb5bfc7b074acb76a6d(size=192.0 K), total size for store is 192.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-12 03:54:36,023 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 38bfa684335ca214a06d15565b8cb87b: 2023-02-12 03:54:36,023 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676174061396.38bfa684335ca214a06d15565b8cb87b. 2023-02-12 03:54:36,023 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676174061396.38bfa684335ca214a06d15565b8cb87b. 2023-02-12 03:54:36,024 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676174061396.38bfa684335ca214a06d15565b8cb87b. after waiting 0 ms 2023-02-12 03:54:36,024 INFO [RS:0;jenkins-hbase20:39639-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676174061396.38bfa684335ca214a06d15565b8cb87b., storeName=family1, fileCount=3, fileSize=388.1 K (190.5 K, 6.8 K, 190.9 K), priority=2, time=1676174074755; duration=1sec 2023-02-12 03:54:36,024 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676174061396.38bfa684335ca214a06d15565b8cb87b. 2023-02-12 03:54:36,024 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-12 03:54:36,028 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676174061396.38bfa684335ca214a06d15565b8cb87b.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/38bfa684335ca214a06d15565b8cb87b/family1/79b25bb0af414d92b854ab244f1efe9e, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/38bfa684335ca214a06d15565b8cb87b/family1/08d08741fd5a4d018e816e138adfad76, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/38bfa684335ca214a06d15565b8cb87b/family1/5b5cfcb605d148acafa531fd3d667858_SeqId_47_] to archive 2023-02-12 03:54:36,028 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676174061396.38bfa684335ca214a06d15565b8cb87b.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-02-12 03:54:36,031 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676174061396.38bfa684335ca214a06d15565b8cb87b.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/38bfa684335ca214a06d15565b8cb87b/family1/79b25bb0af414d92b854ab244f1efe9e to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/38bfa684335ca214a06d15565b8cb87b/family1/79b25bb0af414d92b854ab244f1efe9e 2023-02-12 03:54:36,032 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676174061396.38bfa684335ca214a06d15565b8cb87b.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/38bfa684335ca214a06d15565b8cb87b/family1/08d08741fd5a4d018e816e138adfad76 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/38bfa684335ca214a06d15565b8cb87b/family1/08d08741fd5a4d018e816e138adfad76 2023-02-12 03:54:36,034 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676174061396.38bfa684335ca214a06d15565b8cb87b.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/38bfa684335ca214a06d15565b8cb87b/family1/5b5cfcb605d148acafa531fd3d667858_SeqId_47_ to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/38bfa684335ca214a06d15565b8cb87b/family1/5b5cfcb605d148acafa531fd3d667858_SeqId_47_ 2023-02-12 03:54:36,039 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/38bfa684335ca214a06d15565b8cb87b/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-02-12 03:54:36,040 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676174061396.38bfa684335ca214a06d15565b8cb87b. 2023-02-12 03:54:36,040 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 38bfa684335ca214a06d15565b8cb87b: Waiting for close lock at 1676174075420Running coprocessor pre-close hooks at 1676174075420Disabling compacts and flushes for region at 1676174075420Disabling writes for close at 1676174076024 (+604 ms)Writing region close event to WAL at 1676174076036 (+12 ms)Running coprocessor post-close hooks at 1676174076039 (+3 ms)Closed at 1676174076040 (+1 ms) 2023-02-12 03:54:36,040 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(3509): Not adding moved region record: 38bfa684335ca214a06d15565b8cb87b to self. 2023-02-12 03:54:36,042 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(147): Closed 38bfa684335ca214a06d15565b8cb87b 2023-02-12 03:54:36,042 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=38bfa684335ca214a06d15565b8cb87b, regionState=CLOSED 2023-02-12 03:54:36,043 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676174061396.38bfa684335ca214a06d15565b8cb87b.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1676174076042"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676174076042"}]},"ts":"1676174076042"} 2023-02-12 03:54:36,046 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=62, resume processing ppid=61 2023-02-12 03:54:36,046 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=62, ppid=61, state=SUCCESS; CloseRegionProcedure 38bfa684335ca214a06d15565b8cb87b, server=jenkins-hbase20.apache.org,39639,1676173982450 in 776 msec 2023-02-12 03:54:36,047 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=38bfa684335ca214a06d15565b8cb87b, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase20.apache.org,39639,1676173982450; forceNewPlan=false, retain=true 2023-02-12 03:54:36,197 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=38bfa684335ca214a06d15565b8cb87b, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:36,198 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676174061396.38bfa684335ca214a06d15565b8cb87b.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1676174076197"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676174076197"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676174076197"}]},"ts":"1676174076197"} 2023-02-12 03:54:36,201 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=63, ppid=61, state=RUNNABLE; OpenRegionProcedure 38bfa684335ca214a06d15565b8cb87b, server=jenkins-hbase20.apache.org,39639,1676173982450}] 2023-02-12 03:54:36,361 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676174061396.38bfa684335ca214a06d15565b8cb87b. 2023-02-12 03:54:36,362 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 38bfa684335ca214a06d15565b8cb87b, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676174061396.38bfa684335ca214a06d15565b8cb87b.', STARTKEY => '', ENDKEY => ''} 2023-02-12 03:54:36,362 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 38bfa684335ca214a06d15565b8cb87b 2023-02-12 03:54:36,362 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676174061396.38bfa684335ca214a06d15565b8cb87b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:54:36,362 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 38bfa684335ca214a06d15565b8cb87b 2023-02-12 03:54:36,362 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 38bfa684335ca214a06d15565b8cb87b 2023-02-12 03:54:36,364 INFO [StoreOpener-38bfa684335ca214a06d15565b8cb87b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 38bfa684335ca214a06d15565b8cb87b 2023-02-12 03:54:36,365 DEBUG [StoreOpener-38bfa684335ca214a06d15565b8cb87b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/38bfa684335ca214a06d15565b8cb87b/family1 2023-02-12 03:54:36,365 DEBUG [StoreOpener-38bfa684335ca214a06d15565b8cb87b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/38bfa684335ca214a06d15565b8cb87b/family1 2023-02-12 03:54:36,366 INFO [StoreOpener-38bfa684335ca214a06d15565b8cb87b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 38bfa684335ca214a06d15565b8cb87b columnFamilyName family1 2023-02-12 03:54:36,372 DEBUG [StoreOpener-38bfa684335ca214a06d15565b8cb87b-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/38bfa684335ca214a06d15565b8cb87b/family1/151f602f336f4bb5bfc7b074acb76a6d 2023-02-12 03:54:36,372 INFO [StoreOpener-38bfa684335ca214a06d15565b8cb87b-1] regionserver.HStore(310): Store=38bfa684335ca214a06d15565b8cb87b/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:54:36,373 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/38bfa684335ca214a06d15565b8cb87b 2023-02-12 03:54:36,375 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/38bfa684335ca214a06d15565b8cb87b 2023-02-12 03:54:36,378 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 38bfa684335ca214a06d15565b8cb87b 2023-02-12 03:54:36,379 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 38bfa684335ca214a06d15565b8cb87b; next sequenceid=51; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60092735, jitterRate=-0.10454846918582916}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-12 03:54:36,379 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 38bfa684335ca214a06d15565b8cb87b: Running coprocessor pre-open hook at 1676174076362Writing region info on filesystem at 1676174076362Initializing all the Stores at 1676174076363 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} at 1676174076363Cleaning up temporary data from old regions at 1676174076375 (+12 ms)Cleaning up detritus from prior splits at 1676174076376 (+1 ms)Running coprocessor post-open hooks at 1676174076379 (+3 ms)Region opened successfully at 1676174076379 2023-02-12 03:54:36,380 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676174061396.38bfa684335ca214a06d15565b8cb87b., pid=63, masterSystemTime=1676174076354 2023-02-12 03:54:36,382 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676174061396.38bfa684335ca214a06d15565b8cb87b. 2023-02-12 03:54:36,382 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676174061396.38bfa684335ca214a06d15565b8cb87b. 2023-02-12 03:54:36,382 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=38bfa684335ca214a06d15565b8cb87b, regionState=OPEN, openSeqNum=51, regionLocation=jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:36,382 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676174061396.38bfa684335ca214a06d15565b8cb87b.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1676174076382"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676174076382"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676174076382"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676174076382"}]},"ts":"1676174076382"} 2023-02-12 03:54:36,386 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=63, resume processing ppid=61 2023-02-12 03:54:36,386 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=63, ppid=61, state=SUCCESS; OpenRegionProcedure 38bfa684335ca214a06d15565b8cb87b, server=jenkins-hbase20.apache.org,39639,1676173982450 in 183 msec 2023-02-12 03:54:36,387 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=61, resume processing ppid=60 2023-02-12 03:54:36,388 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=61, ppid=60, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=38bfa684335ca214a06d15565b8cb87b, REOPEN/MOVE in 1.1230 sec 2023-02-12 03:54:36,390 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=60, resume processing ppid=59 2023-02-12 03:54:36,390 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=60, ppid=59, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 1.1280 sec 2023-02-12 03:54:36,392 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=59, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 1.5480 sec 2023-02-12 03:54:36,393 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(1227): Checking to see if procedure is done pid=59 2023-02-12 03:54:36,394 INFO [Listener at localhost.localdomain/41049] compactions.TestMobCompactor(278): alter status finished 2023-02-12 03:54:36,395 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=40099] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:36,396 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676173985818] procedure2.ProcedureExecutor(1029): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-02-12 03:54:36,397 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-02-12 03:54:36,398 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1676174676398 2023-02-12 03:54:36,398 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676173985818] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-12 03:54:36,398 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676173985818] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-12 03:54:36,399 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676173985818] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-02-12 03:54:36,399 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676173985818] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-12 03:54:36,399 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676173985818] zookeeper.ReadOnlyZKClient(139): Connect 0x44c5049c to 127.0.0.1:59556 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 03:54:36,442 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676173985818] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@46ebc8f7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 03:54:36,443 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-12 03:54:36,443 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-12 03:54:36,443 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-12 03:54:36,443 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-12 03:54:36,443 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-12 03:54:37,275 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128dd618a634d7648028923b15ec868abeb to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151128dd618a634d7648028923b15ec868abeb 2023-02-12 03:54:37,276 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-12 03:54:37,290 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-12 03:54:37,291 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:50430, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-12 03:54:37,297 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-12 03:54:37,298 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:40612, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-12 03:54:37,305 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/d11466531f104fb89c8ec7b3c12f0ec6 first=Optional[r05] last=Optional[r8] 2023-02-12 03:54:37,306 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676174061396.38bfa684335ca214a06d15565b8cb87b., hostname=jenkins-hbase20.apache.org,39639,1676173982450, seqNum=51 for row with hfile group [{family1,hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/d11466531f104fb89c8ec7b3c12f0ec6}] 2023-02-12 03:54:37,310 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/d11466531f104fb89c8ec7b3c12f0ec6 for inclusion in 38bfa684335ca214a06d15565b8cb87b/family1 2023-02-12 03:54:37,312 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-02-12 03:54:37,313 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HStore(777): Region bounds: first= last= 2023-02-12 03:54:37,313 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HRegion(2445): Flush status journal for 38bfa684335ca214a06d15565b8cb87b: 2023-02-12 03:54:37,314 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/d11466531f104fb89c8ec7b3c12f0ec6 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__4rlcdokm1cs6kucef04b44dgvsc27okjgsvb62msi5vuacdg5u4c7asbu3mhlor1/family1/d11466531f104fb89c8ec7b3c12f0ec6 2023-02-12 03:54:37,316 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__4rlcdokm1cs6kucef04b44dgvsc27okjgsvb62msi5vuacdg5u4c7asbu3mhlor1/family1/d11466531f104fb89c8ec7b3c12f0ec6 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/38bfa684335ca214a06d15565b8cb87b/family1/453fad7728db4e0f95be275b7ae15bc2_SeqId_53_ 2023-02-12 03:54:37,317 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__4rlcdokm1cs6kucef04b44dgvsc27okjgsvb62msi5vuacdg5u4c7asbu3mhlor1/family1/d11466531f104fb89c8ec7b3c12f0ec6 into 38bfa684335ca214a06d15565b8cb87b/family1 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/38bfa684335ca214a06d15565b8cb87b/family1/453fad7728db4e0f95be275b7ae15bc2_SeqId_53_ - updating store file list. 2023-02-12 03:54:37,321 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/38bfa684335ca214a06d15565b8cb87b/family1/453fad7728db4e0f95be275b7ae15bc2_SeqId_53_ into 38bfa684335ca214a06d15565b8cb87b/family1 2023-02-12 03:54:37,321 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__4rlcdokm1cs6kucef04b44dgvsc27okjgsvb62msi5vuacdg5u4c7asbu3mhlor1/family1/d11466531f104fb89c8ec7b3c12f0ec6 into 38bfa684335ca214a06d15565b8cb87b/family1 (new location: hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/38bfa684335ca214a06d15565b8cb87b/family1/453fad7728db4e0f95be275b7ae15bc2_SeqId_53_) 2023-02-12 03:54:37,322 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__4rlcdokm1cs6kucef04b44dgvsc27okjgsvb62msi5vuacdg5u4c7asbu3mhlor1/family1/d11466531f104fb89c8ec7b3c12f0ec6 2023-02-12 03:54:37,324 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-12 03:54:37,325 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-12 03:54:37,326 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511207914f1fc73e74319915579ace9f72309 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511207914f1fc73e74319915579ace9f72309 2023-02-12 03:54:37,328 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015112805151fd9f74e4cbf9386cfc0674da79e to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015112805151fd9f74e4cbf9386cfc0674da79e 2023-02-12 03:54:37,328 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2 expired mob files are deleted 2023-02-12 03:54:37,328 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-02-12 03:54:37,328 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-12 03:54:37,328 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-12 03:54:37,329 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-12 03:54:37,329 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676173985818] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-12 03:54:37,329 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676173985818] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-12 03:54:37,330 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-02-12 03:54:37,331 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 934 msec 2023-02-12 03:54:37,385 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.HMaster$12(2441): Client=jenkins//148.251.75.209 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'DAILY'} 2023-02-12 03:54:37,386 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] procedure2.ProcedureExecutor(1029): Stored pid=65, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:37,795 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000003 2023-02-12 03:54:37,796 DEBUG [PEWorker-5] util.FSTableDescriptors(519): Deleted hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-02-12 03:54:37,796 INFO [PEWorker-5] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000003 2023-02-12 03:54:37,797 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=66, ppid=65, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily}] 2023-02-12 03:54:37,800 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=38bfa684335ca214a06d15565b8cb87b, REOPEN/MOVE}] 2023-02-12 03:54:37,800 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=38bfa684335ca214a06d15565b8cb87b, REOPEN/MOVE 2023-02-12 03:54:37,801 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=38bfa684335ca214a06d15565b8cb87b, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:37,801 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676174061396.38bfa684335ca214a06d15565b8cb87b.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1676174077801"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676174077801"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676174077801"}]},"ts":"1676174077801"} 2023-02-12 03:54:37,802 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=68, ppid=67, state=RUNNABLE; CloseRegionProcedure 38bfa684335ca214a06d15565b8cb87b, server=jenkins-hbase20.apache.org,39639,1676173982450}] 2023-02-12 03:54:37,954 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(109): Close 38bfa684335ca214a06d15565b8cb87b 2023-02-12 03:54:37,954 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 38bfa684335ca214a06d15565b8cb87b, disabling compactions & flushes 2023-02-12 03:54:37,954 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676174061396.38bfa684335ca214a06d15565b8cb87b. 2023-02-12 03:54:37,954 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676174061396.38bfa684335ca214a06d15565b8cb87b. 2023-02-12 03:54:37,954 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676174061396.38bfa684335ca214a06d15565b8cb87b. after waiting 0 ms 2023-02-12 03:54:37,954 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676174061396.38bfa684335ca214a06d15565b8cb87b. 2023-02-12 03:54:37,966 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/38bfa684335ca214a06d15565b8cb87b/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=50 2023-02-12 03:54:37,967 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676174061396.38bfa684335ca214a06d15565b8cb87b. 2023-02-12 03:54:37,967 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 38bfa684335ca214a06d15565b8cb87b: Waiting for close lock at 1676174077954Running coprocessor pre-close hooks at 1676174077954Disabling compacts and flushes for region at 1676174077954Disabling writes for close at 1676174077954Writing region close event to WAL at 1676174077959 (+5 ms)Running coprocessor post-close hooks at 1676174077967 (+8 ms)Closed at 1676174077967 2023-02-12 03:54:37,967 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(3509): Not adding moved region record: 38bfa684335ca214a06d15565b8cb87b to self. 2023-02-12 03:54:37,969 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(147): Closed 38bfa684335ca214a06d15565b8cb87b 2023-02-12 03:54:37,969 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=38bfa684335ca214a06d15565b8cb87b, regionState=CLOSED 2023-02-12 03:54:37,969 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676174061396.38bfa684335ca214a06d15565b8cb87b.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1676174077969"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676174077969"}]},"ts":"1676174077969"} 2023-02-12 03:54:37,973 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=68, resume processing ppid=67 2023-02-12 03:54:37,973 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=68, ppid=67, state=SUCCESS; CloseRegionProcedure 38bfa684335ca214a06d15565b8cb87b, server=jenkins-hbase20.apache.org,39639,1676173982450 in 169 msec 2023-02-12 03:54:37,974 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=38bfa684335ca214a06d15565b8cb87b, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase20.apache.org,39639,1676173982450; forceNewPlan=false, retain=true 2023-02-12 03:54:38,125 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=38bfa684335ca214a06d15565b8cb87b, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:38,125 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676174061396.38bfa684335ca214a06d15565b8cb87b.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1676174078125"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676174078125"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676174078125"}]},"ts":"1676174078125"} 2023-02-12 03:54:38,130 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=69, ppid=67, state=RUNNABLE; OpenRegionProcedure 38bfa684335ca214a06d15565b8cb87b, server=jenkins-hbase20.apache.org,39639,1676173982450}] 2023-02-12 03:54:38,288 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676174061396.38bfa684335ca214a06d15565b8cb87b. 2023-02-12 03:54:38,288 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 38bfa684335ca214a06d15565b8cb87b, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676174061396.38bfa684335ca214a06d15565b8cb87b.', STARTKEY => '', ENDKEY => ''} 2023-02-12 03:54:38,288 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 38bfa684335ca214a06d15565b8cb87b 2023-02-12 03:54:38,288 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676174061396.38bfa684335ca214a06d15565b8cb87b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:54:38,288 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 38bfa684335ca214a06d15565b8cb87b 2023-02-12 03:54:38,289 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 38bfa684335ca214a06d15565b8cb87b 2023-02-12 03:54:38,291 INFO [StoreOpener-38bfa684335ca214a06d15565b8cb87b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 38bfa684335ca214a06d15565b8cb87b 2023-02-12 03:54:38,293 DEBUG [StoreOpener-38bfa684335ca214a06d15565b8cb87b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/38bfa684335ca214a06d15565b8cb87b/family1 2023-02-12 03:54:38,293 DEBUG [StoreOpener-38bfa684335ca214a06d15565b8cb87b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/38bfa684335ca214a06d15565b8cb87b/family1 2023-02-12 03:54:38,293 INFO [StoreOpener-38bfa684335ca214a06d15565b8cb87b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 38bfa684335ca214a06d15565b8cb87b columnFamilyName family1 2023-02-12 03:54:38,303 DEBUG [StoreOpener-38bfa684335ca214a06d15565b8cb87b-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/38bfa684335ca214a06d15565b8cb87b/family1/151f602f336f4bb5bfc7b074acb76a6d 2023-02-12 03:54:38,307 DEBUG [StoreOpener-38bfa684335ca214a06d15565b8cb87b-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/38bfa684335ca214a06d15565b8cb87b/family1/453fad7728db4e0f95be275b7ae15bc2_SeqId_53_ 2023-02-12 03:54:38,307 INFO [StoreOpener-38bfa684335ca214a06d15565b8cb87b-1] regionserver.HStore(310): Store=38bfa684335ca214a06d15565b8cb87b/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:54:38,308 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/38bfa684335ca214a06d15565b8cb87b 2023-02-12 03:54:38,309 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/38bfa684335ca214a06d15565b8cb87b 2023-02-12 03:54:38,312 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 38bfa684335ca214a06d15565b8cb87b 2023-02-12 03:54:38,312 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 38bfa684335ca214a06d15565b8cb87b; next sequenceid=56; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62862935, jitterRate=-0.06326927244663239}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-12 03:54:38,313 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 38bfa684335ca214a06d15565b8cb87b: Running coprocessor pre-open hook at 1676174078289Writing region info on filesystem at 1676174078289Initializing all the Stores at 1676174078290 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'DAILY'} at 1676174078290Cleaning up temporary data from old regions at 1676174078310 (+20 ms)Cleaning up detritus from prior splits at 1676174078310Running coprocessor post-open hooks at 1676174078313 (+3 ms)Region opened successfully at 1676174078313 2023-02-12 03:54:38,313 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676174061396.38bfa684335ca214a06d15565b8cb87b., pid=69, masterSystemTime=1676174078283 2023-02-12 03:54:38,314 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676174061396.38bfa684335ca214a06d15565b8cb87b. 2023-02-12 03:54:38,315 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676174061396.38bfa684335ca214a06d15565b8cb87b. 2023-02-12 03:54:38,315 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=38bfa684335ca214a06d15565b8cb87b, regionState=OPEN, openSeqNum=56, regionLocation=jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:38,315 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676174061396.38bfa684335ca214a06d15565b8cb87b.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1676174078315"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676174078315"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676174078315"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676174078315"}]},"ts":"1676174078315"} 2023-02-12 03:54:38,318 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=69, resume processing ppid=67 2023-02-12 03:54:38,318 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=69, ppid=67, state=SUCCESS; OpenRegionProcedure 38bfa684335ca214a06d15565b8cb87b, server=jenkins-hbase20.apache.org,39639,1676173982450 in 186 msec 2023-02-12 03:54:38,319 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=67, resume processing ppid=66 2023-02-12 03:54:38,319 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=38bfa684335ca214a06d15565b8cb87b, REOPEN/MOVE in 518 msec 2023-02-12 03:54:38,321 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=66, resume processing ppid=65 2023-02-12 03:54:38,321 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=66, ppid=65, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 523 msec 2023-02-12 03:54:38,322 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=65, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 935 msec 2023-02-12 03:54:38,323 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(1227): Checking to see if procedure is done pid=65 2023-02-12 03:54:38,324 INFO [Listener at localhost.localdomain/41049] compactions.TestMobCompactor(278): alter status finished 2023-02-12 03:54:38,324 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=40099] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'DAILY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-12 03:54:38,326 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676173985818] procedure2.ProcedureExecutor(1029): Stored pid=70, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-02-12 03:54:38,326 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=70, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-02-12 03:54:38,327 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676173985818] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-12 03:54:38,327 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=70, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1676174678327 2023-02-12 03:54:38,328 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676173985818] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-12 03:54:38,328 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676173985818] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 4 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-02-12 03:54:38,328 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676173985818] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-12 03:54:38,329 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676173985818] zookeeper.ReadOnlyZKClient(139): Connect 0x689871d0 to 127.0.0.1:59556 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 03:54:38,333 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676173985818] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@defe799, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 03:54:38,333 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151128 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-12 03:54:38,333 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151128 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-12 03:54:38,333 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151205 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-12 03:54:38,333 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151205 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-12 03:54:38,333 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160103 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-12 03:54:38,333 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160103 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-12 03:54:38,333 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-12 03:54:38,333 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-12 03:54:38,333 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676173985818] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-12 03:54:38,333 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676173985818] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-12 03:54:38,334 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=70, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-02-12 03:54:38,335 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=70, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 9 msec 2023-02-12 03:54:38,388 INFO [Listener at localhost.localdomain/41049] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily Thread=242 (was 243), OpenFileDescriptor=617 (was 615) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=222 (was 244), ProcessCount=164 (was 164), AvailableMemoryMB=4013 (was 4110) 2023-02-12 03:54:38,398 INFO [Listener at localhost.localdomain/41049] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testGetAfterCompaction Thread=242, OpenFileDescriptor=617, MaxFileDescriptor=60000, SystemLoadAverage=222, ProcessCount=164, AvailableMemoryMB=4012 2023-02-12 03:54:38,401 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.HMaster$4(2102): Client=jenkins//148.251.75.209 create 'testGetAfterCompaction', {TABLE_ATTRIBUTES => {coprocessor$1 => '|org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro|1073741823|'}}, {NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-02-12 03:54:38,402 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] procedure2.ProcedureExecutor(1029): Stored pid=71, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testGetAfterCompaction 2023-02-12 03:54:38,404 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_PRE_OPERATION 2023-02-12 03:54:38,404 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(697): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testGetAfterCompaction" procId is: 71 2023-02-12 03:54:38,404 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-12 03:54:38,404 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-02-12 03:54:38,405 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/.tmp/data/default/testGetAfterCompaction/74f017819cfe8095b4318cb728395e44 2023-02-12 03:54:38,406 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/.tmp/data/default/testGetAfterCompaction/74f017819cfe8095b4318cb728395e44 empty. 2023-02-12 03:54:38,406 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/.tmp/data/default/testGetAfterCompaction/74f017819cfe8095b4318cb728395e44 2023-02-12 03:54:38,406 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testGetAfterCompaction regions 2023-02-12 03:54:38,506 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-02-12 03:54:38,707 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-02-12 03:54:38,814 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/.tmp/data/default/testGetAfterCompaction/.tabledesc/.tableinfo.0000000001 2023-02-12 03:54:38,816 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(7671): creating {ENCODED => 74f017819cfe8095b4318cb728395e44, NAME => 'testGetAfterCompaction,,1676174078401.74f017819cfe8095b4318cb728395e44.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testGetAfterCompaction', {TABLE_ATTRIBUTES => {coprocessor$1 => '|org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro|1073741823|'}}, {NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/.tmp 2023-02-12 03:54:39,008 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-02-12 03:54:39,227 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(865): Instantiated testGetAfterCompaction,,1676174078401.74f017819cfe8095b4318cb728395e44.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:54:39,228 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1603): Closing 74f017819cfe8095b4318cb728395e44, disabling compactions & flushes 2023-02-12 03:54:39,228 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1625): Closing region testGetAfterCompaction,,1676174078401.74f017819cfe8095b4318cb728395e44. 2023-02-12 03:54:39,228 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testGetAfterCompaction,,1676174078401.74f017819cfe8095b4318cb728395e44. 2023-02-12 03:54:39,228 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1713): Acquired close lock on testGetAfterCompaction,,1676174078401.74f017819cfe8095b4318cb728395e44. after waiting 0 ms 2023-02-12 03:54:39,228 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1723): Updates disabled for region testGetAfterCompaction,,1676174078401.74f017819cfe8095b4318cb728395e44. 2023-02-12 03:54:39,228 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1837): Closed testGetAfterCompaction,,1676174078401.74f017819cfe8095b4318cb728395e44. 2023-02-12 03:54:39,228 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1557): Region close journal for 74f017819cfe8095b4318cb728395e44: Waiting for close lock at 1676174079228Disabling compacts and flushes for region at 1676174079228Disabling writes for close at 1676174079228Writing region close event to WAL at 1676174079228Closed at 1676174079228 2023-02-12 03:54:39,232 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_ADD_TO_META 2023-02-12 03:54:39,234 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testGetAfterCompaction,,1676174078401.74f017819cfe8095b4318cb728395e44.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1676174079233"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676174079233"}]},"ts":"1676174079233"} 2023-02-12 03:54:39,235 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-12 03:54:39,236 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-12 03:54:39,236 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676174079236"}]},"ts":"1676174079236"} 2023-02-12 03:54:39,237 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=ENABLING in hbase:meta 2023-02-12 03:54:39,239 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testGetAfterCompaction, region=74f017819cfe8095b4318cb728395e44, ASSIGN}] 2023-02-12 03:54:39,241 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testGetAfterCompaction, region=74f017819cfe8095b4318cb728395e44, ASSIGN 2023-02-12 03:54:39,241 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testGetAfterCompaction, region=74f017819cfe8095b4318cb728395e44, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,39639,1676173982450; forceNewPlan=false, retain=false 2023-02-12 03:54:39,393 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=74f017819cfe8095b4318cb728395e44, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:39,393 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testGetAfterCompaction,,1676174078401.74f017819cfe8095b4318cb728395e44.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1676174079393"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676174079393"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676174079393"}]},"ts":"1676174079393"} 2023-02-12 03:54:39,395 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=73, ppid=72, state=RUNNABLE; OpenRegionProcedure 74f017819cfe8095b4318cb728395e44, server=jenkins-hbase20.apache.org,39639,1676173982450}] 2023-02-12 03:54:39,510 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-02-12 03:54:39,550 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testGetAfterCompaction,,1676174078401.74f017819cfe8095b4318cb728395e44. 2023-02-12 03:54:39,550 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 74f017819cfe8095b4318cb728395e44, NAME => 'testGetAfterCompaction,,1676174078401.74f017819cfe8095b4318cb728395e44.', STARTKEY => '', ENDKEY => ''} 2023-02-12 03:54:39,550 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro with path null and priority 1073741823 2023-02-12 03:54:39,552 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro from HTD of testGetAfterCompaction successfully. 2023-02-12 03:54:39,552 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testGetAfterCompaction 74f017819cfe8095b4318cb728395e44 2023-02-12 03:54:39,552 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testGetAfterCompaction,,1676174078401.74f017819cfe8095b4318cb728395e44.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:54:39,552 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 74f017819cfe8095b4318cb728395e44 2023-02-12 03:54:39,552 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 74f017819cfe8095b4318cb728395e44 2023-02-12 03:54:39,553 INFO [StoreOpener-74f017819cfe8095b4318cb728395e44-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 74f017819cfe8095b4318cb728395e44 2023-02-12 03:54:39,554 DEBUG [StoreOpener-74f017819cfe8095b4318cb728395e44-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testGetAfterCompaction/74f017819cfe8095b4318cb728395e44/f1 2023-02-12 03:54:39,554 DEBUG [StoreOpener-74f017819cfe8095b4318cb728395e44-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testGetAfterCompaction/74f017819cfe8095b4318cb728395e44/f1 2023-02-12 03:54:39,555 INFO [StoreOpener-74f017819cfe8095b4318cb728395e44-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 74f017819cfe8095b4318cb728395e44 columnFamilyName f1 2023-02-12 03:54:39,556 INFO [StoreOpener-74f017819cfe8095b4318cb728395e44-1] regionserver.HStore(310): Store=74f017819cfe8095b4318cb728395e44/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:54:39,557 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testGetAfterCompaction/74f017819cfe8095b4318cb728395e44 2023-02-12 03:54:39,557 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testGetAfterCompaction/74f017819cfe8095b4318cb728395e44 2023-02-12 03:54:39,559 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 74f017819cfe8095b4318cb728395e44 2023-02-12 03:54:39,560 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testGetAfterCompaction/74f017819cfe8095b4318cb728395e44/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 03:54:39,561 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 74f017819cfe8095b4318cb728395e44; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61304955, jitterRate=-0.08648498356342316}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-12 03:54:39,561 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 74f017819cfe8095b4318cb728395e44: Running coprocessor pre-open hook at 1676174079552Writing region info on filesystem at 1676174079552Initializing all the Stores at 1676174079553 (+1 ms)Instantiating store for column family {NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676174079553Cleaning up temporary data from old regions at 1676174079557 (+4 ms)Cleaning up detritus from prior splits at 1676174079558 (+1 ms)Running coprocessor post-open hooks at 1676174079561 (+3 ms)Region opened successfully at 1676174079561 2023-02-12 03:54:39,561 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testGetAfterCompaction,,1676174078401.74f017819cfe8095b4318cb728395e44., pid=73, masterSystemTime=1676174079547 2023-02-12 03:54:39,562 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testGetAfterCompaction,,1676174078401.74f017819cfe8095b4318cb728395e44. 2023-02-12 03:54:39,563 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testGetAfterCompaction,,1676174078401.74f017819cfe8095b4318cb728395e44. 2023-02-12 03:54:39,563 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=74f017819cfe8095b4318cb728395e44, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:39,563 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testGetAfterCompaction,,1676174078401.74f017819cfe8095b4318cb728395e44.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1676174079563"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676174079563"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676174079563"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676174079563"}]},"ts":"1676174079563"} 2023-02-12 03:54:39,566 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=73, resume processing ppid=72 2023-02-12 03:54:39,566 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=73, ppid=72, state=SUCCESS; OpenRegionProcedure 74f017819cfe8095b4318cb728395e44, server=jenkins-hbase20.apache.org,39639,1676173982450 in 169 msec 2023-02-12 03:54:39,568 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=72, resume processing ppid=71 2023-02-12 03:54:39,568 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testGetAfterCompaction, region=74f017819cfe8095b4318cb728395e44, ASSIGN in 327 msec 2023-02-12 03:54:39,568 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-12 03:54:39,568 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676174079568"}]},"ts":"1676174079568"} 2023-02-12 03:54:39,569 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=ENABLED in hbase:meta 2023-02-12 03:54:39,572 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_POST_OPERATION 2023-02-12 03:54:39,574 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=71, state=SUCCESS; CreateTableProcedure table=testGetAfterCompaction in 1.1710 sec 2023-02-12 03:54:40,075 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testGetAfterCompaction' 2023-02-12 03:54:40,513 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-02-12 03:54:40,514 INFO [Listener at localhost.localdomain/41049] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testGetAfterCompaction, procId: 71 completed 2023-02-12 03:54:40,514 DEBUG [Listener at localhost.localdomain/41049] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testGetAfterCompaction get assigned. Timeout = 60000ms 2023-02-12 03:54:40,518 INFO [Listener at localhost.localdomain/41049] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-12 03:54:40,522 INFO [Listener at localhost.localdomain/41049] hbase.HBaseTestingUtility(3484): All regions for table testGetAfterCompaction assigned to meta. Checking AM states. 2023-02-12 03:54:40,523 INFO [Listener at localhost.localdomain/41049] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-12 03:54:40,523 INFO [Listener at localhost.localdomain/41049] hbase.HBaseTestingUtility(3504): All regions for table testGetAfterCompaction assigned. 2023-02-12 03:54:40,526 INFO [Listener at localhost.localdomain/41049] regionserver.HRegion(2744): Flushing 74f017819cfe8095b4318cb728395e44 1/1 column families, dataSize=37 B heapSize=368 B 2023-02-12 03:54:40,945 INFO [Listener at localhost.localdomain/41049] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230212f51f4c98a31149869d90c6271a1d6a08 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20230212f51f4c98a31149869d90c6271a1d6a08 2023-02-12 03:54:41,353 INFO [Listener at localhost.localdomain/41049] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=37, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testGetAfterCompaction/74f017819cfe8095b4318cb728395e44/.tmp/f1/712bcbfc3a0f4ab091dc9c4fb8df6485 2023-02-12 03:54:41,364 DEBUG [Listener at localhost.localdomain/41049] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testGetAfterCompaction/74f017819cfe8095b4318cb728395e44/.tmp/f1/712bcbfc3a0f4ab091dc9c4fb8df6485 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testGetAfterCompaction/74f017819cfe8095b4318cb728395e44/f1/712bcbfc3a0f4ab091dc9c4fb8df6485 2023-02-12 03:54:41,368 INFO [Listener at localhost.localdomain/41049] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testGetAfterCompaction/74f017819cfe8095b4318cb728395e44/f1/712bcbfc3a0f4ab091dc9c4fb8df6485, entries=1, sequenceid=5, filesize=4.9 K 2023-02-12 03:54:41,369 INFO [Listener at localhost.localdomain/41049] regionserver.HRegion(2947): Finished flush of dataSize ~37 B/37, heapSize ~352 B/352, currentSize=0 B/0 for 74f017819cfe8095b4318cb728395e44 in 843ms, sequenceid=5, compaction requested=false 2023-02-12 03:54:41,370 DEBUG [Listener at localhost.localdomain/41049] regionserver.HRegion(2445): Flush status journal for 74f017819cfe8095b4318cb728395e44: 2023-02-12 03:54:41,372 INFO [Listener at localhost.localdomain/41049] regionserver.HRegion(2744): Flushing 74f017819cfe8095b4318cb728395e44 1/1 column families, dataSize=37 B heapSize=368 B 2023-02-12 03:54:41,575 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-12 03:54:41,613 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro 2023-02-12 03:54:41,613 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro Metrics about HBase RegionObservers 2023-02-12 03:54:41,791 INFO [Listener at localhost.localdomain/41049] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230212a31b805328994b7d8b9aacddf520d814 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20230212a31b805328994b7d8b9aacddf520d814 2023-02-12 03:54:42,200 INFO [Listener at localhost.localdomain/41049] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=37, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testGetAfterCompaction/74f017819cfe8095b4318cb728395e44/.tmp/f1/9baf8b05d8e5483abf5fa55aa57fe9ff 2023-02-12 03:54:42,212 DEBUG [Listener at localhost.localdomain/41049] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testGetAfterCompaction/74f017819cfe8095b4318cb728395e44/.tmp/f1/9baf8b05d8e5483abf5fa55aa57fe9ff as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testGetAfterCompaction/74f017819cfe8095b4318cb728395e44/f1/9baf8b05d8e5483abf5fa55aa57fe9ff 2023-02-12 03:54:42,216 INFO [Listener at localhost.localdomain/41049] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testGetAfterCompaction/74f017819cfe8095b4318cb728395e44/f1/9baf8b05d8e5483abf5fa55aa57fe9ff, entries=1, sequenceid=9, filesize=4.9 K 2023-02-12 03:54:42,217 INFO [Listener at localhost.localdomain/41049] regionserver.HRegion(2947): Finished flush of dataSize ~37 B/37, heapSize ~352 B/352, currentSize=0 B/0 for 74f017819cfe8095b4318cb728395e44 in 845ms, sequenceid=9, compaction requested=false 2023-02-12 03:54:42,217 DEBUG [Listener at localhost.localdomain/41049] regionserver.HRegion(2445): Flush status journal for 74f017819cfe8095b4318cb728395e44: 2023-02-12 03:54:42,218 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=40099] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testGetAfterCompaction 2023-02-12 03:54:42,219 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676173985818] procedure2.ProcedureExecutor(1029): Stored pid=74, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-02-12 03:54:42,220 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=74, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-02-12 03:54:42,220 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=74, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1676174682220 2023-02-12 03:54:42,220 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676173985818] mob.MobUtils(833): start MOB compaction of files for table='testGetAfterCompaction', column='f1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-12 03:54:42,221 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676173985818] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-02-12 03:54:42,221 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676173985818] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 2 selected files, and 0 irrelevant files table 'testGetAfterCompaction' and column 'f1' 2023-02-12 03:54:42,221 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676173985818] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testGetAfterCompaction' column='f1' 2023-02-12 03:54:42,221 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676173985818] zookeeper.ReadOnlyZKClient(139): Connect 0x18ad170f to 127.0.0.1:59556 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 03:54:42,225 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676173985818] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6a8ce8ac, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 03:54:42,225 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20230212 for table='testGetAfterCompaction' and column='f1' 2023-02-12 03:54:42,270 INFO [Listener at localhost.localdomain/41049] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testGetAfterCompaction/74f017819cfe8095b4318cb728395e44/f1/712bcbfc3a0f4ab091dc9c4fb8df6485; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676174081353; access_time=1676174080529; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-12 03:54:42,270 INFO [Listener at localhost.localdomain/41049] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testGetAfterCompaction/74f017819cfe8095b4318cb728395e44/f1/9baf8b05d8e5483abf5fa55aa57fe9ff; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676174082199; access_time=1676174081373; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-12 03:54:42,321 INFO [Listener at localhost.localdomain/41049] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testGetAfterCompaction/74f017819cfe8095b4318cb728395e44/f1/712bcbfc3a0f4ab091dc9c4fb8df6485; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676174081353; access_time=1676174080529; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-12 03:54:42,321 INFO [Listener at localhost.localdomain/41049] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testGetAfterCompaction/74f017819cfe8095b4318cb728395e44/f1/9baf8b05d8e5483abf5fa55aa57fe9ff; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676174082199; access_time=1676174081373; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-12 03:54:42,372 INFO [Listener at localhost.localdomain/41049] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testGetAfterCompaction/74f017819cfe8095b4318cb728395e44/f1/712bcbfc3a0f4ab091dc9c4fb8df6485; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676174081353; access_time=1676174080529; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-12 03:54:42,372 INFO [Listener at localhost.localdomain/41049] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testGetAfterCompaction/74f017819cfe8095b4318cb728395e44/f1/9baf8b05d8e5483abf5fa55aa57fe9ff; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676174082199; access_time=1676174081373; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-12 03:54:42,423 INFO [Listener at localhost.localdomain/41049] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testGetAfterCompaction/74f017819cfe8095b4318cb728395e44/f1/712bcbfc3a0f4ab091dc9c4fb8df6485; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676174081353; access_time=1676174080529; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-12 03:54:42,423 INFO [Listener at localhost.localdomain/41049] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testGetAfterCompaction/74f017819cfe8095b4318cb728395e44/f1/9baf8b05d8e5483abf5fa55aa57fe9ff; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676174082199; access_time=1676174081373; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-12 03:54:42,474 INFO [Listener at localhost.localdomain/41049] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testGetAfterCompaction/74f017819cfe8095b4318cb728395e44/f1/712bcbfc3a0f4ab091dc9c4fb8df6485; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676174081353; access_time=1676174080529; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-12 03:54:42,475 INFO [Listener at localhost.localdomain/41049] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testGetAfterCompaction/74f017819cfe8095b4318cb728395e44/f1/9baf8b05d8e5483abf5fa55aa57fe9ff; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676174082199; access_time=1676174081373; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-12 03:54:42,526 INFO [Listener at localhost.localdomain/41049] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testGetAfterCompaction/74f017819cfe8095b4318cb728395e44/f1/712bcbfc3a0f4ab091dc9c4fb8df6485; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676174081353; access_time=1676174080529; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-12 03:54:42,527 INFO [Listener at localhost.localdomain/41049] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testGetAfterCompaction/74f017819cfe8095b4318cb728395e44/f1/9baf8b05d8e5483abf5fa55aa57fe9ff; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676174082199; access_time=1676174081373; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-12 03:54:42,578 INFO [Listener at localhost.localdomain/41049] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testGetAfterCompaction/74f017819cfe8095b4318cb728395e44/f1/712bcbfc3a0f4ab091dc9c4fb8df6485; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676174081353; access_time=1676174080529; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-12 03:54:42,578 INFO [Listener at localhost.localdomain/41049] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testGetAfterCompaction/74f017819cfe8095b4318cb728395e44/f1/9baf8b05d8e5483abf5fa55aa57fe9ff; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676174082199; access_time=1676174081373; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-12 03:54:42,630 INFO [Listener at localhost.localdomain/41049] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testGetAfterCompaction/74f017819cfe8095b4318cb728395e44/f1/712bcbfc3a0f4ab091dc9c4fb8df6485; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676174081353; access_time=1676174080529; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-12 03:54:42,630 INFO [Listener at localhost.localdomain/41049] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testGetAfterCompaction/74f017819cfe8095b4318cb728395e44/f1/9baf8b05d8e5483abf5fa55aa57fe9ff; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676174082199; access_time=1676174081373; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-12 03:54:42,661 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023021262c216bd9af24ceaaa4799b2cd3f9be6 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e2023021262c216bd9af24ceaaa4799b2cd3f9be6 2023-02-12 03:54:42,662 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230212 table='testGetAfterCompaction' column='f1' 2023-02-12 03:54:42,672 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-12 03:54:42,673 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:50436, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-12 03:54:42,680 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-12 03:54:42,682 INFO [Listener at localhost.localdomain/41049] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testGetAfterCompaction/74f017819cfe8095b4318cb728395e44/f1/712bcbfc3a0f4ab091dc9c4fb8df6485; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676174081353; access_time=1676174080529; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-12 03:54:42,682 INFO [Listener at localhost.localdomain/41049] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testGetAfterCompaction/74f017819cfe8095b4318cb728395e44/f1/9baf8b05d8e5483abf5fa55aa57fe9ff; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676174082199; access_time=1676174081373; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-12 03:54:42,682 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:40628, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-12 03:54:42,692 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20230212/f1/1e0cfc69717b45adab5d978c48e9336b first=Optional[r1] last=Optional[r2] 2023-02-12 03:54:42,692 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testGetAfterCompaction,,1676174078401.74f017819cfe8095b4318cb728395e44., hostname=jenkins-hbase20.apache.org,39639,1676173982450, seqNum=2 for row with hfile group [{f1,hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20230212/f1/1e0cfc69717b45adab5d978c48e9336b}] 2023-02-12 03:54:42,697 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20230212/f1/1e0cfc69717b45adab5d978c48e9336b for inclusion in 74f017819cfe8095b4318cb728395e44/f1 2023-02-12 03:54:42,699 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HStore(775): HFile bounds: first=r1 last=r2 2023-02-12 03:54:42,699 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HStore(777): Region bounds: first= last= 2023-02-12 03:54:42,699 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HRegion(2445): Flush status journal for 74f017819cfe8095b4318cb728395e44: 2023-02-12 03:54:42,700 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20230212/f1/1e0cfc69717b45adab5d978c48e9336b to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/staging/jenkins__testGetAfterCompaction__spf93m2hkercitso1gvr3dib23pak9nfli0peq3vihptqqlufhest2lq6i0b28hv/f1/1e0cfc69717b45adab5d978c48e9336b 2023-02-12 03:54:42,702 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/staging/jenkins__testGetAfterCompaction__spf93m2hkercitso1gvr3dib23pak9nfli0peq3vihptqqlufhest2lq6i0b28hv/f1/1e0cfc69717b45adab5d978c48e9336b as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testGetAfterCompaction/74f017819cfe8095b4318cb728395e44/f1/b74ce1af53e14777accd03d311b92e17_SeqId_12_ 2023-02-12 03:54:42,703 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/staging/jenkins__testGetAfterCompaction__spf93m2hkercitso1gvr3dib23pak9nfli0peq3vihptqqlufhest2lq6i0b28hv/f1/1e0cfc69717b45adab5d978c48e9336b into 74f017819cfe8095b4318cb728395e44/f1 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testGetAfterCompaction/74f017819cfe8095b4318cb728395e44/f1/b74ce1af53e14777accd03d311b92e17_SeqId_12_ - updating store file list. 2023-02-12 03:54:42,707 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testGetAfterCompaction/74f017819cfe8095b4318cb728395e44/f1/b74ce1af53e14777accd03d311b92e17_SeqId_12_ into 74f017819cfe8095b4318cb728395e44/f1 2023-02-12 03:54:42,707 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/staging/jenkins__testGetAfterCompaction__spf93m2hkercitso1gvr3dib23pak9nfli0peq3vihptqqlufhest2lq6i0b28hv/f1/1e0cfc69717b45adab5d978c48e9336b into 74f017819cfe8095b4318cb728395e44/f1 (new location: hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testGetAfterCompaction/74f017819cfe8095b4318cb728395e44/f1/b74ce1af53e14777accd03d311b92e17_SeqId_12_) 2023-02-12 03:54:42,708 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/staging/jenkins__testGetAfterCompaction__spf93m2hkercitso1gvr3dib23pak9nfli0peq3vihptqqlufhest2lq6i0b28hv/f1/1e0cfc69717b45adab5d978c48e9336b 2023-02-12 03:54:42,708 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HStore(1912): 74f017819cfe8095b4318cb728395e44/f1 is initiating minor compaction 2023-02-12 03:54:42,708 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@2d840e11; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-02-12 03:54:42,708 INFO [RS:0;jenkins-hbase20:39639-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 74f017819cfe8095b4318cb728395e44/f1 in testGetAfterCompaction,,1676174078401.74f017819cfe8095b4318cb728395e44. 2023-02-12 03:54:42,709 INFO [RS:0;jenkins-hbase20:39639-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testGetAfterCompaction/74f017819cfe8095b4318cb728395e44/f1/9baf8b05d8e5483abf5fa55aa57fe9ff, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testGetAfterCompaction/74f017819cfe8095b4318cb728395e44/f1/b74ce1af53e14777accd03d311b92e17_SeqId_12_] into tmpdir=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testGetAfterCompaction/74f017819cfe8095b4318cb728395e44/.tmp, totalSize=10.0 K 2023-02-12 03:54:42,709 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] compactions.Compactor(207): Compacting 9baf8b05d8e5483abf5fa55aa57fe9ff, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=9 2023-02-12 03:54:42,709 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] compactions.Compactor(207): Compacting b74ce1af53e14777accd03d311b92e17_SeqId_12_, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13 2023-02-12 03:54:42,711 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230212 table='testGetAfterCompaction' column='f1' 2023-02-12 03:54:42,712 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-12 03:54:42,714 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20230212a31b805328994b7d8b9aacddf520d814 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20230212a31b805328994b7d8b9aacddf520d814 2023-02-12 03:54:42,715 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20230212f51f4c98a31149869d90c6271a1d6a08 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20230212f51f4c98a31149869d90c6271a1d6a08 2023-02-12 03:54:42,715 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testGetAfterCompaction 2 expired mob files are deleted 2023-02-12 03:54:42,715 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20230212' 2023-02-12 03:54:42,716 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20230212 for table='testGetAfterCompaction' and column='f1' 2023-02-12 03:54:42,716 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676173985818] compactions.PartitionedMobCompactor(354): After compaction, there are 1 mob files. table='testGetAfterCompaction' column='f1' 2023-02-12 03:54:42,716 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676173985818] mob.MobUtils(840): end MOB compaction of files for table='testGetAfterCompaction', column='f1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-12 03:54:42,717 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=74, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-02-12 03:54:42,718 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=74, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE in 498 msec 2023-02-12 03:54:42,718 INFO [RS:0;jenkins-hbase20:39639-shortCompactions-0] throttle.PressureAwareThroughputController(145): 74f017819cfe8095b4318cb728395e44#f1#compaction#77 average throughput is 0.13 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 80.77 MB/second 2023-02-12 03:54:42,733 INFO [Listener at localhost.localdomain/41049] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testGetAfterCompaction/74f017819cfe8095b4318cb728395e44/f1/712bcbfc3a0f4ab091dc9c4fb8df6485; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676174081353; access_time=1676174080529; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-12 03:54:42,733 INFO [Listener at localhost.localdomain/41049] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testGetAfterCompaction/74f017819cfe8095b4318cb728395e44/f1/9baf8b05d8e5483abf5fa55aa57fe9ff; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676174082199; access_time=1676174081373; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-12 03:54:42,733 INFO [Listener at localhost.localdomain/41049] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testGetAfterCompaction/74f017819cfe8095b4318cb728395e44/f1/b74ce1af53e14777accd03d311b92e17_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1676174082657; access_time=1676174082237; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-12 03:54:42,736 DEBUG [Listener at localhost.localdomain/41049] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-12 03:54:42,740 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:50448, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-12 03:54:42,741 INFO [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=39639] regionserver.RSRpcServices(1662): Compacting testGetAfterCompaction,,1676174078401.74f017819cfe8095b4318cb728395e44. 2023-02-12 03:54:42,741 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=39639] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 2 compacting, 0 eligible, 16 blocking 2023-02-12 03:54:42,741 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=39639] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 0 files of size 0 starting at candidate #-1 after considering 0 permutations with 0 in ratio 2023-02-12 03:54:42,741 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=39639] compactions.SortedCompactionPolicy(232): Not compacting files because we only have 0 files ready for compaction. Need 3 to initiate. 2023-02-12 03:54:42,741 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=39639] regionserver.CompactSplit(415): Not compacting testGetAfterCompaction,,1676174078401.74f017819cfe8095b4318cb728395e44. because compaction request was cancelled 2023-02-12 03:54:42,794 INFO [Listener at localhost.localdomain/41049] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testGetAfterCompaction/74f017819cfe8095b4318cb728395e44/f1/712bcbfc3a0f4ab091dc9c4fb8df6485; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676174081353; access_time=1676174080529; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-12 03:54:42,794 INFO [Listener at localhost.localdomain/41049] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testGetAfterCompaction/74f017819cfe8095b4318cb728395e44/f1/9baf8b05d8e5483abf5fa55aa57fe9ff; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676174082199; access_time=1676174081373; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-12 03:54:42,794 INFO [Listener at localhost.localdomain/41049] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testGetAfterCompaction/74f017819cfe8095b4318cb728395e44/f1/b74ce1af53e14777accd03d311b92e17_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1676174082657; access_time=1676174082237; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-12 03:54:42,846 INFO [Listener at localhost.localdomain/41049] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testGetAfterCompaction/74f017819cfe8095b4318cb728395e44/f1/712bcbfc3a0f4ab091dc9c4fb8df6485; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676174081353; access_time=1676174080529; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-12 03:54:42,847 INFO [Listener at localhost.localdomain/41049] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testGetAfterCompaction/74f017819cfe8095b4318cb728395e44/f1/9baf8b05d8e5483abf5fa55aa57fe9ff; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676174082199; access_time=1676174081373; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-12 03:54:42,847 INFO [Listener at localhost.localdomain/41049] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testGetAfterCompaction/74f017819cfe8095b4318cb728395e44/f1/b74ce1af53e14777accd03d311b92e17_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1676174082657; access_time=1676174082237; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-12 03:54:42,898 INFO [Listener at localhost.localdomain/41049] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testGetAfterCompaction/74f017819cfe8095b4318cb728395e44/f1/712bcbfc3a0f4ab091dc9c4fb8df6485; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676174081353; access_time=1676174080529; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-12 03:54:42,899 INFO [Listener at localhost.localdomain/41049] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testGetAfterCompaction/74f017819cfe8095b4318cb728395e44/f1/9baf8b05d8e5483abf5fa55aa57fe9ff; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676174082199; access_time=1676174081373; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-12 03:54:42,899 INFO [Listener at localhost.localdomain/41049] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testGetAfterCompaction/74f017819cfe8095b4318cb728395e44/f1/b74ce1af53e14777accd03d311b92e17_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1676174082657; access_time=1676174082237; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-12 03:54:42,951 INFO [Listener at localhost.localdomain/41049] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testGetAfterCompaction/74f017819cfe8095b4318cb728395e44/f1/712bcbfc3a0f4ab091dc9c4fb8df6485; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676174081353; access_time=1676174080529; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-12 03:54:42,951 INFO [Listener at localhost.localdomain/41049] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testGetAfterCompaction/74f017819cfe8095b4318cb728395e44/f1/9baf8b05d8e5483abf5fa55aa57fe9ff; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676174082199; access_time=1676174081373; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-12 03:54:42,951 INFO [Listener at localhost.localdomain/41049] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testGetAfterCompaction/74f017819cfe8095b4318cb728395e44/f1/b74ce1af53e14777accd03d311b92e17_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1676174082657; access_time=1676174082237; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-12 03:54:43,002 INFO [Listener at localhost.localdomain/41049] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testGetAfterCompaction/74f017819cfe8095b4318cb728395e44/f1/712bcbfc3a0f4ab091dc9c4fb8df6485; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676174081353; access_time=1676174080529; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-12 03:54:43,003 INFO [Listener at localhost.localdomain/41049] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testGetAfterCompaction/74f017819cfe8095b4318cb728395e44/f1/9baf8b05d8e5483abf5fa55aa57fe9ff; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676174082199; access_time=1676174081373; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-12 03:54:43,003 INFO [Listener at localhost.localdomain/41049] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testGetAfterCompaction/74f017819cfe8095b4318cb728395e44/f1/b74ce1af53e14777accd03d311b92e17_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1676174082657; access_time=1676174082237; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-12 03:54:43,054 INFO [Listener at localhost.localdomain/41049] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testGetAfterCompaction/74f017819cfe8095b4318cb728395e44/f1/712bcbfc3a0f4ab091dc9c4fb8df6485; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676174081353; access_time=1676174080529; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-12 03:54:43,054 INFO [Listener at localhost.localdomain/41049] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testGetAfterCompaction/74f017819cfe8095b4318cb728395e44/f1/9baf8b05d8e5483abf5fa55aa57fe9ff; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676174082199; access_time=1676174081373; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-12 03:54:43,054 INFO [Listener at localhost.localdomain/41049] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testGetAfterCompaction/74f017819cfe8095b4318cb728395e44/f1/b74ce1af53e14777accd03d311b92e17_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1676174082657; access_time=1676174082237; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-12 03:54:43,106 INFO [Listener at localhost.localdomain/41049] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testGetAfterCompaction/74f017819cfe8095b4318cb728395e44/f1/712bcbfc3a0f4ab091dc9c4fb8df6485; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676174081353; access_time=1676174080529; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-12 03:54:43,107 INFO [Listener at localhost.localdomain/41049] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testGetAfterCompaction/74f017819cfe8095b4318cb728395e44/f1/9baf8b05d8e5483abf5fa55aa57fe9ff; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676174082199; access_time=1676174081373; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-12 03:54:43,107 INFO [Listener at localhost.localdomain/41049] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testGetAfterCompaction/74f017819cfe8095b4318cb728395e44/f1/b74ce1af53e14777accd03d311b92e17_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1676174082657; access_time=1676174082237; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-12 03:54:43,158 INFO [Listener at localhost.localdomain/41049] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testGetAfterCompaction/74f017819cfe8095b4318cb728395e44/f1/712bcbfc3a0f4ab091dc9c4fb8df6485; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676174081353; access_time=1676174080529; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-12 03:54:43,158 INFO [Listener at localhost.localdomain/41049] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testGetAfterCompaction/74f017819cfe8095b4318cb728395e44/f1/9baf8b05d8e5483abf5fa55aa57fe9ff; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676174082199; access_time=1676174081373; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-12 03:54:43,158 INFO [Listener at localhost.localdomain/41049] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testGetAfterCompaction/74f017819cfe8095b4318cb728395e44/f1/b74ce1af53e14777accd03d311b92e17_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1676174082657; access_time=1676174082237; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-12 03:54:43,209 INFO [Listener at localhost.localdomain/41049] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testGetAfterCompaction/74f017819cfe8095b4318cb728395e44/f1/712bcbfc3a0f4ab091dc9c4fb8df6485; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676174081353; access_time=1676174080529; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-12 03:54:43,209 INFO [Listener at localhost.localdomain/41049] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testGetAfterCompaction/74f017819cfe8095b4318cb728395e44/f1/9baf8b05d8e5483abf5fa55aa57fe9ff; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676174082199; access_time=1676174081373; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-12 03:54:43,209 INFO [Listener at localhost.localdomain/41049] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testGetAfterCompaction/74f017819cfe8095b4318cb728395e44/f1/b74ce1af53e14777accd03d311b92e17_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1676174082657; access_time=1676174082237; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-12 03:54:43,261 INFO [Listener at localhost.localdomain/41049] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testGetAfterCompaction/74f017819cfe8095b4318cb728395e44/f1/712bcbfc3a0f4ab091dc9c4fb8df6485; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676174081353; access_time=1676174080529; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-12 03:54:43,261 INFO [Listener at localhost.localdomain/41049] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testGetAfterCompaction/74f017819cfe8095b4318cb728395e44/f1/9baf8b05d8e5483abf5fa55aa57fe9ff; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676174082199; access_time=1676174081373; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-12 03:54:43,261 INFO [Listener at localhost.localdomain/41049] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testGetAfterCompaction/74f017819cfe8095b4318cb728395e44/f1/b74ce1af53e14777accd03d311b92e17_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1676174082657; access_time=1676174082237; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-12 03:54:43,312 INFO [Listener at localhost.localdomain/41049] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testGetAfterCompaction/74f017819cfe8095b4318cb728395e44/f1/712bcbfc3a0f4ab091dc9c4fb8df6485; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676174081353; access_time=1676174080529; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-12 03:54:43,312 INFO [Listener at localhost.localdomain/41049] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testGetAfterCompaction/74f017819cfe8095b4318cb728395e44/f1/9baf8b05d8e5483abf5fa55aa57fe9ff; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676174082199; access_time=1676174081373; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-12 03:54:43,312 INFO [Listener at localhost.localdomain/41049] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testGetAfterCompaction/74f017819cfe8095b4318cb728395e44/f1/b74ce1af53e14777accd03d311b92e17_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1676174082657; access_time=1676174082237; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-12 03:54:43,364 INFO [Listener at localhost.localdomain/41049] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testGetAfterCompaction/74f017819cfe8095b4318cb728395e44/f1/712bcbfc3a0f4ab091dc9c4fb8df6485; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676174081353; access_time=1676174080529; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-12 03:54:43,364 INFO [Listener at localhost.localdomain/41049] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testGetAfterCompaction/74f017819cfe8095b4318cb728395e44/f1/9baf8b05d8e5483abf5fa55aa57fe9ff; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676174082199; access_time=1676174081373; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-12 03:54:43,364 INFO [Listener at localhost.localdomain/41049] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testGetAfterCompaction/74f017819cfe8095b4318cb728395e44/f1/b74ce1af53e14777accd03d311b92e17_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1676174082657; access_time=1676174082237; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-12 03:54:43,415 INFO [Listener at localhost.localdomain/41049] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testGetAfterCompaction/74f017819cfe8095b4318cb728395e44/f1/712bcbfc3a0f4ab091dc9c4fb8df6485; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676174081353; access_time=1676174080529; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-12 03:54:43,416 INFO [Listener at localhost.localdomain/41049] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testGetAfterCompaction/74f017819cfe8095b4318cb728395e44/f1/9baf8b05d8e5483abf5fa55aa57fe9ff; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676174082199; access_time=1676174081373; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-12 03:54:43,416 INFO [Listener at localhost.localdomain/41049] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testGetAfterCompaction/74f017819cfe8095b4318cb728395e44/f1/b74ce1af53e14777accd03d311b92e17_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1676174082657; access_time=1676174082237; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-12 03:54:43,467 INFO [Listener at localhost.localdomain/41049] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testGetAfterCompaction/74f017819cfe8095b4318cb728395e44/f1/712bcbfc3a0f4ab091dc9c4fb8df6485; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676174081353; access_time=1676174080529; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-12 03:54:43,467 INFO [Listener at localhost.localdomain/41049] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testGetAfterCompaction/74f017819cfe8095b4318cb728395e44/f1/9baf8b05d8e5483abf5fa55aa57fe9ff; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676174082199; access_time=1676174081373; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-12 03:54:43,467 INFO [Listener at localhost.localdomain/41049] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testGetAfterCompaction/74f017819cfe8095b4318cb728395e44/f1/b74ce1af53e14777accd03d311b92e17_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1676174082657; access_time=1676174082237; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-12 03:54:43,520 INFO [Listener at localhost.localdomain/41049] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testGetAfterCompaction/74f017819cfe8095b4318cb728395e44/f1/712bcbfc3a0f4ab091dc9c4fb8df6485; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676174081353; access_time=1676174080529; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-12 03:54:43,520 INFO [Listener at localhost.localdomain/41049] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testGetAfterCompaction/74f017819cfe8095b4318cb728395e44/f1/9baf8b05d8e5483abf5fa55aa57fe9ff; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676174082199; access_time=1676174081373; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-12 03:54:43,520 INFO [Listener at localhost.localdomain/41049] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testGetAfterCompaction/74f017819cfe8095b4318cb728395e44/f1/b74ce1af53e14777accd03d311b92e17_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1676174082657; access_time=1676174082237; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-12 03:54:43,539 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testGetAfterCompaction/74f017819cfe8095b4318cb728395e44/.tmp/f1/10cd444426e44a6b81fd15f924fbb06e as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testGetAfterCompaction/74f017819cfe8095b4318cb728395e44/f1/10cd444426e44a6b81fd15f924fbb06e 2023-02-12 03:54:43,544 INFO [RS:0;jenkins-hbase20:39639-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 2 file(s) in 74f017819cfe8095b4318cb728395e44/f1 of 74f017819cfe8095b4318cb728395e44 into 10cd444426e44a6b81fd15f924fbb06e(size=5.1 K), total size for store is 10.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-12 03:54:43,544 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 74f017819cfe8095b4318cb728395e44: 2023-02-12 03:54:43,544 INFO [RS:0;jenkins-hbase20:39639-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testGetAfterCompaction,,1676174078401.74f017819cfe8095b4318cb728395e44., storeName=f1, fileCount=2, fileSize=10.0 K (4.9 K, 5.1 K), priority=2, time=1676174082708; duration=0sec 2023-02-12 03:54:43,544 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-12 03:54:43,551 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testGetAfterCompaction/74f017819cfe8095b4318cb728395e44/f1/9baf8b05d8e5483abf5fa55aa57fe9ff, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testGetAfterCompaction/74f017819cfe8095b4318cb728395e44/f1/b74ce1af53e14777accd03d311b92e17_SeqId_12_] to archive 2023-02-12 03:54:43,552 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-12 03:54:43,554 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testGetAfterCompaction/74f017819cfe8095b4318cb728395e44/f1/9baf8b05d8e5483abf5fa55aa57fe9ff to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testGetAfterCompaction/74f017819cfe8095b4318cb728395e44/f1/9baf8b05d8e5483abf5fa55aa57fe9ff 2023-02-12 03:54:43,556 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testGetAfterCompaction/74f017819cfe8095b4318cb728395e44/f1/b74ce1af53e14777accd03d311b92e17_SeqId_12_ to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testGetAfterCompaction/74f017819cfe8095b4318cb728395e44/f1/b74ce1af53e14777accd03d311b92e17_SeqId_12_ 2023-02-12 03:54:43,572 INFO [Listener at localhost.localdomain/41049] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testGetAfterCompaction/74f017819cfe8095b4318cb728395e44/f1/10cd444426e44a6b81fd15f924fbb06e; isDirectory=false; length=5228; replication=1; blocksize=134217728; modification_time=1676174083535; access_time=1676174082715; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-12 03:54:43,572 INFO [Listener at localhost.localdomain/41049] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testGetAfterCompaction/74f017819cfe8095b4318cb728395e44/f1/712bcbfc3a0f4ab091dc9c4fb8df6485; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1676174081353; access_time=1676174080529; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-12 03:54:43,699 INFO [Listener at localhost.localdomain/41049] client.HBaseAdmin$15(890): Started disable of testGetAfterCompaction 2023-02-12 03:54:43,703 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.HMaster$11(2405): Client=jenkins//148.251.75.209 disable testGetAfterCompaction 2023-02-12 03:54:43,707 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] procedure2.ProcedureExecutor(1029): Stored pid=75, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testGetAfterCompaction 2023-02-12 03:54:43,710 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676174083710"}]},"ts":"1676174083710"} 2023-02-12 03:54:43,711 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=DISABLING in hbase:meta 2023-02-12 03:54:43,711 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(1227): Checking to see if procedure is done pid=75 2023-02-12 03:54:43,712 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testGetAfterCompaction to state=DISABLING 2023-02-12 03:54:43,713 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=76, ppid=75, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testGetAfterCompaction, region=74f017819cfe8095b4318cb728395e44, UNASSIGN}] 2023-02-12 03:54:43,714 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=75, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testGetAfterCompaction, region=74f017819cfe8095b4318cb728395e44, UNASSIGN 2023-02-12 03:54:43,715 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=74f017819cfe8095b4318cb728395e44, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:43,715 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testGetAfterCompaction,,1676174078401.74f017819cfe8095b4318cb728395e44.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1676174083715"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676174083715"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676174083715"}]},"ts":"1676174083715"} 2023-02-12 03:54:43,716 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; CloseRegionProcedure 74f017819cfe8095b4318cb728395e44, server=jenkins-hbase20.apache.org,39639,1676173982450}] 2023-02-12 03:54:43,813 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(1227): Checking to see if procedure is done pid=75 2023-02-12 03:54:43,868 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(109): Close 74f017819cfe8095b4318cb728395e44 2023-02-12 03:54:43,868 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 74f017819cfe8095b4318cb728395e44, disabling compactions & flushes 2023-02-12 03:54:43,868 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testGetAfterCompaction,,1676174078401.74f017819cfe8095b4318cb728395e44. 2023-02-12 03:54:43,868 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testGetAfterCompaction,,1676174078401.74f017819cfe8095b4318cb728395e44. 2023-02-12 03:54:43,868 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testGetAfterCompaction,,1676174078401.74f017819cfe8095b4318cb728395e44. after waiting 0 ms 2023-02-12 03:54:43,868 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testGetAfterCompaction,,1676174078401.74f017819cfe8095b4318cb728395e44. 2023-02-12 03:54:43,882 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testGetAfterCompaction/74f017819cfe8095b4318cb728395e44/recovered.edits/15.seqid, newMaxSeqId=15, maxSeqId=1 2023-02-12 03:54:43,883 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro 2023-02-12 03:54:43,884 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testGetAfterCompaction,,1676174078401.74f017819cfe8095b4318cb728395e44. 2023-02-12 03:54:43,884 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 74f017819cfe8095b4318cb728395e44: Waiting for close lock at 1676174083868Running coprocessor pre-close hooks at 1676174083868Disabling compacts and flushes for region at 1676174083868Disabling writes for close at 1676174083868Writing region close event to WAL at 1676174083874 (+6 ms)Running coprocessor post-close hooks at 1676174083883 (+9 ms)Closed at 1676174083884 (+1 ms) 2023-02-12 03:54:43,885 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(147): Closed 74f017819cfe8095b4318cb728395e44 2023-02-12 03:54:43,885 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=74f017819cfe8095b4318cb728395e44, regionState=CLOSED 2023-02-12 03:54:43,885 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testGetAfterCompaction,,1676174078401.74f017819cfe8095b4318cb728395e44.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1676174083885"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676174083885"}]},"ts":"1676174083885"} 2023-02-12 03:54:43,887 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=77, resume processing ppid=76 2023-02-12 03:54:43,887 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=77, ppid=76, state=SUCCESS; CloseRegionProcedure 74f017819cfe8095b4318cb728395e44, server=jenkins-hbase20.apache.org,39639,1676173982450 in 170 msec 2023-02-12 03:54:43,888 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=76, resume processing ppid=75 2023-02-12 03:54:43,888 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=76, ppid=75, state=SUCCESS; TransitRegionStateProcedure table=testGetAfterCompaction, region=74f017819cfe8095b4318cb728395e44, UNASSIGN in 174 msec 2023-02-12 03:54:43,889 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676174083889"}]},"ts":"1676174083889"} 2023-02-12 03:54:43,889 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=DISABLED in hbase:meta 2023-02-12 03:54:43,890 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testGetAfterCompaction to state=DISABLED 2023-02-12 03:54:43,892 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=75, state=SUCCESS; DisableTableProcedure table=testGetAfterCompaction in 187 msec 2023-02-12 03:54:44,014 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(1227): Checking to see if procedure is done pid=75 2023-02-12 03:54:44,014 INFO [Listener at localhost.localdomain/41049] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testGetAfterCompaction, procId: 75 completed 2023-02-12 03:54:44,020 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.HMaster$5(2215): Client=jenkins//148.251.75.209 delete testGetAfterCompaction 2023-02-12 03:54:44,028 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] procedure2.ProcedureExecutor(1029): Stored pid=78, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testGetAfterCompaction 2023-02-12 03:54:44,030 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=78, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-02-12 03:54:44,031 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=78, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-02-12 03:54:44,032 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(1227): Checking to see if procedure is done pid=78 2023-02-12 03:54:44,034 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/.tmp/data/default/testGetAfterCompaction/74f017819cfe8095b4318cb728395e44 2023-02-12 03:54:44,036 DEBUG [HFileArchiver-12] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/.tmp/data/default/testGetAfterCompaction/74f017819cfe8095b4318cb728395e44/f1, FileablePath, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/.tmp/data/default/testGetAfterCompaction/74f017819cfe8095b4318cb728395e44/recovered.edits] 2023-02-12 03:54:44,038 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/.tmp/data/default/testGetAfterCompaction/74f017819cfe8095b4318cb728395e44/f1/10cd444426e44a6b81fd15f924fbb06e to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testGetAfterCompaction/74f017819cfe8095b4318cb728395e44/f1/10cd444426e44a6b81fd15f924fbb06e 2023-02-12 03:54:44,039 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/.tmp/data/default/testGetAfterCompaction/74f017819cfe8095b4318cb728395e44/f1/712bcbfc3a0f4ab091dc9c4fb8df6485 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testGetAfterCompaction/74f017819cfe8095b4318cb728395e44/f1/712bcbfc3a0f4ab091dc9c4fb8df6485 2023-02-12 03:54:44,042 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/.tmp/data/default/testGetAfterCompaction/74f017819cfe8095b4318cb728395e44/recovered.edits/15.seqid to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testGetAfterCompaction/74f017819cfe8095b4318cb728395e44/recovered.edits/15.seqid 2023-02-12 03:54:44,042 DEBUG [HFileArchiver-12] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/.tmp/data/default/testGetAfterCompaction/74f017819cfe8095b4318cb728395e44 2023-02-12 03:54:44,042 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testGetAfterCompaction regions 2023-02-12 03:54:44,042 DEBUG [PEWorker-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0 2023-02-12 03:54:44,043 DEBUG [PEWorker-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1] 2023-02-12 03:54:44,045 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e2023021262c216bd9af24ceaaa4799b2cd3f9be6 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e2023021262c216bd9af24ceaaa4799b2cd3f9be6 2023-02-12 03:54:44,045 DEBUG [PEWorker-5] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0 2023-02-12 03:54:44,046 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=78, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-02-12 03:54:44,065 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testGetAfterCompaction from hbase:meta 2023-02-12 03:54:44,067 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testGetAfterCompaction' descriptor. 2023-02-12 03:54:44,068 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=78, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-02-12 03:54:44,068 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testGetAfterCompaction' from region states. 2023-02-12 03:54:44,068 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testGetAfterCompaction,,1676174078401.74f017819cfe8095b4318cb728395e44.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676174084068"}]},"ts":"9223372036854775807"} 2023-02-12 03:54:44,069 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-12 03:54:44,069 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 74f017819cfe8095b4318cb728395e44, NAME => 'testGetAfterCompaction,,1676174078401.74f017819cfe8095b4318cb728395e44.', STARTKEY => '', ENDKEY => ''}] 2023-02-12 03:54:44,069 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testGetAfterCompaction' as deleted. 2023-02-12 03:54:44,070 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1676174084069"}]},"ts":"9223372036854775807"} 2023-02-12 03:54:44,071 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testGetAfterCompaction state from META 2023-02-12 03:54:44,072 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=78, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-02-12 03:54:44,073 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=78, state=SUCCESS; DeleteTableProcedure table=testGetAfterCompaction in 50 msec 2023-02-12 03:54:44,134 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(1227): Checking to see if procedure is done pid=78 2023-02-12 03:54:44,134 INFO [Listener at localhost.localdomain/41049] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testGetAfterCompaction, procId: 78 completed 2023-02-12 03:54:44,155 INFO [Listener at localhost.localdomain/41049] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testGetAfterCompaction Thread=244 (was 242) - Thread LEAK? -, OpenFileDescriptor=614 (was 617), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=188 (was 222), ProcessCount=164 (was 164), AvailableMemoryMB=4014 (was 4012) - AvailableMemoryMB LEAK? - 2023-02-12 03:54:44,165 INFO [Listener at localhost.localdomain/41049] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testCompactionWithHFileLink Thread=244, OpenFileDescriptor=614, MaxFileDescriptor=60000, SystemLoadAverage=188, ProcessCount=164, AvailableMemoryMB=4014 2023-02-12 03:54:44,167 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.HMaster$4(2102): Client=jenkins//148.251.75.209 create 'testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-02-12 03:54:44,167 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] procedure2.ProcedureExecutor(1029): Stored pid=79, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testCompactionWithHFileLink 2023-02-12 03:54:44,169 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_PRE_OPERATION 2023-02-12 03:54:44,169 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(697): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testCompactionWithHFileLink" procId is: 79 2023-02-12 03:54:44,169 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-12 03:54:44,170 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-02-12 03:54:44,171 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/.tmp/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d 2023-02-12 03:54:44,171 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/.tmp/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e 2023-02-12 03:54:44,171 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/.tmp/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc 2023-02-12 03:54:44,172 DEBUG [HFileArchiver-14] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/.tmp/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e empty. 2023-02-12 03:54:44,172 DEBUG [HFileArchiver-13] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/.tmp/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d empty. 2023-02-12 03:54:44,172 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/.tmp/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc empty. 2023-02-12 03:54:44,172 DEBUG [HFileArchiver-14] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/.tmp/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e 2023-02-12 03:54:44,172 DEBUG [HFileArchiver-13] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/.tmp/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d 2023-02-12 03:54:44,172 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/.tmp/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc 2023-02-12 03:54:44,172 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testCompactionWithHFileLink regions 2023-02-12 03:54:44,271 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-02-12 03:54:44,473 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-02-12 03:54:44,580 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/.tmp/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000001 2023-02-12 03:54:44,581 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(7671): creating {ENCODED => 4e8254a6d12aded099b366c106c6930d, NAME => 'testCompactionWithHFileLink,,1676174084167.4e8254a6d12aded099b366c106c6930d.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/.tmp 2023-02-12 03:54:44,582 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(7671): creating {ENCODED => 0e9d0e06e60b6abe7b05797a5112bb5e, NAME => 'testCompactionWithHFileLink,1,1676174084167.0e9d0e06e60b6abe7b05797a5112bb5e.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/.tmp 2023-02-12 03:54:44,582 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(7671): creating {ENCODED => 369851c5c3dd6d38afc3b2a16e1a3ffc, NAME => 'testCompactionWithHFileLink,2,1676174084167.369851c5c3dd6d38afc3b2a16e1a3ffc.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/.tmp 2023-02-12 03:54:44,775 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-02-12 03:54:44,995 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(865): Instantiated testCompactionWithHFileLink,1,1676174084167.0e9d0e06e60b6abe7b05797a5112bb5e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:54:44,995 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1603): Closing 0e9d0e06e60b6abe7b05797a5112bb5e, disabling compactions & flushes 2023-02-12 03:54:44,995 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1625): Closing region testCompactionWithHFileLink,1,1676174084167.0e9d0e06e60b6abe7b05797a5112bb5e. 2023-02-12 03:54:44,995 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1676174084167.0e9d0e06e60b6abe7b05797a5112bb5e. 2023-02-12 03:54:44,995 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1713): Acquired close lock on testCompactionWithHFileLink,1,1676174084167.0e9d0e06e60b6abe7b05797a5112bb5e. after waiting 0 ms 2023-02-12 03:54:44,996 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1723): Updates disabled for region testCompactionWithHFileLink,1,1676174084167.0e9d0e06e60b6abe7b05797a5112bb5e. 2023-02-12 03:54:44,996 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1837): Closed testCompactionWithHFileLink,1,1676174084167.0e9d0e06e60b6abe7b05797a5112bb5e. 2023-02-12 03:54:44,996 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1557): Region close journal for 0e9d0e06e60b6abe7b05797a5112bb5e: Waiting for close lock at 1676174084995Disabling compacts and flushes for region at 1676174084995Disabling writes for close at 1676174084996 (+1 ms)Writing region close event to WAL at 1676174084996Closed at 1676174084996 2023-02-12 03:54:44,999 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(865): Instantiated testCompactionWithHFileLink,,1676174084167.4e8254a6d12aded099b366c106c6930d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:54:44,999 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(865): Instantiated testCompactionWithHFileLink,2,1676174084167.369851c5c3dd6d38afc3b2a16e1a3ffc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:54:44,999 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1603): Closing 4e8254a6d12aded099b366c106c6930d, disabling compactions & flushes 2023-02-12 03:54:44,999 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1625): Closing region testCompactionWithHFileLink,,1676174084167.4e8254a6d12aded099b366c106c6930d. 2023-02-12 03:54:44,999 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1603): Closing 369851c5c3dd6d38afc3b2a16e1a3ffc, disabling compactions & flushes 2023-02-12 03:54:45,000 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testCompactionWithHFileLink,,1676174084167.4e8254a6d12aded099b366c106c6930d. 2023-02-12 03:54:45,000 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1625): Closing region testCompactionWithHFileLink,2,1676174084167.369851c5c3dd6d38afc3b2a16e1a3ffc. 2023-02-12 03:54:45,000 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1713): Acquired close lock on testCompactionWithHFileLink,,1676174084167.4e8254a6d12aded099b366c106c6930d. after waiting 0 ms 2023-02-12 03:54:45,000 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1676174084167.369851c5c3dd6d38afc3b2a16e1a3ffc. 2023-02-12 03:54:45,000 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1723): Updates disabled for region testCompactionWithHFileLink,,1676174084167.4e8254a6d12aded099b366c106c6930d. 2023-02-12 03:54:45,000 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1713): Acquired close lock on testCompactionWithHFileLink,2,1676174084167.369851c5c3dd6d38afc3b2a16e1a3ffc. after waiting 0 ms 2023-02-12 03:54:45,000 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1837): Closed testCompactionWithHFileLink,,1676174084167.4e8254a6d12aded099b366c106c6930d. 2023-02-12 03:54:45,000 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1723): Updates disabled for region testCompactionWithHFileLink,2,1676174084167.369851c5c3dd6d38afc3b2a16e1a3ffc. 2023-02-12 03:54:45,000 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1557): Region close journal for 4e8254a6d12aded099b366c106c6930d: Waiting for close lock at 1676174084999Disabling compacts and flushes for region at 1676174084999Disabling writes for close at 1676174085000 (+1 ms)Writing region close event to WAL at 1676174085000Closed at 1676174085000 2023-02-12 03:54:45,000 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1837): Closed testCompactionWithHFileLink,2,1676174084167.369851c5c3dd6d38afc3b2a16e1a3ffc. 2023-02-12 03:54:45,000 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1557): Region close journal for 369851c5c3dd6d38afc3b2a16e1a3ffc: Waiting for close lock at 1676174084999Disabling compacts and flushes for region at 1676174084999Disabling writes for close at 1676174085000 (+1 ms)Writing region close event to WAL at 1676174085000Closed at 1676174085000 2023-02-12 03:54:45,003 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_ADD_TO_META 2023-02-12 03:54:45,005 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1676174084167.0e9d0e06e60b6abe7b05797a5112bb5e.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1676174085005"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676174085005"}]},"ts":"1676174085005"} 2023-02-12 03:54:45,005 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1676174084167.4e8254a6d12aded099b366c106c6930d.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1676174085005"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676174085005"}]},"ts":"1676174085005"} 2023-02-12 03:54:45,005 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1676174084167.369851c5c3dd6d38afc3b2a16e1a3ffc.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1676174085005"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676174085005"}]},"ts":"1676174085005"} 2023-02-12 03:54:45,008 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-02-12 03:54:45,009 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-12 03:54:45,009 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676174085009"}]},"ts":"1676174085009"} 2023-02-12 03:54:45,010 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLING in hbase:meta 2023-02-12 03:54:45,015 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=4e8254a6d12aded099b366c106c6930d, ASSIGN}, {pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=0e9d0e06e60b6abe7b05797a5112bb5e, ASSIGN}, {pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=369851c5c3dd6d38afc3b2a16e1a3ffc, ASSIGN}] 2023-02-12 03:54:45,017 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=369851c5c3dd6d38afc3b2a16e1a3ffc, ASSIGN 2023-02-12 03:54:45,017 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=0e9d0e06e60b6abe7b05797a5112bb5e, ASSIGN 2023-02-12 03:54:45,017 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=4e8254a6d12aded099b366c106c6930d, ASSIGN 2023-02-12 03:54:45,018 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=369851c5c3dd6d38afc3b2a16e1a3ffc, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,39639,1676173982450; forceNewPlan=false, retain=false 2023-02-12 03:54:45,018 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=4e8254a6d12aded099b366c106c6930d, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,39639,1676173982450; forceNewPlan=false, retain=false 2023-02-12 03:54:45,018 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=0e9d0e06e60b6abe7b05797a5112bb5e, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,39639,1676173982450; forceNewPlan=false, retain=false 2023-02-12 03:54:45,171 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=80 updating hbase:meta row=4e8254a6d12aded099b366c106c6930d, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:45,171 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=82 updating hbase:meta row=369851c5c3dd6d38afc3b2a16e1a3ffc, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:45,171 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=0e9d0e06e60b6abe7b05797a5112bb5e, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:45,171 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1676174084167.369851c5c3dd6d38afc3b2a16e1a3ffc.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1676174085171"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676174085171"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676174085171"}]},"ts":"1676174085171"} 2023-02-12 03:54:45,171 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1676174084167.4e8254a6d12aded099b366c106c6930d.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1676174085171"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676174085171"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676174085171"}]},"ts":"1676174085171"} 2023-02-12 03:54:45,172 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1676174084167.0e9d0e06e60b6abe7b05797a5112bb5e.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1676174085171"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676174085171"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676174085171"}]},"ts":"1676174085171"} 2023-02-12 03:54:45,174 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=83, ppid=82, state=RUNNABLE; OpenRegionProcedure 369851c5c3dd6d38afc3b2a16e1a3ffc, server=jenkins-hbase20.apache.org,39639,1676173982450}] 2023-02-12 03:54:45,176 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=84, ppid=80, state=RUNNABLE; OpenRegionProcedure 4e8254a6d12aded099b366c106c6930d, server=jenkins-hbase20.apache.org,39639,1676173982450}] 2023-02-12 03:54:45,179 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=85, ppid=81, state=RUNNABLE; OpenRegionProcedure 0e9d0e06e60b6abe7b05797a5112bb5e, server=jenkins-hbase20.apache.org,39639,1676173982450}] 2023-02-12 03:54:45,277 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-02-12 03:54:45,334 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,1,1676174084167.0e9d0e06e60b6abe7b05797a5112bb5e. 2023-02-12 03:54:45,334 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 0e9d0e06e60b6abe7b05797a5112bb5e, NAME => 'testCompactionWithHFileLink,1,1676174084167.0e9d0e06e60b6abe7b05797a5112bb5e.', STARTKEY => '1', ENDKEY => '2'} 2023-02-12 03:54:45,334 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 0e9d0e06e60b6abe7b05797a5112bb5e 2023-02-12 03:54:45,335 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testCompactionWithHFileLink,1,1676174084167.0e9d0e06e60b6abe7b05797a5112bb5e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:54:45,335 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 0e9d0e06e60b6abe7b05797a5112bb5e 2023-02-12 03:54:45,335 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 0e9d0e06e60b6abe7b05797a5112bb5e 2023-02-12 03:54:45,337 INFO [StoreOpener-0e9d0e06e60b6abe7b05797a5112bb5e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 0e9d0e06e60b6abe7b05797a5112bb5e 2023-02-12 03:54:45,340 DEBUG [StoreOpener-0e9d0e06e60b6abe7b05797a5112bb5e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/family1 2023-02-12 03:54:45,340 DEBUG [StoreOpener-0e9d0e06e60b6abe7b05797a5112bb5e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/family1 2023-02-12 03:54:45,341 INFO [StoreOpener-0e9d0e06e60b6abe7b05797a5112bb5e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0e9d0e06e60b6abe7b05797a5112bb5e columnFamilyName family1 2023-02-12 03:54:45,343 INFO [StoreOpener-0e9d0e06e60b6abe7b05797a5112bb5e-1] regionserver.HStore(310): Store=0e9d0e06e60b6abe7b05797a5112bb5e/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:54:45,344 INFO [StoreOpener-0e9d0e06e60b6abe7b05797a5112bb5e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 0e9d0e06e60b6abe7b05797a5112bb5e 2023-02-12 03:54:45,345 DEBUG [StoreOpener-0e9d0e06e60b6abe7b05797a5112bb5e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/family2 2023-02-12 03:54:45,345 DEBUG [StoreOpener-0e9d0e06e60b6abe7b05797a5112bb5e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/family2 2023-02-12 03:54:45,345 INFO [StoreOpener-0e9d0e06e60b6abe7b05797a5112bb5e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0e9d0e06e60b6abe7b05797a5112bb5e columnFamilyName family2 2023-02-12 03:54:45,347 INFO [StoreOpener-0e9d0e06e60b6abe7b05797a5112bb5e-1] regionserver.HStore(310): Store=0e9d0e06e60b6abe7b05797a5112bb5e/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:54:45,348 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e 2023-02-12 03:54:45,348 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e 2023-02-12 03:54:45,350 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 03:54:45,351 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 0e9d0e06e60b6abe7b05797a5112bb5e 2023-02-12 03:54:45,353 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 03:54:45,354 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 0e9d0e06e60b6abe7b05797a5112bb5e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61138423, jitterRate=-0.088966503739357}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 03:54:45,354 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 0e9d0e06e60b6abe7b05797a5112bb5e: Running coprocessor pre-open hook at 1676174085335Writing region info on filesystem at 1676174085335Initializing all the Stores at 1676174085337 (+2 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676174085337Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676174085337Cleaning up temporary data from old regions at 1676174085349 (+12 ms)Cleaning up detritus from prior splits at 1676174085349Running coprocessor post-open hooks at 1676174085354 (+5 ms)Region opened successfully at 1676174085354 2023-02-12 03:54:45,355 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,1,1676174084167.0e9d0e06e60b6abe7b05797a5112bb5e., pid=85, masterSystemTime=1676174085329 2023-02-12 03:54:45,356 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,1,1676174084167.0e9d0e06e60b6abe7b05797a5112bb5e. 2023-02-12 03:54:45,356 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,1,1676174084167.0e9d0e06e60b6abe7b05797a5112bb5e. 2023-02-12 03:54:45,356 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,,1676174084167.4e8254a6d12aded099b366c106c6930d. 2023-02-12 03:54:45,357 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 4e8254a6d12aded099b366c106c6930d, NAME => 'testCompactionWithHFileLink,,1676174084167.4e8254a6d12aded099b366c106c6930d.', STARTKEY => '', ENDKEY => '1'} 2023-02-12 03:54:45,357 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 4e8254a6d12aded099b366c106c6930d 2023-02-12 03:54:45,357 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testCompactionWithHFileLink,,1676174084167.4e8254a6d12aded099b366c106c6930d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:54:45,357 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 4e8254a6d12aded099b366c106c6930d 2023-02-12 03:54:45,357 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 4e8254a6d12aded099b366c106c6930d 2023-02-12 03:54:45,358 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=0e9d0e06e60b6abe7b05797a5112bb5e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:45,358 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,1,1676174084167.0e9d0e06e60b6abe7b05797a5112bb5e.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1676174085357"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676174085357"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676174085357"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676174085357"}]},"ts":"1676174085357"} 2023-02-12 03:54:45,359 INFO [StoreOpener-4e8254a6d12aded099b366c106c6930d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 4e8254a6d12aded099b366c106c6930d 2023-02-12 03:54:45,361 DEBUG [StoreOpener-4e8254a6d12aded099b366c106c6930d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/family1 2023-02-12 03:54:45,361 DEBUG [StoreOpener-4e8254a6d12aded099b366c106c6930d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/family1 2023-02-12 03:54:45,362 INFO [StoreOpener-4e8254a6d12aded099b366c106c6930d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4e8254a6d12aded099b366c106c6930d columnFamilyName family1 2023-02-12 03:54:45,362 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=85, resume processing ppid=81 2023-02-12 03:54:45,362 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=85, ppid=81, state=SUCCESS; OpenRegionProcedure 0e9d0e06e60b6abe7b05797a5112bb5e, server=jenkins-hbase20.apache.org,39639,1676173982450 in 182 msec 2023-02-12 03:54:45,363 INFO [StoreOpener-4e8254a6d12aded099b366c106c6930d-1] regionserver.HStore(310): Store=4e8254a6d12aded099b366c106c6930d/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:54:45,363 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=81, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=0e9d0e06e60b6abe7b05797a5112bb5e, ASSIGN in 348 msec 2023-02-12 03:54:45,363 INFO [StoreOpener-4e8254a6d12aded099b366c106c6930d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 4e8254a6d12aded099b366c106c6930d 2023-02-12 03:54:45,365 DEBUG [StoreOpener-4e8254a6d12aded099b366c106c6930d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/family2 2023-02-12 03:54:45,365 DEBUG [StoreOpener-4e8254a6d12aded099b366c106c6930d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/family2 2023-02-12 03:54:45,365 INFO [StoreOpener-4e8254a6d12aded099b366c106c6930d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4e8254a6d12aded099b366c106c6930d columnFamilyName family2 2023-02-12 03:54:45,366 INFO [StoreOpener-4e8254a6d12aded099b366c106c6930d-1] regionserver.HStore(310): Store=4e8254a6d12aded099b366c106c6930d/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:54:45,367 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d 2023-02-12 03:54:45,367 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d 2023-02-12 03:54:45,368 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 03:54:45,369 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 4e8254a6d12aded099b366c106c6930d 2023-02-12 03:54:45,370 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 03:54:45,371 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 4e8254a6d12aded099b366c106c6930d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72337179, jitterRate=0.07790796458721161}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 03:54:45,371 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 4e8254a6d12aded099b366c106c6930d: Running coprocessor pre-open hook at 1676174085358Writing region info on filesystem at 1676174085358Initializing all the Stores at 1676174085358Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676174085359 (+1 ms)Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676174085359Cleaning up temporary data from old regions at 1676174085368 (+9 ms)Cleaning up detritus from prior splits at 1676174085368Running coprocessor post-open hooks at 1676174085371 (+3 ms)Region opened successfully at 1676174085371 2023-02-12 03:54:45,371 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,,1676174084167.4e8254a6d12aded099b366c106c6930d., pid=84, masterSystemTime=1676174085329 2023-02-12 03:54:45,372 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,,1676174084167.4e8254a6d12aded099b366c106c6930d. 2023-02-12 03:54:45,372 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,,1676174084167.4e8254a6d12aded099b366c106c6930d. 2023-02-12 03:54:45,372 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,2,1676174084167.369851c5c3dd6d38afc3b2a16e1a3ffc. 2023-02-12 03:54:45,373 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 369851c5c3dd6d38afc3b2a16e1a3ffc, NAME => 'testCompactionWithHFileLink,2,1676174084167.369851c5c3dd6d38afc3b2a16e1a3ffc.', STARTKEY => '2', ENDKEY => ''} 2023-02-12 03:54:45,373 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=80 updating hbase:meta row=4e8254a6d12aded099b366c106c6930d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:45,373 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 369851c5c3dd6d38afc3b2a16e1a3ffc 2023-02-12 03:54:45,373 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,,1676174084167.4e8254a6d12aded099b366c106c6930d.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1676174085373"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676174085373"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676174085373"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676174085373"}]},"ts":"1676174085373"} 2023-02-12 03:54:45,373 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testCompactionWithHFileLink,2,1676174084167.369851c5c3dd6d38afc3b2a16e1a3ffc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:54:45,373 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 369851c5c3dd6d38afc3b2a16e1a3ffc 2023-02-12 03:54:45,373 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 369851c5c3dd6d38afc3b2a16e1a3ffc 2023-02-12 03:54:45,374 INFO [StoreOpener-369851c5c3dd6d38afc3b2a16e1a3ffc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 369851c5c3dd6d38afc3b2a16e1a3ffc 2023-02-12 03:54:45,375 DEBUG [StoreOpener-369851c5c3dd6d38afc3b2a16e1a3ffc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/family1 2023-02-12 03:54:45,375 DEBUG [StoreOpener-369851c5c3dd6d38afc3b2a16e1a3ffc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/family1 2023-02-12 03:54:45,375 INFO [StoreOpener-369851c5c3dd6d38afc3b2a16e1a3ffc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 369851c5c3dd6d38afc3b2a16e1a3ffc columnFamilyName family1 2023-02-12 03:54:45,376 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=84, resume processing ppid=80 2023-02-12 03:54:45,376 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=84, ppid=80, state=SUCCESS; OpenRegionProcedure 4e8254a6d12aded099b366c106c6930d, server=jenkins-hbase20.apache.org,39639,1676173982450 in 198 msec 2023-02-12 03:54:45,376 INFO [StoreOpener-369851c5c3dd6d38afc3b2a16e1a3ffc-1] regionserver.HStore(310): Store=369851c5c3dd6d38afc3b2a16e1a3ffc/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:54:45,376 INFO [StoreOpener-369851c5c3dd6d38afc3b2a16e1a3ffc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 369851c5c3dd6d38afc3b2a16e1a3ffc 2023-02-12 03:54:45,377 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=80, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=4e8254a6d12aded099b366c106c6930d, ASSIGN in 362 msec 2023-02-12 03:54:45,377 DEBUG [StoreOpener-369851c5c3dd6d38afc3b2a16e1a3ffc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/family2 2023-02-12 03:54:45,377 DEBUG [StoreOpener-369851c5c3dd6d38afc3b2a16e1a3ffc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/family2 2023-02-12 03:54:45,378 INFO [StoreOpener-369851c5c3dd6d38afc3b2a16e1a3ffc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 369851c5c3dd6d38afc3b2a16e1a3ffc columnFamilyName family2 2023-02-12 03:54:45,378 INFO [StoreOpener-369851c5c3dd6d38afc3b2a16e1a3ffc-1] regionserver.HStore(310): Store=369851c5c3dd6d38afc3b2a16e1a3ffc/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:54:45,379 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc 2023-02-12 03:54:45,379 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc 2023-02-12 03:54:45,380 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 03:54:45,381 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 369851c5c3dd6d38afc3b2a16e1a3ffc 2023-02-12 03:54:45,382 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 03:54:45,383 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 369851c5c3dd6d38afc3b2a16e1a3ffc; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65214657, jitterRate=-0.028225883841514587}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 03:54:45,383 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 369851c5c3dd6d38afc3b2a16e1a3ffc: Running coprocessor pre-open hook at 1676174085373Writing region info on filesystem at 1676174085373Initializing all the Stores at 1676174085374 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676174085374Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676174085374Cleaning up temporary data from old regions at 1676174085380 (+6 ms)Cleaning up detritus from prior splits at 1676174085380Running coprocessor post-open hooks at 1676174085383 (+3 ms)Region opened successfully at 1676174085383 2023-02-12 03:54:45,383 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,2,1676174084167.369851c5c3dd6d38afc3b2a16e1a3ffc., pid=83, masterSystemTime=1676174085329 2023-02-12 03:54:45,385 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,2,1676174084167.369851c5c3dd6d38afc3b2a16e1a3ffc. 2023-02-12 03:54:45,385 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,2,1676174084167.369851c5c3dd6d38afc3b2a16e1a3ffc. 2023-02-12 03:54:45,385 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=82 updating hbase:meta row=369851c5c3dd6d38afc3b2a16e1a3ffc, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:45,385 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,2,1676174084167.369851c5c3dd6d38afc3b2a16e1a3ffc.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1676174085385"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676174085385"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676174085385"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676174085385"}]},"ts":"1676174085385"} 2023-02-12 03:54:45,387 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=83, resume processing ppid=82 2023-02-12 03:54:45,387 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=83, ppid=82, state=SUCCESS; OpenRegionProcedure 369851c5c3dd6d38afc3b2a16e1a3ffc, server=jenkins-hbase20.apache.org,39639,1676173982450 in 212 msec 2023-02-12 03:54:45,388 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=82, resume processing ppid=79 2023-02-12 03:54:45,388 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=82, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=369851c5c3dd6d38afc3b2a16e1a3ffc, ASSIGN in 372 msec 2023-02-12 03:54:45,389 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-12 03:54:45,389 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676174085389"}]},"ts":"1676174085389"} 2023-02-12 03:54:45,390 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLED in hbase:meta 2023-02-12 03:54:45,391 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_POST_OPERATION 2023-02-12 03:54:45,392 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=79, state=SUCCESS; CreateTableProcedure table=testCompactionWithHFileLink in 1.2240 sec 2023-02-12 03:54:46,077 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testCompactionWithHFileLink' 2023-02-12 03:54:46,279 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-02-12 03:54:46,279 INFO [Listener at localhost.localdomain/41049] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testCompactionWithHFileLink, procId: 79 completed 2023-02-12 03:54:46,289 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,,1676174084167.4e8254a6d12aded099b366c106c6930d. with WAL disabled. Data may be lost in the event of a crash. 2023-02-12 03:54:46,290 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,1,1676174084167.0e9d0e06e60b6abe7b05797a5112bb5e. with WAL disabled. Data may be lost in the event of a crash. 2023-02-12 03:54:46,291 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,2,1676174084167.369851c5c3dd6d38afc3b2a16e1a3ffc. with WAL disabled. Data may be lost in the event of a crash. 2023-02-12 03:54:46,294 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-12 03:54:46,296 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-02-12 03:54:46,296 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-02-12 03:54:46,296 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:54:46,296 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-02-12 03:54:46,296 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-02-12 03:54:46,297 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-12 03:54:46,297 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-12 03:54:46,297 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:54:46,297 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:46,298 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:54:46,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:54:46,298 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:46,298 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-12 03:54:46,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-12 03:54:46,298 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-12 03:54:46,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-12 03:54:46,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-12 03:54:46,299 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-02-12 03:54:46,299 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-02-12 03:54:46,299 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-02-12 03:54:46,299 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:54:46,299 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-02-12 03:54:46,299 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1676174084167.0e9d0e06e60b6abe7b05797a5112bb5e. 2023-02-12 03:54:46,299 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1676174084167.369851c5c3dd6d38afc3b2a16e1a3ffc. 2023-02-12 03:54:46,299 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1676174084167.369851c5c3dd6d38afc3b2a16e1a3ffc. started... 2023-02-12 03:54:46,299 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1676174084167.0e9d0e06e60b6abe7b05797a5112bb5e. started... 2023-02-12 03:54:46,300 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-12 03:54:46,301 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 0e9d0e06e60b6abe7b05797a5112bb5e 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-02-12 03:54:46,301 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-12 03:54:46,301 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1676174084167.4e8254a6d12aded099b366c106c6930d. 2023-02-12 03:54:46,301 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1676174084167.4e8254a6d12aded099b366c106c6930d. started... 2023-02-12 03:54:46,300 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 369851c5c3dd6d38afc3b2a16e1a3ffc 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-02-12 03:54:46,302 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 4e8254a6d12aded099b366c106c6930d 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-02-12 03:54:46,722 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023021240d363ee3ba045559336952277303653 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023021240d363ee3ba045559336952277303653 2023-02-12 03:54:46,722 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302128e17b0c2b0934395b74d1c0fa5415109 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202302128e17b0c2b0934395b74d1c0fa5415109 2023-02-12 03:54:46,724 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230212216703835d1543e0bf1aa9f72faf4287 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230212216703835d1543e0bf1aa9f72faf4287 2023-02-12 03:54:47,137 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/.tmp/family1/ca25e354821f41239297823f77effa98 2023-02-12 03:54:47,141 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/.tmp/family1/57336479cdcf48c297824f71584356ca 2023-02-12 03:54:47,141 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/.tmp/family1/67634b9f7088459b8c692fbefde445c4 2023-02-12 03:54:47,570 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202302129e8cfbdfc0ec4fd8a9436aaa8c0bca05 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202302129e8cfbdfc0ec4fd8a9436aaa8c0bca05 2023-02-12 03:54:47,570 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230212b19a5db2fcd54e20b4d9ad64a100884e to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230212b19a5db2fcd54e20b4d9ad64a100884e 2023-02-12 03:54:47,570 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302121782cb197ab641539a6ad7c95e81357b to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202302121782cb197ab641539a6ad7c95e81357b 2023-02-12 03:54:47,978 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/.tmp/family2/9094c6fd8f824ee288f6545ee8d61038 2023-02-12 03:54:47,983 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/.tmp/family1/67634b9f7088459b8c692fbefde445c4 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/family1/67634b9f7088459b8c692fbefde445c4 2023-02-12 03:54:47,984 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/.tmp/family2/dd64bba239ac4a7491ca0594815ff9af 2023-02-12 03:54:47,985 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/.tmp/family2/fef2cc5193ee4c29bf399d13cb8afa3b 2023-02-12 03:54:47,991 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/family1/67634b9f7088459b8c692fbefde445c4, entries=4, sequenceid=5, filesize=5.4 K 2023-02-12 03:54:47,991 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/.tmp/family1/57336479cdcf48c297824f71584356ca as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/family1/57336479cdcf48c297824f71584356ca 2023-02-12 03:54:47,991 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/.tmp/family1/ca25e354821f41239297823f77effa98 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/family1/ca25e354821f41239297823f77effa98 2023-02-12 03:54:47,992 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/.tmp/family2/9094c6fd8f824ee288f6545ee8d61038 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/family2/9094c6fd8f824ee288f6545ee8d61038 2023-02-12 03:54:47,996 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/family2/9094c6fd8f824ee288f6545ee8d61038, entries=2, sequenceid=5, filesize=5.1 K 2023-02-12 03:54:47,996 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/family1/ca25e354821f41239297823f77effa98, entries=4, sequenceid=5, filesize=5.4 K 2023-02-12 03:54:47,996 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/family1/57336479cdcf48c297824f71584356ca, entries=4, sequenceid=5, filesize=5.4 K 2023-02-12 03:54:47,996 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 4e8254a6d12aded099b366c106c6930d in 1694ms, sequenceid=5, compaction requested=false 2023-02-12 03:54:47,996 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/.tmp/family2/dd64bba239ac4a7491ca0594815ff9af as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/family2/dd64bba239ac4a7491ca0594815ff9af 2023-02-12 03:54:47,997 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/.tmp/family2/fef2cc5193ee4c29bf399d13cb8afa3b as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/family2/fef2cc5193ee4c29bf399d13cb8afa3b 2023-02-12 03:54:47,997 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 4e8254a6d12aded099b366c106c6930d: 2023-02-12 03:54:47,997 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1676174084167.4e8254a6d12aded099b366c106c6930d. 2023-02-12 03:54:47,997 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-12 03:54:48,001 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/family2/dd64bba239ac4a7491ca0594815ff9af, entries=2, sequenceid=5, filesize=5.1 K 2023-02-12 03:54:48,001 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/family2/fef2cc5193ee4c29bf399d13cb8afa3b, entries=2, sequenceid=5, filesize=5.1 K 2023-02-12 03:54:48,001 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 369851c5c3dd6d38afc3b2a16e1a3ffc in 1701ms, sequenceid=5, compaction requested=false 2023-02-12 03:54:48,001 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 0e9d0e06e60b6abe7b05797a5112bb5e in 1700ms, sequenceid=5, compaction requested=false 2023-02-12 03:54:48,002 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 369851c5c3dd6d38afc3b2a16e1a3ffc: 2023-02-12 03:54:48,002 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 0e9d0e06e60b6abe7b05797a5112bb5e: 2023-02-12 03:54:48,002 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1676174084167.369851c5c3dd6d38afc3b2a16e1a3ffc. 2023-02-12 03:54:48,002 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1676174084167.0e9d0e06e60b6abe7b05797a5112bb5e. 2023-02-12 03:54:48,002 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-12 03:54:48,002 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-12 03:54:48,002 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-12 03:54:48,002 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:48,002 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-02-12 03:54:48,002 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-02-12 03:54:48,003 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:48,003 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-12 03:54:48,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:48,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:54:48,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:54:48,003 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-12 03:54:48,003 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 03:54:48,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:54:48,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:54:48,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-12 03:54:48,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:48,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:54:48,004 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-02-12 03:54:48,004 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4942ee56[Count = 0] remaining members to acquire global barrier 2023-02-12 03:54:48,004 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-02-12 03:54:48,004 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-12 03:54:48,004 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-12 03:54:48,004 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-12 03:54:48,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-12 03:54:48,005 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-02-12 03:54:48,005 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:48,005 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-12 03:54:48,005 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-02-12 03:54:48,005 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase20.apache.org,39639,1676173982450' in zk 2023-02-12 03:54:48,005 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:48,005 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-02-12 03:54:48,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:48,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:54:48,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:54:48,005 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:54:48,005 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-02-12 03:54:48,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:54:48,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:54:48,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-12 03:54:48,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:48,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:54:48,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-12 03:54:48,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:48,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase20.apache.org,39639,1676173982450': 2023-02-12 03:54:48,007 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-02-12 03:54:48,007 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-02-12 03:54:48,007 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-12 03:54:48,007 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-12 03:54:48,007 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-02-12 03:54:48,007 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-12 03:54:48,008 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-12 03:54:48,008 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-12 03:54:48,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-12 03:54:48,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:54:48,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:54:48,008 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-12 03:54:48,008 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:54:48,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-12 03:54:48,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:54:48,008 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:54:48,008 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:48,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:54:48,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-12 03:54:48,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-12 03:54:48,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:54:48,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-12 03:54:48,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:48,009 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:48,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:54:48,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-12 03:54:48,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:48,010 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:48,010 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:54:48,010 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-12 03:54:48,010 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:54:48,010 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:54:48,010 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:54:48,010 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-02-12 03:54:48,010 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-02-12 03:54:48,011 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-12 03:54:48,010 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-12 03:54:48,011 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:48,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:54:48,011 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-12 03:54:48,011 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-12 03:54:48,011 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-12 03:54:48,011 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-02-12 03:54:48,011 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-12 03:54:48,011 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:54:48,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:54:48,111 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-12 03:54:48,112 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-12 03:54:48,114 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,,1676174084167.4e8254a6d12aded099b366c106c6930d. with WAL disabled. Data may be lost in the event of a crash. 2023-02-12 03:54:48,114 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,1,1676174084167.0e9d0e06e60b6abe7b05797a5112bb5e. with WAL disabled. Data may be lost in the event of a crash. 2023-02-12 03:54:48,114 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,2,1676174084167.369851c5c3dd6d38afc3b2a16e1a3ffc. with WAL disabled. Data may be lost in the event of a crash. 2023-02-12 03:54:48,119 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-12 03:54:48,123 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-02-12 03:54:48,123 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-02-12 03:54:48,123 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-02-12 03:54:48,123 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:54:48,124 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-02-12 03:54:48,124 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-02-12 03:54:48,124 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-12 03:54:48,124 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-12 03:54:48,125 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:54:48,125 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:48,125 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:54:48,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:54:48,126 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:48,126 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-12 03:54:48,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-12 03:54:48,127 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-12 03:54:48,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-12 03:54:48,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-12 03:54:48,127 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-02-12 03:54:48,127 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-02-12 03:54:48,127 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-02-12 03:54:48,127 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-02-12 03:54:48,127 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:54:48,127 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-02-12 03:54:48,128 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1676174084167.0e9d0e06e60b6abe7b05797a5112bb5e. 2023-02-12 03:54:48,128 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1676174084167.369851c5c3dd6d38afc3b2a16e1a3ffc. 2023-02-12 03:54:48,128 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1676174084167.0e9d0e06e60b6abe7b05797a5112bb5e. started... 2023-02-12 03:54:48,128 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1676174084167.4e8254a6d12aded099b366c106c6930d. 2023-02-12 03:54:48,128 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-12 03:54:48,128 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-12 03:54:48,128 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 0e9d0e06e60b6abe7b05797a5112bb5e 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-02-12 03:54:48,128 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1676174084167.4e8254a6d12aded099b366c106c6930d. started... 2023-02-12 03:54:48,128 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1676174084167.369851c5c3dd6d38afc3b2a16e1a3ffc. started... 2023-02-12 03:54:48,128 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 4e8254a6d12aded099b366c106c6930d 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-02-12 03:54:48,128 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 369851c5c3dd6d38afc3b2a16e1a3ffc 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-02-12 03:54:48,547 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230212a3a6d6339686408ba5d6e047ec635631 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230212a3a6d6339686408ba5d6e047ec635631 2023-02-12 03:54:48,547 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230212de3ba320365e4c209e5e5905c42d1e7b to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230212de3ba320365e4c209e5e5905c42d1e7b 2023-02-12 03:54:48,547 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302123ccb2e9b5c43466f9e396ae6b2e4e7e6 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202302123ccb2e9b5c43466f9e396ae6b2e4e7e6 2023-02-12 03:54:48,954 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/.tmp/family1/1680fc2fd19047b9a4d476b5505a9420 2023-02-12 03:54:48,954 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/.tmp/family1/f16c24a6c05c4ffc99cbbd8f419bdc6b 2023-02-12 03:54:48,955 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/.tmp/family1/28a38cf350244da7830c9753b7964958 2023-02-12 03:54:49,387 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-12 03:54:49,388 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202302122d66f473fe004147a0ef1f76a920c9e1 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202302122d66f473fe004147a0ef1f76a920c9e1 2023-02-12 03:54:49,388 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023021218f5c72f02694ad2965ea5a26f85029b to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023021218f5c72f02694ad2965ea5a26f85029b 2023-02-12 03:54:49,388 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302129836d7cedd0346f0ab8d3b4fc30f7371 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202302129836d7cedd0346f0ab8d3b4fc30f7371 2023-02-12 03:54:49,472 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-12 03:54:49,472 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x18ad170f to 127.0.0.1:59556 2023-02-12 03:54:49,472 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 03:54:49,472 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-12 03:54:49,472 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x44c5049c to 127.0.0.1:59556 2023-02-12 03:54:49,472 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 03:54:49,473 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x689871d0 to 127.0.0.1:59556 2023-02-12 03:54:49,473 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 03:54:49,473 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-12 03:54:49,473 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4b9578b9 to 127.0.0.1:59556 2023-02-12 03:54:49,473 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 03:54:49,795 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/.tmp/family2/82632c718e894427ab9e68941a927668 2023-02-12 03:54:49,801 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/.tmp/family2/e45c7d1c8c914c029f7acb4750386b15 2023-02-12 03:54:49,801 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/.tmp/family2/109b596bd4c145e380fc107ade6f1be3 2023-02-12 03:54:49,803 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/.tmp/family1/f16c24a6c05c4ffc99cbbd8f419bdc6b as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/family1/f16c24a6c05c4ffc99cbbd8f419bdc6b 2023-02-12 03:54:49,808 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/.tmp/family1/28a38cf350244da7830c9753b7964958 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/family1/28a38cf350244da7830c9753b7964958 2023-02-12 03:54:49,808 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/.tmp/family1/1680fc2fd19047b9a4d476b5505a9420 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/family1/1680fc2fd19047b9a4d476b5505a9420 2023-02-12 03:54:49,809 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/family1/f16c24a6c05c4ffc99cbbd8f419bdc6b, entries=4, sequenceid=9, filesize=5.4 K 2023-02-12 03:54:49,810 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/.tmp/family2/82632c718e894427ab9e68941a927668 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/family2/82632c718e894427ab9e68941a927668 2023-02-12 03:54:49,812 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/family1/1680fc2fd19047b9a4d476b5505a9420, entries=4, sequenceid=9, filesize=5.4 K 2023-02-12 03:54:49,812 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/family1/28a38cf350244da7830c9753b7964958, entries=4, sequenceid=9, filesize=5.4 K 2023-02-12 03:54:49,813 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/.tmp/family2/109b596bd4c145e380fc107ade6f1be3 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/family2/109b596bd4c145e380fc107ade6f1be3 2023-02-12 03:54:49,813 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/.tmp/family2/e45c7d1c8c914c029f7acb4750386b15 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/family2/e45c7d1c8c914c029f7acb4750386b15 2023-02-12 03:54:49,813 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/family2/82632c718e894427ab9e68941a927668, entries=2, sequenceid=9, filesize=5.1 K 2023-02-12 03:54:49,814 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 4e8254a6d12aded099b366c106c6930d in 1686ms, sequenceid=9, compaction requested=false 2023-02-12 03:54:49,814 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 4e8254a6d12aded099b366c106c6930d: 2023-02-12 03:54:49,814 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1676174084167.4e8254a6d12aded099b366c106c6930d. 2023-02-12 03:54:49,814 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-12 03:54:49,816 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/family2/109b596bd4c145e380fc107ade6f1be3, entries=2, sequenceid=9, filesize=5.1 K 2023-02-12 03:54:49,816 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/family2/e45c7d1c8c914c029f7acb4750386b15, entries=2, sequenceid=9, filesize=5.1 K 2023-02-12 03:54:49,817 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 369851c5c3dd6d38afc3b2a16e1a3ffc in 1689ms, sequenceid=9, compaction requested=false 2023-02-12 03:54:49,817 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 0e9d0e06e60b6abe7b05797a5112bb5e in 1689ms, sequenceid=9, compaction requested=false 2023-02-12 03:54:49,817 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 369851c5c3dd6d38afc3b2a16e1a3ffc: 2023-02-12 03:54:49,817 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 0e9d0e06e60b6abe7b05797a5112bb5e: 2023-02-12 03:54:49,817 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1676174084167.369851c5c3dd6d38afc3b2a16e1a3ffc. 2023-02-12 03:54:49,817 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1676174084167.0e9d0e06e60b6abe7b05797a5112bb5e. 2023-02-12 03:54:49,817 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-12 03:54:49,818 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-12 03:54:49,818 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-12 03:54:49,818 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:49,818 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-02-12 03:54:49,818 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-02-12 03:54:49,819 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:49,819 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-12 03:54:49,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:49,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:54:49,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:54:49,819 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-12 03:54:49,819 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 03:54:49,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:54:49,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:54:49,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-12 03:54:49,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:49,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:54:49,820 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-02-12 03:54:49,820 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@74976d4b[Count = 0] remaining members to acquire global barrier 2023-02-12 03:54:49,820 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-02-12 03:54:49,820 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-12 03:54:49,821 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-12 03:54:49,821 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-12 03:54:49,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-12 03:54:49,821 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-02-12 03:54:49,821 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-02-12 03:54:49,821 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:49,821 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-12 03:54:49,821 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase20.apache.org,39639,1676173982450' in zk 2023-02-12 03:54:49,822 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:49,822 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-02-12 03:54:49,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:49,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:54:49,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:54:49,822 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:54:49,822 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-02-12 03:54:49,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:54:49,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:54:49,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-12 03:54:49,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:49,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:54:49,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-12 03:54:49,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:49,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase20.apache.org,39639,1676173982450': 2023-02-12 03:54:49,824 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-02-12 03:54:49,824 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-02-12 03:54:49,824 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-12 03:54:49,824 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-12 03:54:49,824 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-02-12 03:54:49,824 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-12 03:54:49,825 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-12 03:54:49,825 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-12 03:54:49,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-12 03:54:49,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:54:49,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:54:49,825 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-12 03:54:49,825 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:54:49,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-12 03:54:49,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:54:49,825 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:49,825 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:54:49,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:54:49,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-12 03:54:49,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-12 03:54:49,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:54:49,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-12 03:54:49,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:49,826 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:49,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:54:49,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-12 03:54:49,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:49,827 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:49,827 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-12 03:54:49,827 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:54:49,827 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-12 03:54:49,827 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-02-12 03:54:49,827 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-12 03:54:49,827 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-02-12 03:54:49,827 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:49,827 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:54:49,827 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:54:49,827 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:54:49,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:54:49,827 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-12 03:54:49,827 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-02-12 03:54:49,827 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-12 03:54:49,828 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:54:49,828 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-12 03:54:49,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:54:49,828 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-12 03:54:49,928 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-12 03:54:49,930 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-12 03:54:49,931 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,,1676174084167.4e8254a6d12aded099b366c106c6930d. with WAL disabled. Data may be lost in the event of a crash. 2023-02-12 03:54:49,931 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,1,1676174084167.0e9d0e06e60b6abe7b05797a5112bb5e. with WAL disabled. Data may be lost in the event of a crash. 2023-02-12 03:54:49,932 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,2,1676174084167.369851c5c3dd6d38afc3b2a16e1a3ffc. with WAL disabled. Data may be lost in the event of a crash. 2023-02-12 03:54:49,934 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-12 03:54:49,936 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-02-12 03:54:49,936 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-02-12 03:54:49,936 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-02-12 03:54:49,936 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:54:49,936 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-02-12 03:54:49,936 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-02-12 03:54:49,937 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-12 03:54:49,937 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-12 03:54:49,938 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:54:49,938 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:49,938 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:54:49,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:54:49,938 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:49,938 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-12 03:54:49,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-12 03:54:49,939 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-12 03:54:49,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-12 03:54:49,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-12 03:54:49,939 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-02-12 03:54:49,939 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-02-12 03:54:49,939 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-02-12 03:54:49,939 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-02-12 03:54:49,939 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:54:49,939 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-02-12 03:54:49,940 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1676174084167.0e9d0e06e60b6abe7b05797a5112bb5e. 2023-02-12 03:54:49,940 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1676174084167.0e9d0e06e60b6abe7b05797a5112bb5e. started... 2023-02-12 03:54:49,940 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1676174084167.369851c5c3dd6d38afc3b2a16e1a3ffc. 2023-02-12 03:54:49,940 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1676174084167.369851c5c3dd6d38afc3b2a16e1a3ffc. started... 2023-02-12 03:54:49,940 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1676174084167.4e8254a6d12aded099b366c106c6930d. 2023-02-12 03:54:49,940 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 369851c5c3dd6d38afc3b2a16e1a3ffc 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-02-12 03:54:49,940 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-12 03:54:49,940 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-12 03:54:49,940 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1676174084167.4e8254a6d12aded099b366c106c6930d. started... 2023-02-12 03:54:49,940 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 0e9d0e06e60b6abe7b05797a5112bb5e 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-02-12 03:54:49,940 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 4e8254a6d12aded099b366c106c6930d 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-02-12 03:54:49,960 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230212d6057bca00184504b708b6acd6d48f2d to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230212d6057bca00184504b708b6acd6d48f2d 2023-02-12 03:54:50,365 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/.tmp/family1/87d4d7959ed5460db9686869a40435c0 2023-02-12 03:54:50,367 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230212b7f58914f1a44008b811b6dc8d0875e3 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230212b7f58914f1a44008b811b6dc8d0875e3 2023-02-12 03:54:50,367 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202302129d5ad3f18fe94f96af9319afb047dc3a to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202302129d5ad3f18fe94f96af9319afb047dc3a 2023-02-12 03:54:50,777 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/.tmp/family1/24c9ba5b866a46329c7fb8ab8a046ca8 2023-02-12 03:54:50,778 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/.tmp/family1/ad5e5cac5663442fb628697e0ac1cb74 2023-02-12 03:54:50,787 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230212cb32f8b6a63641388ce6c4c10f214ad3 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230212cb32f8b6a63641388ce6c4c10f214ad3 2023-02-12 03:54:51,196 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/.tmp/family2/0ee9478488594ba3b7336e26366747b1 2023-02-12 03:54:51,201 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230212f7df8ff2eb5b43de9ff5fa96b9d4804b to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230212f7df8ff2eb5b43de9ff5fa96b9d4804b 2023-02-12 03:54:51,202 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/.tmp/family1/87d4d7959ed5460db9686869a40435c0 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/family1/87d4d7959ed5460db9686869a40435c0 2023-02-12 03:54:51,205 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202302127d6644667bea45bb867daf9b1ac0ecc3 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202302127d6644667bea45bb867daf9b1ac0ecc3 2023-02-12 03:54:51,208 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/family1/87d4d7959ed5460db9686869a40435c0, entries=4, sequenceid=13, filesize=5.4 K 2023-02-12 03:54:51,209 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/.tmp/family2/0ee9478488594ba3b7336e26366747b1 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/family2/0ee9478488594ba3b7336e26366747b1 2023-02-12 03:54:51,213 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/family2/0ee9478488594ba3b7336e26366747b1, entries=2, sequenceid=13, filesize=5.1 K 2023-02-12 03:54:51,213 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 369851c5c3dd6d38afc3b2a16e1a3ffc in 1273ms, sequenceid=13, compaction requested=true 2023-02-12 03:54:51,213 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 369851c5c3dd6d38afc3b2a16e1a3ffc: 2023-02-12 03:54:51,213 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1676174084167.369851c5c3dd6d38afc3b2a16e1a3ffc. 2023-02-12 03:54:51,213 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-12 03:54:51,536 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro 2023-02-12 03:54:51,608 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/.tmp/family2/d98fbbdcc7af49b48050c5145edd38da 2023-02-12 03:54:51,613 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/.tmp/family2/bd136b408a804ed88601e3708f60c2a2 2023-02-12 03:54:51,618 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/.tmp/family1/24c9ba5b866a46329c7fb8ab8a046ca8 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/family1/24c9ba5b866a46329c7fb8ab8a046ca8 2023-02-12 03:54:51,620 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/.tmp/family1/ad5e5cac5663442fb628697e0ac1cb74 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/family1/ad5e5cac5663442fb628697e0ac1cb74 2023-02-12 03:54:51,623 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/family1/24c9ba5b866a46329c7fb8ab8a046ca8, entries=4, sequenceid=13, filesize=5.4 K 2023-02-12 03:54:51,624 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/.tmp/family2/d98fbbdcc7af49b48050c5145edd38da as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/family2/d98fbbdcc7af49b48050c5145edd38da 2023-02-12 03:54:51,624 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/family1/ad5e5cac5663442fb628697e0ac1cb74, entries=4, sequenceid=13, filesize=5.4 K 2023-02-12 03:54:51,625 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/.tmp/family2/bd136b408a804ed88601e3708f60c2a2 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/family2/bd136b408a804ed88601e3708f60c2a2 2023-02-12 03:54:51,629 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/family2/d98fbbdcc7af49b48050c5145edd38da, entries=2, sequenceid=13, filesize=5.1 K 2023-02-12 03:54:51,630 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/family2/bd136b408a804ed88601e3708f60c2a2, entries=2, sequenceid=13, filesize=5.1 K 2023-02-12 03:54:51,630 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 4e8254a6d12aded099b366c106c6930d in 1690ms, sequenceid=13, compaction requested=true 2023-02-12 03:54:51,630 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 4e8254a6d12aded099b366c106c6930d: 2023-02-12 03:54:51,630 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 0e9d0e06e60b6abe7b05797a5112bb5e in 1690ms, sequenceid=13, compaction requested=true 2023-02-12 03:54:51,631 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1676174084167.4e8254a6d12aded099b366c106c6930d. 2023-02-12 03:54:51,631 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 0e9d0e06e60b6abe7b05797a5112bb5e: 2023-02-12 03:54:51,631 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1676174084167.0e9d0e06e60b6abe7b05797a5112bb5e. 2023-02-12 03:54:51,631 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-12 03:54:51,631 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-12 03:54:51,631 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-12 03:54:51,631 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:51,631 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-02-12 03:54:51,631 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-02-12 03:54:51,633 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:51,633 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-12 03:54:51,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:51,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:54:51,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:54:51,634 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-12 03:54:51,634 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 03:54:51,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:54:51,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:54:51,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-12 03:54:51,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:51,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:54:51,635 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-02-12 03:54:51,635 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6dc14c78[Count = 0] remaining members to acquire global barrier 2023-02-12 03:54:51,636 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-02-12 03:54:51,636 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-12 03:54:51,636 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-12 03:54:51,636 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-12 03:54:51,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-12 03:54:51,636 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-02-12 03:54:51,636 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:51,637 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-12 03:54:51,636 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-02-12 03:54:51,637 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase20.apache.org,39639,1676173982450' in zk 2023-02-12 03:54:51,637 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:51,637 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-02-12 03:54:51,638 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:54:51,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:51,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:54:51,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:54:51,638 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-02-12 03:54:51,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:54:51,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:54:51,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-12 03:54:51,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:51,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:54:51,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-12 03:54:51,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:51,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase20.apache.org,39639,1676173982450': 2023-02-12 03:54:51,640 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-02-12 03:54:51,640 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-02-12 03:54:51,640 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-12 03:54:51,640 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-12 03:54:51,640 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-02-12 03:54:51,640 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-12 03:54:51,641 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-12 03:54:51,641 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-12 03:54:51,642 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:54:51,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-12 03:54:51,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:54:51,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:54:51,642 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-12 03:54:51,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-12 03:54:51,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:54:51,642 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:54:51,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:54:51,642 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:51,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-12 03:54:51,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-12 03:54:51,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:54:51,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-12 03:54:51,644 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:51,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:51,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:54:51,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-12 03:54:51,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:51,646 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:51,646 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-12 03:54:51,646 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:54:51,646 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:54:51,646 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-02-12 03:54:51,646 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:54:51,646 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:54:51,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:54:51,646 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-02-12 03:54:51,646 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-12 03:54:51,646 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-12 03:54:51,646 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:51,646 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-12 03:54:51,647 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-12 03:54:51,647 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:54:51,647 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-02-12 03:54:51,647 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-12 03:54:51,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:54:51,647 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-12 03:54:51,747 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-12 03:54:51,749 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-12 03:54:51,751 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,,1676174084167.4e8254a6d12aded099b366c106c6930d. with WAL disabled. Data may be lost in the event of a crash. 2023-02-12 03:54:51,752 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,1,1676174084167.0e9d0e06e60b6abe7b05797a5112bb5e. with WAL disabled. Data may be lost in the event of a crash. 2023-02-12 03:54:51,752 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,2,1676174084167.369851c5c3dd6d38afc3b2a16e1a3ffc. with WAL disabled. Data may be lost in the event of a crash. 2023-02-12 03:54:51,757 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-12 03:54:51,759 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-02-12 03:54:51,759 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-02-12 03:54:51,760 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-02-12 03:54:51,760 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:54:51,760 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-02-12 03:54:51,760 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-02-12 03:54:51,760 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-12 03:54:51,760 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-12 03:54:51,761 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:54:51,761 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:51,761 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:54:51,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:54:51,762 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:51,762 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-12 03:54:51,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-12 03:54:51,762 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-12 03:54:51,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-12 03:54:51,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-12 03:54:51,762 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-02-12 03:54:51,763 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-02-12 03:54:51,763 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-02-12 03:54:51,764 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-02-12 03:54:51,764 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:54:51,764 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-02-12 03:54:51,764 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1676174084167.0e9d0e06e60b6abe7b05797a5112bb5e. 2023-02-12 03:54:51,764 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1676174084167.0e9d0e06e60b6abe7b05797a5112bb5e. started... 2023-02-12 03:54:51,764 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 0e9d0e06e60b6abe7b05797a5112bb5e 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-02-12 03:54:51,767 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1676174084167.369851c5c3dd6d38afc3b2a16e1a3ffc. 2023-02-12 03:54:51,768 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1676174084167.369851c5c3dd6d38afc3b2a16e1a3ffc. started... 2023-02-12 03:54:51,768 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-12 03:54:51,768 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1676174084167.4e8254a6d12aded099b366c106c6930d. 2023-02-12 03:54:51,768 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 369851c5c3dd6d38afc3b2a16e1a3ffc 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-02-12 03:54:51,768 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1676174084167.4e8254a6d12aded099b366c106c6930d. started... 2023-02-12 03:54:51,768 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-12 03:54:51,768 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 4e8254a6d12aded099b366c106c6930d 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-02-12 03:54:51,791 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230212e33bb280a79e495589b956efc4e3e56c to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230212e33bb280a79e495589b956efc4e3e56c 2023-02-12 03:54:52,190 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230212a401f6430c8c4a8d88a379f214b16ffb to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230212a401f6430c8c4a8d88a379f214b16ffb 2023-02-12 03:54:52,193 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302126112c32489b74171a8463897751a6913 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202302126112c32489b74171a8463897751a6913 2023-02-12 03:54:52,196 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/.tmp/family1/74306a4c7f9e4c4d90d47fe163c451c2 2023-02-12 03:54:52,598 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/.tmp/family1/3cd14dd59fa842fba2f6ca863062ef1f 2023-02-12 03:54:52,599 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/.tmp/family1/cc7410dc341d435da9efadbba79ec3d5 2023-02-12 03:54:52,613 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230212734a01057dd74d75841e87f3ac454484 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230212734a01057dd74d75841e87f3ac454484 2023-02-12 03:54:53,019 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/.tmp/family2/54b7be21dbb245e787729ac2c1f02542 2023-02-12 03:54:53,027 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230212f429c7c7e2f04873a4522d785a7fa596 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230212f429c7c7e2f04873a4522d785a7fa596 2023-02-12 03:54:53,027 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230212ea5af1d598ed41cf9f7220dba350a175 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230212ea5af1d598ed41cf9f7220dba350a175 2023-02-12 03:54:53,030 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/.tmp/family1/74306a4c7f9e4c4d90d47fe163c451c2 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/family1/74306a4c7f9e4c4d90d47fe163c451c2 2023-02-12 03:54:53,034 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/family1/74306a4c7f9e4c4d90d47fe163c451c2, entries=4, sequenceid=17, filesize=5.4 K 2023-02-12 03:54:53,034 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/.tmp/family2/54b7be21dbb245e787729ac2c1f02542 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/family2/54b7be21dbb245e787729ac2c1f02542 2023-02-12 03:54:53,038 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/family2/54b7be21dbb245e787729ac2c1f02542, entries=2, sequenceid=17, filesize=5.1 K 2023-02-12 03:54:53,038 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 4e8254a6d12aded099b366c106c6930d in 1270ms, sequenceid=17, compaction requested=true 2023-02-12 03:54:53,039 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 4e8254a6d12aded099b366c106c6930d: 2023-02-12 03:54:53,039 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1676174084167.4e8254a6d12aded099b366c106c6930d. 2023-02-12 03:54:53,039 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-12 03:54:53,044 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/.tmp/family2/46d19779813b4d9e825a09db392f3515 2023-02-12 03:54:53,047 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/.tmp/family1/cc7410dc341d435da9efadbba79ec3d5 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/family1/cc7410dc341d435da9efadbba79ec3d5 2023-02-12 03:54:53,050 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/family1/cc7410dc341d435da9efadbba79ec3d5, entries=4, sequenceid=17, filesize=5.4 K 2023-02-12 03:54:53,051 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/.tmp/family2/46d19779813b4d9e825a09db392f3515 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/family2/46d19779813b4d9e825a09db392f3515 2023-02-12 03:54:53,055 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/family2/46d19779813b4d9e825a09db392f3515, entries=2, sequenceid=17, filesize=5.1 K 2023-02-12 03:54:53,056 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 369851c5c3dd6d38afc3b2a16e1a3ffc in 1288ms, sequenceid=17, compaction requested=true 2023-02-12 03:54:53,056 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 369851c5c3dd6d38afc3b2a16e1a3ffc: 2023-02-12 03:54:53,056 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1676174084167.369851c5c3dd6d38afc3b2a16e1a3ffc. 2023-02-12 03:54:53,056 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-12 03:54:53,442 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/.tmp/family2/cf35ea8d9268481bbf9aeec68aa1adb6 2023-02-12 03:54:53,453 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/.tmp/family1/3cd14dd59fa842fba2f6ca863062ef1f as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/family1/3cd14dd59fa842fba2f6ca863062ef1f 2023-02-12 03:54:53,457 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/family1/3cd14dd59fa842fba2f6ca863062ef1f, entries=4, sequenceid=17, filesize=5.4 K 2023-02-12 03:54:53,457 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/.tmp/family2/cf35ea8d9268481bbf9aeec68aa1adb6 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/family2/cf35ea8d9268481bbf9aeec68aa1adb6 2023-02-12 03:54:53,462 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/family2/cf35ea8d9268481bbf9aeec68aa1adb6, entries=2, sequenceid=17, filesize=5.1 K 2023-02-12 03:54:53,463 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 0e9d0e06e60b6abe7b05797a5112bb5e in 1699ms, sequenceid=17, compaction requested=true 2023-02-12 03:54:53,463 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 0e9d0e06e60b6abe7b05797a5112bb5e: 2023-02-12 03:54:53,463 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1676174084167.0e9d0e06e60b6abe7b05797a5112bb5e. 2023-02-12 03:54:53,463 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-12 03:54:53,463 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-12 03:54:53,463 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:53,463 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-02-12 03:54:53,463 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-02-12 03:54:53,464 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:53,464 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-12 03:54:53,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:53,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:54:53,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:54:53,465 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-12 03:54:53,465 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 03:54:53,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:54:53,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:54:53,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-12 03:54:53,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:53,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:54:53,466 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-02-12 03:54:53,467 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@589008fb[Count = 0] remaining members to acquire global barrier 2023-02-12 03:54:53,467 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-02-12 03:54:53,467 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-12 03:54:53,467 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-12 03:54:53,467 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-12 03:54:53,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-12 03:54:53,468 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-02-12 03:54:53,468 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-02-12 03:54:53,468 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase20.apache.org,39639,1676173982450' in zk 2023-02-12 03:54:53,468 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:53,468 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-12 03:54:53,468 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:53,468 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-02-12 03:54:53,469 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:54:53,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:53,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:54:53,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:54:53,469 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-02-12 03:54:53,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:54:53,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:54:53,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-12 03:54:53,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:53,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:54:53,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-12 03:54:53,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:53,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase20.apache.org,39639,1676173982450': 2023-02-12 03:54:53,471 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-02-12 03:54:53,471 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-12 03:54:53,471 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-12 03:54:53,471 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-02-12 03:54:53,471 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-12 03:54:53,471 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-02-12 03:54:53,473 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-12 03:54:53,473 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-12 03:54:53,473 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-12 03:54:53,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-12 03:54:53,473 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:54:53,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-12 03:54:53,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:54:53,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:54:53,473 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:54:53,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:54:53,473 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:53,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:54:53,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-12 03:54:53,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-12 03:54:53,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:54:53,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-12 03:54:53,475 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:53,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:53,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:54:53,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-12 03:54:53,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:53,476 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:53,476 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:54:53,476 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-12 03:54:53,476 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:54:53,476 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-02-12 03:54:53,476 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-12 03:54:53,476 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:54:53,476 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:54:53,477 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-02-12 03:54:53,476 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-12 03:54:53,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:54:53,477 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-02-12 03:54:53,477 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-12 03:54:53,477 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:53,477 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:54:53,477 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-12 03:54:53,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:54:53,477 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-12 03:54:53,477 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-12 03:54:53,577 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-12 03:54:53,578 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-12 03:54:53,596 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(1580): Client=jenkins//148.251.75.209 snapshot request for:{ ss=snaptb-1676174093579 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-02-12 03:54:53,596 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676174093596 (current time:1676174093596). 2023-02-12 03:54:53,596 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-12 03:54:53,597 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] zookeeper.ReadOnlyZKClient(139): Connect 0x128bae36 to 127.0.0.1:59556 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 03:54:53,601 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3ab6714e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 03:54:53,605 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-12 03:54:53,607 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:55910, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-12 03:54:53,608 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x128bae36 to 127.0.0.1:59556 2023-02-12 03:54:53,608 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 03:54:53,609 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-12 03:54:53,609 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb-1676174093579 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-02-12 03:54:53,618 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] procedure2.ProcedureExecutor(1029): Stored pid=86, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-02-12 03:54:53,619 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=86, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-02-12 03:54:53,620 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=86, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE; timeout=600000, timestamp=1676174693620 2023-02-12 03:54:53,620 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb-1676174093579 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-02-12 03:54:53,620 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb-1676174093579 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink 2023-02-12 03:54:53,621 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=86, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-02-12 03:54:53,622 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1029): Stored pid=87, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-02-12 03:54:53,622 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=86, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE in 4 msec 2023-02-12 03:54:53,623 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=87, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-02-12 03:54:53,623 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=87, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED; timeout=600000, timestamp=1676174693623 2023-02-12 03:54:53,625 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb-1676174093579 table=testCompactionWithHFileLink type=FLUSH ttl=0 }'' to complete. (max 300000 ms per retry) 2023-02-12 03:54:53,625 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-12 03:54:53,725 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-12 03:54:53,730 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=snaptb-1676174093579 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-12 03:54:53,733 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb-1676174093579 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-02-12 03:54:53,734 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-12 03:54:53,934 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-12 03:54:53,936 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=snaptb-1676174093579 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-12 03:54:53,936 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb-1676174093579 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-02-12 03:54:53,936 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-02-12 03:54:54,030 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb-1676174093579 2023-02-12 03:54:54,031 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb-1676174093579' 2023-02-12 03:54:54,031 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-12 03:54:54,031 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb-1676174093579' starting 'acquire' 2023-02-12 03:54:54,031 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb-1676174093579', kicking off acquire phase on members. 2023-02-12 03:54:54,031 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb-1676174093579 2023-02-12 03:54:54,031 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb-1676174093579 2023-02-12 03:54:54,032 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-12 03:54:54,032 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb-1676174093579/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:54,033 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-12 03:54:54,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 03:54:54,033 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb-1676174093579/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:54,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb-1676174093579 2023-02-12 03:54:54,033 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-12 03:54:54,034 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb-1676174093579 2023-02-12 03:54:54,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 68 2023-02-12 03:54:54,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb-1676174093579 2023-02-12 03:54:54,034 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb-1676174093579 from table testCompactionWithHFileLink type FLUSH 2023-02-12 03:54:54,037 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb-1676174093579 2023-02-12 03:54:54,037 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb-1676174093579' with timeout 300000ms 2023-02-12 03:54:54,037 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-12 03:54:54,037 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb-1676174093579' starting 'acquire' stage 2023-02-12 03:54:54,037 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb-1676174093579' locally acquired 2023-02-12 03:54:54,038 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure (snaptb-1676174093579) in zk 2023-02-12 03:54:54,044 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1676174093579/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:54,044 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb-1676174093579 2023-02-12 03:54:54,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb-1676174093579/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:54,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:54:54,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-12 03:54:54,044 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb-1676174093579 2023-02-12 03:54:54,044 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb-1676174093579' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 03:54:54,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:54:54,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:54:54,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1676174093579 2023-02-12 03:54:54,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:54,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:54:54,047 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure 'snaptb-1676174093579' on coordinator 2023-02-12 03:54:54,047 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@67e6de1[Count = 0] remaining members to acquire global barrier 2023-02-12 03:54:54,047 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb-1676174093579' starting 'in-barrier' execution. 2023-02-12 03:54:54,047 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb-1676174093579 2023-02-12 03:54:54,050 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1676174093579 2023-02-12 03:54:54,050 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb-1676174093579 2023-02-12 03:54:54,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb-1676174093579 2023-02-12 03:54:54,050 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb-1676174093579' received 'reached' from coordinator. 2023-02-12 03:54:54,051 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb-1676174093579/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:54,051 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-12 03:54:54,052 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,1,1676174084167.0e9d0e06e60b6abe7b05797a5112bb5e. 2023-02-12 03:54:54,052 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,2,1676174084167.369851c5c3dd6d38afc3b2a16e1a3ffc. 2023-02-12 03:54:54,052 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 3 regions 2023-02-12 03:54:54,053 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,,1676174084167.4e8254a6d12aded099b366c106c6930d. 2023-02-12 03:54:54,053 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,2,1676174084167.369851c5c3dd6d38afc3b2a16e1a3ffc. started... 2023-02-12 03:54:54,053 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,,1676174084167.4e8254a6d12aded099b366c106c6930d. started... 2023-02-12 03:54:54,053 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 369851c5c3dd6d38afc3b2a16e1a3ffc: 2023-02-12 03:54:54,053 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 4e8254a6d12aded099b366c106c6930d: 2023-02-12 03:54:54,053 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,1,1676174084167.0e9d0e06e60b6abe7b05797a5112bb5e. started... 2023-02-12 03:54:54,053 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-12 03:54:54,053 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 0e9d0e06e60b6abe7b05797a5112bb5e: 2023-02-12 03:54:54,054 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,1,1676174084167.0e9d0e06e60b6abe7b05797a5112bb5e.' region-info for snapshot=snaptb-1676174093579 2023-02-12 03:54:54,054 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,,1676174084167.4e8254a6d12aded099b366c106c6930d.' region-info for snapshot=snaptb-1676174093579 2023-02-12 03:54:54,054 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,2,1676174084167.369851c5c3dd6d38afc3b2a16e1a3ffc.' region-info for snapshot=snaptb-1676174093579 2023-02-12 03:54:54,064 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 03:54:54,064 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 03:54:54,064 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-12 03:54:54,182 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/family1/57336479cdcf48c297824f71584356ca, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/family1/28a38cf350244da7830c9753b7964958, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/family1/87d4d7959ed5460db9686869a40435c0, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/family1/cc7410dc341d435da9efadbba79ec3d5] hfiles 2023-02-12 03:54:54,182 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/family1/67634b9f7088459b8c692fbefde445c4, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/family1/f16c24a6c05c4ffc99cbbd8f419bdc6b, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/family1/24c9ba5b866a46329c7fb8ab8a046ca8, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/family1/74306a4c7f9e4c4d90d47fe163c451c2] hfiles 2023-02-12 03:54:54,182 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/family1/ca25e354821f41239297823f77effa98, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/family1/1680fc2fd19047b9a4d476b5505a9420, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/family1/ad5e5cac5663442fb628697e0ac1cb74, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/family1/3cd14dd59fa842fba2f6ca863062ef1f] hfiles 2023-02-12 03:54:54,182 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/family1/67634b9f7088459b8c692fbefde445c4 for snapshot=snaptb-1676174093579 2023-02-12 03:54:54,182 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/family1/57336479cdcf48c297824f71584356ca for snapshot=snaptb-1676174093579 2023-02-12 03:54:54,182 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/family1/ca25e354821f41239297823f77effa98 for snapshot=snaptb-1676174093579 2023-02-12 03:54:54,185 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/family1/1680fc2fd19047b9a4d476b5505a9420 for snapshot=snaptb-1676174093579 2023-02-12 03:54:54,185 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/family1/ad5e5cac5663442fb628697e0ac1cb74 for snapshot=snaptb-1676174093579 2023-02-12 03:54:54,185 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/family1/3cd14dd59fa842fba2f6ca863062ef1f for snapshot=snaptb-1676174093579 2023-02-12 03:54:54,185 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/family1/f16c24a6c05c4ffc99cbbd8f419bdc6b for snapshot=snaptb-1676174093579 2023-02-12 03:54:54,185 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/family1/28a38cf350244da7830c9753b7964958 for snapshot=snaptb-1676174093579 2023-02-12 03:54:54,185 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/family1/87d4d7959ed5460db9686869a40435c0 for snapshot=snaptb-1676174093579 2023-02-12 03:54:54,185 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/family1/cc7410dc341d435da9efadbba79ec3d5 for snapshot=snaptb-1676174093579 2023-02-12 03:54:54,185 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/family2/dd64bba239ac4a7491ca0594815ff9af, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/family2/109b596bd4c145e380fc107ade6f1be3, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/family2/bd136b408a804ed88601e3708f60c2a2, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/family2/cf35ea8d9268481bbf9aeec68aa1adb6] hfiles 2023-02-12 03:54:54,185 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/family1/24c9ba5b866a46329c7fb8ab8a046ca8 for snapshot=snaptb-1676174093579 2023-02-12 03:54:54,185 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/family1/74306a4c7f9e4c4d90d47fe163c451c2 for snapshot=snaptb-1676174093579 2023-02-12 03:54:54,185 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/family2/dd64bba239ac4a7491ca0594815ff9af for snapshot=snaptb-1676174093579 2023-02-12 03:54:54,185 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/family2/fef2cc5193ee4c29bf399d13cb8afa3b, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/family2/e45c7d1c8c914c029f7acb4750386b15, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/family2/0ee9478488594ba3b7336e26366747b1, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/family2/46d19779813b4d9e825a09db392f3515] hfiles 2023-02-12 03:54:54,186 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/family2/fef2cc5193ee4c29bf399d13cb8afa3b for snapshot=snaptb-1676174093579 2023-02-12 03:54:54,186 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/family2/109b596bd4c145e380fc107ade6f1be3 for snapshot=snaptb-1676174093579 2023-02-12 03:54:54,186 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/family2/9094c6fd8f824ee288f6545ee8d61038, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/family2/82632c718e894427ab9e68941a927668, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/family2/d98fbbdcc7af49b48050c5145edd38da, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/family2/54b7be21dbb245e787729ac2c1f02542] hfiles 2023-02-12 03:54:54,186 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/family2/bd136b408a804ed88601e3708f60c2a2 for snapshot=snaptb-1676174093579 2023-02-12 03:54:54,186 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/family2/cf35ea8d9268481bbf9aeec68aa1adb6 for snapshot=snaptb-1676174093579 2023-02-12 03:54:54,186 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/family2/e45c7d1c8c914c029f7acb4750386b15 for snapshot=snaptb-1676174093579 2023-02-12 03:54:54,186 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/family2/9094c6fd8f824ee288f6545ee8d61038 for snapshot=snaptb-1676174093579 2023-02-12 03:54:54,186 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/family2/82632c718e894427ab9e68941a927668 for snapshot=snaptb-1676174093579 2023-02-12 03:54:54,186 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/family2/d98fbbdcc7af49b48050c5145edd38da for snapshot=snaptb-1676174093579 2023-02-12 03:54:54,186 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/family2/54b7be21dbb245e787729ac2c1f02542 for snapshot=snaptb-1676174093579 2023-02-12 03:54:54,186 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/family2/0ee9478488594ba3b7336e26366747b1 for snapshot=snaptb-1676174093579 2023-02-12 03:54:54,186 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/family2/46d19779813b4d9e825a09db392f3515 for snapshot=snaptb-1676174093579 2023-02-12 03:54:54,237 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-12 03:54:54,238 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=snaptb-1676174093579 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-12 03:54:54,238 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb-1676174093579 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-02-12 03:54:54,239 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-02-12 03:54:54,593 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,,1676174084167.4e8254a6d12aded099b366c106c6930d. completed. 2023-02-12 03:54:54,593 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,2,1676174084167.369851c5c3dd6d38afc3b2a16e1a3ffc. completed. 2023-02-12 03:54:54,593 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,,1676174084167.4e8254a6d12aded099b366c106c6930d. 2023-02-12 03:54:54,593 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,2,1676174084167.369851c5c3dd6d38afc3b2a16e1a3ffc. 2023-02-12 03:54:54,593 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,1,1676174084167.0e9d0e06e60b6abe7b05797a5112bb5e. completed. 2023-02-12 03:54:54,593 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,1,1676174084167.0e9d0e06e60b6abe7b05797a5112bb5e. 2023-02-12 03:54:54,594 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/3 local region snapshots. 2023-02-12 03:54:54,594 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/3 local region snapshots. 2023-02-12 03:54:54,594 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/3 local region snapshots. 2023-02-12 03:54:54,594 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 3 local region snapshots. 2023-02-12 03:54:54,594 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:54,594 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb-1676174093579' locally completed 2023-02-12 03:54:54,594 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb-1676174093579' completed for member 'jenkins-hbase20.apache.org,39639,1676173982450' in zk 2023-02-12 03:54:54,596 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb-1676174093579' has notified controller of completion 2023-02-12 03:54:54,596 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:54:54,596 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb-1676174093579' completed. 2023-02-12 03:54:54,596 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1676174093579/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:54,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb-1676174093579/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:54,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:54:54,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-12 03:54:54,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:54:54,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:54:54,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1676174093579 2023-02-12 03:54:54,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:54,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:54:54,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1676174093579 2023-02-12 03:54:54,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:54,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb-1676174093579' member 'jenkins-hbase20.apache.org,39639,1676173982450': 2023-02-12 03:54:54,602 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' released barrier for procedure'snaptb-1676174093579', counting down latch. Waiting for 0 more 2023-02-12 03:54:54,602 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb-1676174093579' execution completed 2023-02-12 03:54:54,603 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-12 03:54:54,603 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-12 03:54:54,603 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb-1676174093579 2023-02-12 03:54:54,603 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb-1676174093579including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-12 03:54:54,608 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1676174093579 2023-02-12 03:54:54,608 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1676174093579 2023-02-12 03:54:54,609 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-12 03:54:54,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb-1676174093579 2023-02-12 03:54:54,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:54:54,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-12 03:54:54,609 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb-1676174093579 2023-02-12 03:54:54,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb-1676174093579 2023-02-12 03:54:54,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:54:54,609 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb-1676174093579/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:54,609 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-12 03:54:54,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 03:54:54,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1676174093579 2023-02-12 03:54:54,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb-1676174093579 2023-02-12 03:54:54,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:54:54,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1676174093579 2023-02-12 03:54:54,611 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb-1676174093579/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:54,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:54,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:54:54,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1676174093579 2023-02-12 03:54:54,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:54,619 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1676174093579/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:54,619 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-12 03:54:54,619 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-12 03:54:54,619 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1676174093579 2023-02-12 03:54:54,619 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1676174093579 2023-02-12 03:54:54,619 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1676174093579/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:54,619 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1676174093579 2023-02-12 03:54:54,619 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1676174093579 2023-02-12 03:54:54,619 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/snaptb-1676174093579 because node does not exist (not an error) 2023-02-12 03:54:54,619 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb-1676174093579 2023-02-12 03:54:54,619 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:54:54,620 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testCompactionWithHFileLink 2023-02-12 03:54:54,619 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-12 03:54:54,620 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 0e7b6fa9e81bd62588edd7d77d6165e4, NAME => 'testCompactionWithHFileLink,.mob,0.0e7b6fa9e81bd62588edd7d77d6165e4.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb-1676174093579 2023-02-12 03:54:54,619 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1676174093579 2023-02-12 03:54:54,620 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-02-12 03:54:54,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-12 03:54:54,621 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-12 03:54:54,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-12 03:54:54,622 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230212216703835d1543e0bf1aa9f72faf4287, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230212a3a6d6339686408ba5d6e047ec635631, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230212a401f6430c8c4a8d88a379f214b16ffb, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230212b7f58914f1a44008b811b6dc8d0875e3, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202302123ccb2e9b5c43466f9e396ae6b2e4e7e6, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202302126112c32489b74171a8463897751a6913, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202302128e17b0c2b0934395b74d1c0fa5415109, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230212d6057bca00184504b708b6acd6d48f2d, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023021240d363ee3ba045559336952277303653, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202302129d5ad3f18fe94f96af9319afb047dc3a, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230212de3ba320365e4c209e5e5905c42d1e7b, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230212e33bb280a79e495589b956efc4e3e56c] mob files 2023-02-12 03:54:54,622 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/12): hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230212216703835d1543e0bf1aa9f72faf4287 2023-02-12 03:54:54,622 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/12): hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230212a3a6d6339686408ba5d6e047ec635631 2023-02-12 03:54:54,622 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (3/12): hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230212a401f6430c8c4a8d88a379f214b16ffb 2023-02-12 03:54:54,622 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (4/12): hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230212b7f58914f1a44008b811b6dc8d0875e3 2023-02-12 03:54:54,622 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (5/12): hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202302123ccb2e9b5c43466f9e396ae6b2e4e7e6 2023-02-12 03:54:54,622 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (6/12): hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202302126112c32489b74171a8463897751a6913 2023-02-12 03:54:54,622 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (7/12): hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202302128e17b0c2b0934395b74d1c0fa5415109 2023-02-12 03:54:54,622 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (8/12): hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230212d6057bca00184504b708b6acd6d48f2d 2023-02-12 03:54:54,622 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (9/12): hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023021240d363ee3ba045559336952277303653 2023-02-12 03:54:54,622 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (10/12): hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202302129d5ad3f18fe94f96af9319afb047dc3a 2023-02-12 03:54:54,622 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (11/12): hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230212de3ba320365e4c209e5e5905c42d1e7b 2023-02-12 03:54:54,623 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (12/12): hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230212e33bb280a79e495589b956efc4e3e56c 2023-02-12 03:54:54,624 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202302122d66f473fe004147a0ef1f76a920c9e1, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202302127d6644667bea45bb867daf9b1ac0ecc3, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202302129e8cfbdfc0ec4fd8a9436aaa8c0bca05, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230212ea5af1d598ed41cf9f7220dba350a175, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202302121782cb197ab641539a6ad7c95e81357b, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202302129836d7cedd0346f0ab8d3b4fc30f7371, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230212cb32f8b6a63641388ce6c4c10f214ad3, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230212f429c7c7e2f04873a4522d785a7fa596, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023021218f5c72f02694ad2965ea5a26f85029b, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230212734a01057dd74d75841e87f3ac454484, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230212b19a5db2fcd54e20b4d9ad64a100884e, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230212f7df8ff2eb5b43de9ff5fa96b9d4804b] mob files 2023-02-12 03:54:54,624 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/12): hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202302122d66f473fe004147a0ef1f76a920c9e1 2023-02-12 03:54:54,624 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/12): hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202302127d6644667bea45bb867daf9b1ac0ecc3 2023-02-12 03:54:54,624 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (3/12): hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202302129e8cfbdfc0ec4fd8a9436aaa8c0bca05 2023-02-12 03:54:54,624 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (4/12): hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230212ea5af1d598ed41cf9f7220dba350a175 2023-02-12 03:54:54,624 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (5/12): hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202302121782cb197ab641539a6ad7c95e81357b 2023-02-12 03:54:54,624 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (6/12): hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202302129836d7cedd0346f0ab8d3b4fc30f7371 2023-02-12 03:54:54,625 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (7/12): hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230212cb32f8b6a63641388ce6c4c10f214ad3 2023-02-12 03:54:54,625 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (8/12): hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230212f429c7c7e2f04873a4522d785a7fa596 2023-02-12 03:54:54,625 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (9/12): hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023021218f5c72f02694ad2965ea5a26f85029b 2023-02-12 03:54:54,625 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (10/12): hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230212734a01057dd74d75841e87f3ac454484 2023-02-12 03:54:54,625 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (11/12): hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230212b19a5db2fcd54e20b4d9ad64a100884e 2023-02-12 03:54:54,625 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (12/12): hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230212f7df8ff2eb5b43de9ff5fa96b9d4804b 2023-02-12 03:54:54,739 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-12 03:54:54,741 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=snaptb-1676174093579 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-12 03:54:54,741 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb-1676174093579 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-02-12 03:54:54,742 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-02-12 03:54:55,032 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb-1676174093579 2023-02-12 03:54:55,034 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/.hbase-snapshot/.tmp/snaptb-1676174093579 2023-02-12 03:54:55,482 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/.hbase-snapshot/.tmp/snaptb-1676174093579 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/.hbase-snapshot/snaptb-1676174093579 2023-02-12 03:54:55,742 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-12 03:54:55,744 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=snaptb-1676174093579 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-12 03:54:55,744 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb-1676174093579 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-02-12 03:54:55,744 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2428): (#6) Sleeping: 2000ms while waiting for snapshot completion. 2023-02-12 03:54:56,303 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb-1676174093579 of table testCompactionWithHFileLink completed 2023-02-12 03:54:56,304 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/.hbase-snapshot/.tmp/snaptb-1676174093579 2023-02-12 03:54:56,304 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/.hbase-snapshot/.tmp/snaptb-1676174093579 2023-02-12 03:54:56,304 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb-1676174093579 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink at 1676174093620Completed referencing HFiles for the mob region of table: testCompactionWithHFileLink at 1676174095031 (+1411 ms)Consolidate snapshot: snaptb-1676174093579 at 1676174095032 (+1 ms)Loading Region manifests for snaptb-1676174093579 at 1676174095032Writing data manifest for snaptb-1676174093579 at 1676174095044 (+12 ms)Verifying snapshot: snaptb-1676174093579 at 1676174095455 (+411 ms)Snapshot snaptb-1676174093579 of table testCompactionWithHFileLink completed at 1676174096303 (+848 ms) 2023-02-12 03:54:56,305 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=87, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-02-12 03:54:56,306 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=87, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED in 2.6840 sec 2023-02-12 03:54:57,039 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-12 03:54:57,745 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-12 03:54:57,746 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=snaptb-1676174093579 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-12 03:54:57,746 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb-1676174093579 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-12 03:54:57,782 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-12 03:54:57,784 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-02-12 03:54:57,784 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-02-12 03:54:57,784 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-02-12 03:54:57,784 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:54:57,784 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-02-12 03:54:57,784 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-02-12 03:54:57,784 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-12 03:54:57,785 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-12 03:54:57,785 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:54:57,785 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:57,785 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:54:57,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:54:57,786 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:57,786 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-12 03:54:57,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-12 03:54:57,786 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-12 03:54:57,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-12 03:54:57,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-12 03:54:57,787 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-02-12 03:54:57,787 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-02-12 03:54:57,787 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-02-12 03:54:57,787 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:54:57,787 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-02-12 03:54:57,787 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1676174084167.0e9d0e06e60b6abe7b05797a5112bb5e. 2023-02-12 03:54:57,787 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1676174084167.369851c5c3dd6d38afc3b2a16e1a3ffc. 2023-02-12 03:54:57,787 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-12 03:54:57,787 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-12 03:54:57,787 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1676174084167.0e9d0e06e60b6abe7b05797a5112bb5e. started... 2023-02-12 03:54:57,787 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1676174084167.4e8254a6d12aded099b366c106c6930d. 2023-02-12 03:54:57,788 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1676174084167.4e8254a6d12aded099b366c106c6930d. started... 2023-02-12 03:54:57,788 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 0e9d0e06e60b6abe7b05797a5112bb5e 2/2 column families, dataSize=138 B heapSize=944 B 2023-02-12 03:54:57,787 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1676174084167.369851c5c3dd6d38afc3b2a16e1a3ffc. started... 2023-02-12 03:54:57,788 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 4e8254a6d12aded099b366c106c6930d 2/2 column families, dataSize=138 B heapSize=944 B 2023-02-12 03:54:57,788 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 369851c5c3dd6d38afc3b2a16e1a3ffc 2/2 column families, dataSize=138 B heapSize=944 B 2023-02-12 03:54:58,217 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/.tmp/family1/1c2c34ff376449a4b08f75812f8ea519 2023-02-12 03:54:58,221 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1c2c34ff376449a4b08f75812f8ea519 2023-02-12 03:54:58,612 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/.tmp/family1/654aab5bc6c7494b84e2a47384b60a08 2023-02-12 03:54:58,618 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/.tmp/family1/8883b115b302457685287ed6466e811c 2023-02-12 03:54:58,621 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 654aab5bc6c7494b84e2a47384b60a08 2023-02-12 03:54:58,624 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8883b115b302457685287ed6466e811c 2023-02-12 03:54:59,038 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/.tmp/family2/c09fdb04ee16484aa8db081cf6004e78 2023-02-12 03:54:59,041 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/.tmp/family2/bb0d640629de4082a43900ea2855860e 2023-02-12 03:54:59,046 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c09fdb04ee16484aa8db081cf6004e78 2023-02-12 03:54:59,047 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for bb0d640629de4082a43900ea2855860e 2023-02-12 03:54:59,047 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/.tmp/family1/1c2c34ff376449a4b08f75812f8ea519 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/family1/1c2c34ff376449a4b08f75812f8ea519 2023-02-12 03:54:59,047 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/.tmp/family2/5691e511a76d404dbb9a0e78c25cf746 2023-02-12 03:54:59,048 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/.tmp/family1/654aab5bc6c7494b84e2a47384b60a08 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/family1/654aab5bc6c7494b84e2a47384b60a08 2023-02-12 03:54:59,050 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1c2c34ff376449a4b08f75812f8ea519 2023-02-12 03:54:59,050 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5691e511a76d404dbb9a0e78c25cf746 2023-02-12 03:54:59,051 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/family1/1c2c34ff376449a4b08f75812f8ea519, entries=3, sequenceid=24, filesize=5.0 K 2023-02-12 03:54:59,051 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 654aab5bc6c7494b84e2a47384b60a08 2023-02-12 03:54:59,051 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/.tmp/family1/8883b115b302457685287ed6466e811c as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/family1/8883b115b302457685287ed6466e811c 2023-02-12 03:54:59,051 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/family1/654aab5bc6c7494b84e2a47384b60a08, entries=3, sequenceid=24, filesize=5.0 K 2023-02-12 03:54:59,051 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/.tmp/family2/c09fdb04ee16484aa8db081cf6004e78 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/family2/c09fdb04ee16484aa8db081cf6004e78 2023-02-12 03:54:59,052 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/.tmp/family2/bb0d640629de4082a43900ea2855860e as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/family2/bb0d640629de4082a43900ea2855860e 2023-02-12 03:54:59,055 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c09fdb04ee16484aa8db081cf6004e78 2023-02-12 03:54:59,055 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/family2/c09fdb04ee16484aa8db081cf6004e78, entries=1, sequenceid=24, filesize=5.0 K 2023-02-12 03:54:59,055 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8883b115b302457685287ed6466e811c 2023-02-12 03:54:59,055 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/family1/8883b115b302457685287ed6466e811c, entries=3, sequenceid=24, filesize=5.0 K 2023-02-12 03:54:59,055 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for bb0d640629de4082a43900ea2855860e 2023-02-12 03:54:59,055 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 369851c5c3dd6d38afc3b2a16e1a3ffc in 1267ms, sequenceid=24, compaction requested=true 2023-02-12 03:54:59,055 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/family2/bb0d640629de4082a43900ea2855860e, entries=1, sequenceid=24, filesize=5.0 K 2023-02-12 03:54:59,055 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 369851c5c3dd6d38afc3b2a16e1a3ffc: 2023-02-12 03:54:59,055 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1676174084167.369851c5c3dd6d38afc3b2a16e1a3ffc. 2023-02-12 03:54:59,056 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-12 03:54:59,056 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 4e8254a6d12aded099b366c106c6930d in 1268ms, sequenceid=24, compaction requested=true 2023-02-12 03:54:59,056 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/.tmp/family2/5691e511a76d404dbb9a0e78c25cf746 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/family2/5691e511a76d404dbb9a0e78c25cf746 2023-02-12 03:54:59,056 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 4e8254a6d12aded099b366c106c6930d: 2023-02-12 03:54:59,056 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1676174084167.4e8254a6d12aded099b366c106c6930d. 2023-02-12 03:54:59,056 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-12 03:54:59,060 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5691e511a76d404dbb9a0e78c25cf746 2023-02-12 03:54:59,060 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/family2/5691e511a76d404dbb9a0e78c25cf746, entries=1, sequenceid=24, filesize=5.0 K 2023-02-12 03:54:59,060 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 0e9d0e06e60b6abe7b05797a5112bb5e in 1272ms, sequenceid=24, compaction requested=true 2023-02-12 03:54:59,061 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 0e9d0e06e60b6abe7b05797a5112bb5e: 2023-02-12 03:54:59,061 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1676174084167.0e9d0e06e60b6abe7b05797a5112bb5e. 2023-02-12 03:54:59,061 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-12 03:54:59,061 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-12 03:54:59,061 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:59,061 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-02-12 03:54:59,061 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-02-12 03:54:59,063 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:59,063 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-12 03:54:59,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:59,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:54:59,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:54:59,063 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-12 03:54:59,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:54:59,063 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 03:54:59,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:54:59,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-12 03:54:59,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:59,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:54:59,064 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-02-12 03:54:59,064 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-02-12 03:54:59,064 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@49ccb550[Count = 0] remaining members to acquire global barrier 2023-02-12 03:54:59,064 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-12 03:54:59,065 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-12 03:54:59,065 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-12 03:54:59,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-12 03:54:59,065 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-02-12 03:54:59,065 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-02-12 03:54:59,065 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase20.apache.org,39639,1676173982450' in zk 2023-02-12 03:54:59,065 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:59,065 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-12 03:54:59,066 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-02-12 03:54:59,066 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:59,066 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:54:59,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:59,066 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-02-12 03:54:59,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:54:59,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:54:59,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:54:59,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:54:59,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-12 03:54:59,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:59,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:54:59,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-12 03:54:59,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:59,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase20.apache.org,39639,1676173982450': 2023-02-12 03:54:59,068 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-02-12 03:54:59,068 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-02-12 03:54:59,068 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-12 03:54:59,068 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-12 03:54:59,068 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-02-12 03:54:59,068 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-12 03:54:59,069 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-12 03:54:59,069 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-12 03:54:59,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-12 03:54:59,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:54:59,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:54:59,069 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-12 03:54:59,069 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:54:59,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-12 03:54:59,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:54:59,069 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:59,069 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:54:59,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:54:59,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-12 03:54:59,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-12 03:54:59,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:54:59,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-12 03:54:59,070 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:59,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:59,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:54:59,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-12 03:54:59,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:59,071 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:59,071 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-12 03:54:59,071 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:54:59,071 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:54:59,071 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-02-12 03:54:59,071 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:54:59,071 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-02-12 03:54:59,072 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-12 03:54:59,071 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-12 03:54:59,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:54:59,071 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:54:59,072 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:54:59,072 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-12 03:54:59,072 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-12 03:54:59,072 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-12 03:54:59,072 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-02-12 03:54:59,072 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-12 03:54:59,072 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:54:59,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:54:59,172 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-12 03:54:59,174 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-12 03:54:59,175 DEBUG [Listener at localhost.localdomain/41049] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-12 03:54:59,175 DEBUG [Listener at localhost.localdomain/41049] regionserver.HStore(1912): 0e9d0e06e60b6abe7b05797a5112bb5e/family1 is initiating major compaction (all files) 2023-02-12 03:54:59,175 INFO [Listener at localhost.localdomain/41049] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-12 03:54:59,176 INFO [Listener at localhost.localdomain/41049] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 03:54:59,176 INFO [Listener at localhost.localdomain/41049] regionserver.HRegion(2258): Starting compaction of 0e9d0e06e60b6abe7b05797a5112bb5e/family1 in testCompactionWithHFileLink,1,1676174084167.0e9d0e06e60b6abe7b05797a5112bb5e. 2023-02-12 03:54:59,176 INFO [Listener at localhost.localdomain/41049] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/family1/ca25e354821f41239297823f77effa98, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/family1/1680fc2fd19047b9a4d476b5505a9420, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/family1/ad5e5cac5663442fb628697e0ac1cb74, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/family1/3cd14dd59fa842fba2f6ca863062ef1f, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/family1/8883b115b302457685287ed6466e811c] into tmpdir=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/.tmp, totalSize=26.7 K 2023-02-12 03:54:59,177 DEBUG [Listener at localhost.localdomain/41049] compactions.Compactor(207): Compacting ca25e354821f41239297823f77effa98, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676174086290 2023-02-12 03:54:59,178 DEBUG [Listener at localhost.localdomain/41049] compactions.Compactor(207): Compacting 1680fc2fd19047b9a4d476b5505a9420, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676174088114 2023-02-12 03:54:59,179 DEBUG [Listener at localhost.localdomain/41049] compactions.Compactor(207): Compacting ad5e5cac5663442fb628697e0ac1cb74, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676174089931 2023-02-12 03:54:59,180 DEBUG [Listener at localhost.localdomain/41049] compactions.Compactor(207): Compacting 3cd14dd59fa842fba2f6ca863062ef1f, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676174091752 2023-02-12 03:54:59,181 DEBUG [Listener at localhost.localdomain/41049] compactions.Compactor(207): Compacting 8883b115b302457685287ed6466e811c, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-02-12 03:54:59,202 INFO [Listener at localhost.localdomain/41049] throttle.PressureAwareThroughputController(145): 0e9d0e06e60b6abe7b05797a5112bb5e#family1#compaction#108 average throughput is 0.28 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-12 03:54:59,619 INFO [Listener at localhost.localdomain/41049] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20230212a3092d201c404b71b3f600acb24fd0db_del 2023-02-12 03:54:59,619 INFO [Listener at localhost.localdomain/41049] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230212a3092d201c404b71b3f600acb24fd0db_del to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230212a3092d201c404b71b3f600acb24fd0db_del 2023-02-12 03:55:00,040 INFO [Listener at localhost.localdomain/41049] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7f4abed2edde4309b8fcefad8528958d 2023-02-12 03:55:00,041 DEBUG [Listener at localhost.localdomain/41049] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/.tmp/family1/7f4abed2edde4309b8fcefad8528958d as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/family1/7f4abed2edde4309b8fcefad8528958d 2023-02-12 03:55:00,047 INFO [Listener at localhost.localdomain/41049] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7f4abed2edde4309b8fcefad8528958d 2023-02-12 03:55:00,048 INFO [Listener at localhost.localdomain/41049] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 0e9d0e06e60b6abe7b05797a5112bb5e/family1 of 0e9d0e06e60b6abe7b05797a5112bb5e into 7f4abed2edde4309b8fcefad8528958d(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-12 03:55:00,049 DEBUG [Listener at localhost.localdomain/41049] regionserver.HRegion(2288): Compaction status journal for 0e9d0e06e60b6abe7b05797a5112bb5e: 2023-02-12 03:55:00,049 DEBUG [Listener at localhost.localdomain/41049] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-12 03:55:00,049 DEBUG [Listener at localhost.localdomain/41049] regionserver.HStore(1912): 0e9d0e06e60b6abe7b05797a5112bb5e/family2 is initiating major compaction (all files) 2023-02-12 03:55:00,049 INFO [Listener at localhost.localdomain/41049] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-12 03:55:00,049 INFO [Listener at localhost.localdomain/41049] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 03:55:00,049 INFO [Listener at localhost.localdomain/41049] regionserver.HRegion(2258): Starting compaction of 0e9d0e06e60b6abe7b05797a5112bb5e/family2 in testCompactionWithHFileLink,1,1676174084167.0e9d0e06e60b6abe7b05797a5112bb5e. 2023-02-12 03:55:00,049 INFO [Listener at localhost.localdomain/41049] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/family2/dd64bba239ac4a7491ca0594815ff9af, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/family2/109b596bd4c145e380fc107ade6f1be3, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/family2/bd136b408a804ed88601e3708f60c2a2, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/family2/cf35ea8d9268481bbf9aeec68aa1adb6, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/family2/5691e511a76d404dbb9a0e78c25cf746] into tmpdir=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/.tmp, totalSize=25.4 K 2023-02-12 03:55:00,051 DEBUG [Listener at localhost.localdomain/41049] compactions.Compactor(207): Compacting dd64bba239ac4a7491ca0594815ff9af, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676174086290 2023-02-12 03:55:00,053 DEBUG [Listener at localhost.localdomain/41049] compactions.Compactor(207): Compacting 109b596bd4c145e380fc107ade6f1be3, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676174088114 2023-02-12 03:55:00,055 DEBUG [Listener at localhost.localdomain/41049] compactions.Compactor(207): Compacting bd136b408a804ed88601e3708f60c2a2, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676174089931 2023-02-12 03:55:00,055 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/family1/ca25e354821f41239297823f77effa98, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/family1/1680fc2fd19047b9a4d476b5505a9420, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/family1/ad5e5cac5663442fb628697e0ac1cb74, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/family1/3cd14dd59fa842fba2f6ca863062ef1f, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/family1/8883b115b302457685287ed6466e811c] to archive 2023-02-12 03:55:00,056 DEBUG [Listener at localhost.localdomain/41049] compactions.Compactor(207): Compacting cf35ea8d9268481bbf9aeec68aa1adb6, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676174091752 2023-02-12 03:55:00,056 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-12 03:55:00,056 DEBUG [Listener at localhost.localdomain/41049] compactions.Compactor(207): Compacting 5691e511a76d404dbb9a0e78c25cf746, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-02-12 03:55:00,058 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/family1/ca25e354821f41239297823f77effa98 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/family1/ca25e354821f41239297823f77effa98 2023-02-12 03:55:00,059 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/family1/1680fc2fd19047b9a4d476b5505a9420 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/family1/1680fc2fd19047b9a4d476b5505a9420 2023-02-12 03:55:00,060 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/family1/ad5e5cac5663442fb628697e0ac1cb74 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/family1/ad5e5cac5663442fb628697e0ac1cb74 2023-02-12 03:55:00,062 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/family1/3cd14dd59fa842fba2f6ca863062ef1f to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/family1/3cd14dd59fa842fba2f6ca863062ef1f 2023-02-12 03:55:00,064 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/family1/8883b115b302457685287ed6466e811c to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/family1/8883b115b302457685287ed6466e811c 2023-02-12 03:55:00,072 INFO [Listener at localhost.localdomain/41049] throttle.PressureAwareThroughputController(145): 0e9d0e06e60b6abe7b05797a5112bb5e#family2#compaction#109 average throughput is 0.35 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-12 03:55:00,484 INFO [Listener at localhost.localdomain/41049] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b202302129f55f3a10ba94b29972e398fcaff9e90_del 2023-02-12 03:55:00,484 INFO [Listener at localhost.localdomain/41049] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202302129f55f3a10ba94b29972e398fcaff9e90_del to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202302129f55f3a10ba94b29972e398fcaff9e90_del 2023-02-12 03:55:01,312 INFO [Listener at localhost.localdomain/41049] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a09e474efda84c1e8ffb5a29f5530324 2023-02-12 03:55:01,313 DEBUG [Listener at localhost.localdomain/41049] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/.tmp/family2/a09e474efda84c1e8ffb5a29f5530324 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/family2/a09e474efda84c1e8ffb5a29f5530324 2023-02-12 03:55:01,317 INFO [Listener at localhost.localdomain/41049] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a09e474efda84c1e8ffb5a29f5530324 2023-02-12 03:55:01,318 INFO [Listener at localhost.localdomain/41049] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 0e9d0e06e60b6abe7b05797a5112bb5e/family2 of 0e9d0e06e60b6abe7b05797a5112bb5e into a09e474efda84c1e8ffb5a29f5530324(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-12 03:55:01,318 DEBUG [Listener at localhost.localdomain/41049] regionserver.HRegion(2288): Compaction status journal for 0e9d0e06e60b6abe7b05797a5112bb5e: 2023-02-12 03:55:01,318 DEBUG [Listener at localhost.localdomain/41049] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-12 03:55:01,318 DEBUG [Listener at localhost.localdomain/41049] regionserver.HStore(1912): 369851c5c3dd6d38afc3b2a16e1a3ffc/family1 is initiating major compaction (all files) 2023-02-12 03:55:01,318 INFO [Listener at localhost.localdomain/41049] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-12 03:55:01,318 INFO [Listener at localhost.localdomain/41049] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 03:55:01,319 INFO [Listener at localhost.localdomain/41049] regionserver.HRegion(2258): Starting compaction of 369851c5c3dd6d38afc3b2a16e1a3ffc/family1 in testCompactionWithHFileLink,2,1676174084167.369851c5c3dd6d38afc3b2a16e1a3ffc. 2023-02-12 03:55:01,319 INFO [Listener at localhost.localdomain/41049] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/family1/57336479cdcf48c297824f71584356ca, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/family1/28a38cf350244da7830c9753b7964958, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/family1/87d4d7959ed5460db9686869a40435c0, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/family1/cc7410dc341d435da9efadbba79ec3d5, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/family1/1c2c34ff376449a4b08f75812f8ea519] into tmpdir=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/.tmp, totalSize=26.7 K 2023-02-12 03:55:01,319 DEBUG [Listener at localhost.localdomain/41049] compactions.Compactor(207): Compacting 57336479cdcf48c297824f71584356ca, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676174086291 2023-02-12 03:55:01,320 DEBUG [Listener at localhost.localdomain/41049] compactions.Compactor(207): Compacting 28a38cf350244da7830c9753b7964958, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676174088114 2023-02-12 03:55:01,320 DEBUG [Listener at localhost.localdomain/41049] compactions.Compactor(207): Compacting 87d4d7959ed5460db9686869a40435c0, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676174089932 2023-02-12 03:55:01,320 DEBUG [Listener at localhost.localdomain/41049] compactions.Compactor(207): Compacting cc7410dc341d435da9efadbba79ec3d5, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676174091752 2023-02-12 03:55:01,321 DEBUG [Listener at localhost.localdomain/41049] compactions.Compactor(207): Compacting 1c2c34ff376449a4b08f75812f8ea519, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-02-12 03:55:01,331 INFO [Listener at localhost.localdomain/41049] throttle.PressureAwareThroughputController(145): 369851c5c3dd6d38afc3b2a16e1a3ffc#family1#compaction#110 average throughput is 0.85 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-12 03:55:01,354 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/family2/dd64bba239ac4a7491ca0594815ff9af, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/family2/109b596bd4c145e380fc107ade6f1be3, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/family2/bd136b408a804ed88601e3708f60c2a2, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/family2/cf35ea8d9268481bbf9aeec68aa1adb6, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/family2/5691e511a76d404dbb9a0e78c25cf746] to archive 2023-02-12 03:55:01,355 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-12 03:55:01,357 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/family2/dd64bba239ac4a7491ca0594815ff9af to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/family2/dd64bba239ac4a7491ca0594815ff9af 2023-02-12 03:55:01,358 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/family2/109b596bd4c145e380fc107ade6f1be3 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/family2/109b596bd4c145e380fc107ade6f1be3 2023-02-12 03:55:01,359 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/family2/bd136b408a804ed88601e3708f60c2a2 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/family2/bd136b408a804ed88601e3708f60c2a2 2023-02-12 03:55:01,360 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/family2/cf35ea8d9268481bbf9aeec68aa1adb6 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/family2/cf35ea8d9268481bbf9aeec68aa1adb6 2023-02-12 03:55:01,361 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/family2/5691e511a76d404dbb9a0e78c25cf746 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/family2/5691e511a76d404dbb9a0e78c25cf746 2023-02-12 03:55:01,746 INFO [Listener at localhost.localdomain/41049] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202302128c6d609f01ed49cca911854ab9bbf632_del 2023-02-12 03:55:01,746 INFO [Listener at localhost.localdomain/41049] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302128c6d609f01ed49cca911854ab9bbf632_del to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202302128c6d609f01ed49cca911854ab9bbf632_del 2023-02-12 03:55:02,572 INFO [Listener at localhost.localdomain/41049] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ab81feae660f4af8aa8ed6d44cc28dad 2023-02-12 03:55:02,573 DEBUG [Listener at localhost.localdomain/41049] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/.tmp/family1/ab81feae660f4af8aa8ed6d44cc28dad as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/family1/ab81feae660f4af8aa8ed6d44cc28dad 2023-02-12 03:55:02,578 INFO [Listener at localhost.localdomain/41049] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ab81feae660f4af8aa8ed6d44cc28dad 2023-02-12 03:55:02,579 INFO [Listener at localhost.localdomain/41049] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 369851c5c3dd6d38afc3b2a16e1a3ffc/family1 of 369851c5c3dd6d38afc3b2a16e1a3ffc into ab81feae660f4af8aa8ed6d44cc28dad(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-12 03:55:02,579 DEBUG [Listener at localhost.localdomain/41049] regionserver.HRegion(2288): Compaction status journal for 369851c5c3dd6d38afc3b2a16e1a3ffc: 2023-02-12 03:55:02,579 DEBUG [Listener at localhost.localdomain/41049] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-12 03:55:02,580 DEBUG [Listener at localhost.localdomain/41049] regionserver.HStore(1912): 369851c5c3dd6d38afc3b2a16e1a3ffc/family2 is initiating major compaction (all files) 2023-02-12 03:55:02,580 INFO [Listener at localhost.localdomain/41049] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-12 03:55:02,580 INFO [Listener at localhost.localdomain/41049] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 03:55:02,580 INFO [Listener at localhost.localdomain/41049] regionserver.HRegion(2258): Starting compaction of 369851c5c3dd6d38afc3b2a16e1a3ffc/family2 in testCompactionWithHFileLink,2,1676174084167.369851c5c3dd6d38afc3b2a16e1a3ffc. 2023-02-12 03:55:02,580 INFO [Listener at localhost.localdomain/41049] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/family2/fef2cc5193ee4c29bf399d13cb8afa3b, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/family2/e45c7d1c8c914c029f7acb4750386b15, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/family2/0ee9478488594ba3b7336e26366747b1, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/family2/46d19779813b4d9e825a09db392f3515, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/family2/c09fdb04ee16484aa8db081cf6004e78] into tmpdir=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/.tmp, totalSize=25.4 K 2023-02-12 03:55:02,581 DEBUG [Listener at localhost.localdomain/41049] compactions.Compactor(207): Compacting fef2cc5193ee4c29bf399d13cb8afa3b, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676174086291 2023-02-12 03:55:02,581 DEBUG [Listener at localhost.localdomain/41049] compactions.Compactor(207): Compacting e45c7d1c8c914c029f7acb4750386b15, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676174088114 2023-02-12 03:55:02,582 DEBUG [Listener at localhost.localdomain/41049] compactions.Compactor(207): Compacting 0ee9478488594ba3b7336e26366747b1, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676174089932 2023-02-12 03:55:02,582 DEBUG [Listener at localhost.localdomain/41049] compactions.Compactor(207): Compacting 46d19779813b4d9e825a09db392f3515, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676174091752 2023-02-12 03:55:02,582 DEBUG [Listener at localhost.localdomain/41049] compactions.Compactor(207): Compacting c09fdb04ee16484aa8db081cf6004e78, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-02-12 03:55:02,597 INFO [Listener at localhost.localdomain/41049] throttle.PressureAwareThroughputController(145): 369851c5c3dd6d38afc3b2a16e1a3ffc#family2#compaction#111 average throughput is 0.26 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-12 03:55:02,665 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/family1/57336479cdcf48c297824f71584356ca, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/family1/28a38cf350244da7830c9753b7964958, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/family1/87d4d7959ed5460db9686869a40435c0, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/family1/cc7410dc341d435da9efadbba79ec3d5, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/family1/1c2c34ff376449a4b08f75812f8ea519] to archive 2023-02-12 03:55:02,666 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-12 03:55:02,670 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/family1/57336479cdcf48c297824f71584356ca to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/family1/57336479cdcf48c297824f71584356ca 2023-02-12 03:55:02,672 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/family1/28a38cf350244da7830c9753b7964958 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/family1/28a38cf350244da7830c9753b7964958 2023-02-12 03:55:02,674 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/family1/87d4d7959ed5460db9686869a40435c0 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/family1/87d4d7959ed5460db9686869a40435c0 2023-02-12 03:55:02,676 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/family1/cc7410dc341d435da9efadbba79ec3d5 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/family1/cc7410dc341d435da9efadbba79ec3d5 2023-02-12 03:55:02,677 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/family1/1c2c34ff376449a4b08f75812f8ea519 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/family1/1c2c34ff376449a4b08f75812f8ea519 2023-02-12 03:55:03,014 INFO [Listener at localhost.localdomain/41049] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c2023021220a2e9433eba4d98a6904d7ad86e0ae2_del 2023-02-12 03:55:03,014 INFO [Listener at localhost.localdomain/41049] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023021220a2e9433eba4d98a6904d7ad86e0ae2_del to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023021220a2e9433eba4d98a6904d7ad86e0ae2_del 2023-02-12 03:55:03,435 INFO [Listener at localhost.localdomain/41049] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e6d75c83fc51486ebd93ba76e83caf12 2023-02-12 03:55:03,436 DEBUG [Listener at localhost.localdomain/41049] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/.tmp/family2/e6d75c83fc51486ebd93ba76e83caf12 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/family2/e6d75c83fc51486ebd93ba76e83caf12 2023-02-12 03:55:03,442 INFO [Listener at localhost.localdomain/41049] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e6d75c83fc51486ebd93ba76e83caf12 2023-02-12 03:55:03,443 INFO [Listener at localhost.localdomain/41049] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 369851c5c3dd6d38afc3b2a16e1a3ffc/family2 of 369851c5c3dd6d38afc3b2a16e1a3ffc into e6d75c83fc51486ebd93ba76e83caf12(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-12 03:55:03,443 DEBUG [Listener at localhost.localdomain/41049] regionserver.HRegion(2288): Compaction status journal for 369851c5c3dd6d38afc3b2a16e1a3ffc: 2023-02-12 03:55:03,443 DEBUG [Listener at localhost.localdomain/41049] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-12 03:55:03,443 DEBUG [Listener at localhost.localdomain/41049] regionserver.HStore(1912): 4e8254a6d12aded099b366c106c6930d/family1 is initiating major compaction (all files) 2023-02-12 03:55:03,444 INFO [Listener at localhost.localdomain/41049] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-12 03:55:03,444 INFO [Listener at localhost.localdomain/41049] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 03:55:03,444 INFO [Listener at localhost.localdomain/41049] regionserver.HRegion(2258): Starting compaction of 4e8254a6d12aded099b366c106c6930d/family1 in testCompactionWithHFileLink,,1676174084167.4e8254a6d12aded099b366c106c6930d. 2023-02-12 03:55:03,444 INFO [Listener at localhost.localdomain/41049] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/family1/67634b9f7088459b8c692fbefde445c4, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/family1/f16c24a6c05c4ffc99cbbd8f419bdc6b, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/family1/24c9ba5b866a46329c7fb8ab8a046ca8, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/family1/74306a4c7f9e4c4d90d47fe163c451c2, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/family1/654aab5bc6c7494b84e2a47384b60a08] into tmpdir=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/.tmp, totalSize=26.7 K 2023-02-12 03:55:03,444 DEBUG [Listener at localhost.localdomain/41049] compactions.Compactor(207): Compacting 67634b9f7088459b8c692fbefde445c4, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676174086289 2023-02-12 03:55:03,445 DEBUG [Listener at localhost.localdomain/41049] compactions.Compactor(207): Compacting f16c24a6c05c4ffc99cbbd8f419bdc6b, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676174088114 2023-02-12 03:55:03,445 DEBUG [Listener at localhost.localdomain/41049] compactions.Compactor(207): Compacting 24c9ba5b866a46329c7fb8ab8a046ca8, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676174089931 2023-02-12 03:55:03,445 DEBUG [Listener at localhost.localdomain/41049] compactions.Compactor(207): Compacting 74306a4c7f9e4c4d90d47fe163c451c2, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676174091751 2023-02-12 03:55:03,446 DEBUG [Listener at localhost.localdomain/41049] compactions.Compactor(207): Compacting 654aab5bc6c7494b84e2a47384b60a08, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-02-12 03:55:03,454 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/family2/fef2cc5193ee4c29bf399d13cb8afa3b, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/family2/e45c7d1c8c914c029f7acb4750386b15, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/family2/0ee9478488594ba3b7336e26366747b1, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/family2/46d19779813b4d9e825a09db392f3515, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/family2/c09fdb04ee16484aa8db081cf6004e78] to archive 2023-02-12 03:55:03,454 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-12 03:55:03,456 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/family2/fef2cc5193ee4c29bf399d13cb8afa3b to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/family2/fef2cc5193ee4c29bf399d13cb8afa3b 2023-02-12 03:55:03,457 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/family2/e45c7d1c8c914c029f7acb4750386b15 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/family2/e45c7d1c8c914c029f7acb4750386b15 2023-02-12 03:55:03,458 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/family2/0ee9478488594ba3b7336e26366747b1 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/family2/0ee9478488594ba3b7336e26366747b1 2023-02-12 03:55:03,458 INFO [Listener at localhost.localdomain/41049] throttle.PressureAwareThroughputController(145): 4e8254a6d12aded099b366c106c6930d#family1#compaction#112 average throughput is 0.85 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-12 03:55:03,459 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/family2/46d19779813b4d9e825a09db392f3515 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/family2/46d19779813b4d9e825a09db392f3515 2023-02-12 03:55:03,460 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/family2/c09fdb04ee16484aa8db081cf6004e78 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/family2/c09fdb04ee16484aa8db081cf6004e78 2023-02-12 03:55:03,881 INFO [Listener at localhost.localdomain/41049] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20230212a0b8eb6d30a3462b98f5a549945b6748_del 2023-02-12 03:55:03,881 INFO [Listener at localhost.localdomain/41049] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230212a0b8eb6d30a3462b98f5a549945b6748_del to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230212a0b8eb6d30a3462b98f5a549945b6748_del 2023-02-12 03:55:04,711 INFO [Listener at localhost.localdomain/41049] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7730098863a144d3a17241ccf222a945 2023-02-12 03:55:04,712 DEBUG [Listener at localhost.localdomain/41049] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/.tmp/family1/7730098863a144d3a17241ccf222a945 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/family1/7730098863a144d3a17241ccf222a945 2023-02-12 03:55:04,717 INFO [Listener at localhost.localdomain/41049] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7730098863a144d3a17241ccf222a945 2023-02-12 03:55:04,718 INFO [Listener at localhost.localdomain/41049] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 4e8254a6d12aded099b366c106c6930d/family1 of 4e8254a6d12aded099b366c106c6930d into 7730098863a144d3a17241ccf222a945(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-12 03:55:04,718 DEBUG [Listener at localhost.localdomain/41049] regionserver.HRegion(2288): Compaction status journal for 4e8254a6d12aded099b366c106c6930d: 2023-02-12 03:55:04,718 DEBUG [Listener at localhost.localdomain/41049] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-12 03:55:04,718 DEBUG [Listener at localhost.localdomain/41049] regionserver.HStore(1912): 4e8254a6d12aded099b366c106c6930d/family2 is initiating major compaction (all files) 2023-02-12 03:55:04,718 INFO [Listener at localhost.localdomain/41049] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-12 03:55:04,718 INFO [Listener at localhost.localdomain/41049] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 03:55:04,719 INFO [Listener at localhost.localdomain/41049] regionserver.HRegion(2258): Starting compaction of 4e8254a6d12aded099b366c106c6930d/family2 in testCompactionWithHFileLink,,1676174084167.4e8254a6d12aded099b366c106c6930d. 2023-02-12 03:55:04,719 INFO [Listener at localhost.localdomain/41049] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/family2/9094c6fd8f824ee288f6545ee8d61038, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/family2/82632c718e894427ab9e68941a927668, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/family2/d98fbbdcc7af49b48050c5145edd38da, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/family2/54b7be21dbb245e787729ac2c1f02542, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/family2/bb0d640629de4082a43900ea2855860e] into tmpdir=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/.tmp, totalSize=25.4 K 2023-02-12 03:55:04,719 DEBUG [Listener at localhost.localdomain/41049] compactions.Compactor(207): Compacting 9094c6fd8f824ee288f6545ee8d61038, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676174086289 2023-02-12 03:55:04,720 DEBUG [Listener at localhost.localdomain/41049] compactions.Compactor(207): Compacting 82632c718e894427ab9e68941a927668, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676174088114 2023-02-12 03:55:04,720 DEBUG [Listener at localhost.localdomain/41049] compactions.Compactor(207): Compacting d98fbbdcc7af49b48050c5145edd38da, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676174089931 2023-02-12 03:55:04,721 DEBUG [Listener at localhost.localdomain/41049] compactions.Compactor(207): Compacting 54b7be21dbb245e787729ac2c1f02542, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676174091751 2023-02-12 03:55:04,721 DEBUG [Listener at localhost.localdomain/41049] compactions.Compactor(207): Compacting bb0d640629de4082a43900ea2855860e, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-02-12 03:55:04,734 INFO [Listener at localhost.localdomain/41049] throttle.PressureAwareThroughputController(145): 4e8254a6d12aded099b366c106c6930d#family2#compaction#113 average throughput is 0.35 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-12 03:55:04,750 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/family1/67634b9f7088459b8c692fbefde445c4, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/family1/f16c24a6c05c4ffc99cbbd8f419bdc6b, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/family1/24c9ba5b866a46329c7fb8ab8a046ca8, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/family1/74306a4c7f9e4c4d90d47fe163c451c2, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/family1/654aab5bc6c7494b84e2a47384b60a08] to archive 2023-02-12 03:55:04,751 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-12 03:55:04,752 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/family1/67634b9f7088459b8c692fbefde445c4 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/family1/67634b9f7088459b8c692fbefde445c4 2023-02-12 03:55:04,753 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/family1/f16c24a6c05c4ffc99cbbd8f419bdc6b to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/family1/f16c24a6c05c4ffc99cbbd8f419bdc6b 2023-02-12 03:55:04,754 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/family1/24c9ba5b866a46329c7fb8ab8a046ca8 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/family1/24c9ba5b866a46329c7fb8ab8a046ca8 2023-02-12 03:55:04,755 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/family1/74306a4c7f9e4c4d90d47fe163c451c2 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/family1/74306a4c7f9e4c4d90d47fe163c451c2 2023-02-12 03:55:04,755 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/family1/654aab5bc6c7494b84e2a47384b60a08 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/family1/654aab5bc6c7494b84e2a47384b60a08 2023-02-12 03:55:05,151 INFO [Listener at localhost.localdomain/41049] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e2023021223f4e32022b3458c99697b28d40de768_del 2023-02-12 03:55:05,151 INFO [Listener at localhost.localdomain/41049] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023021223f4e32022b3458c99697b28d40de768_del to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023021223f4e32022b3458c99697b28d40de768_del 2023-02-12 03:55:05,973 INFO [Listener at localhost.localdomain/41049] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for be8941937c7447efaf7957668a4fb103 2023-02-12 03:55:05,974 DEBUG [Listener at localhost.localdomain/41049] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/.tmp/family2/be8941937c7447efaf7957668a4fb103 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/family2/be8941937c7447efaf7957668a4fb103 2023-02-12 03:55:05,980 INFO [Listener at localhost.localdomain/41049] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for be8941937c7447efaf7957668a4fb103 2023-02-12 03:55:05,981 INFO [Listener at localhost.localdomain/41049] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 4e8254a6d12aded099b366c106c6930d/family2 of 4e8254a6d12aded099b366c106c6930d into be8941937c7447efaf7957668a4fb103(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-12 03:55:05,981 DEBUG [Listener at localhost.localdomain/41049] regionserver.HRegion(2288): Compaction status journal for 4e8254a6d12aded099b366c106c6930d: 2023-02-12 03:55:05,990 DEBUG [Listener at localhost.localdomain/41049] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-12 03:55:05,996 DEBUG [Listener at localhost.localdomain/41049] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-12 03:55:06,001 DEBUG [Listener at localhost.localdomain/41049] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-12 03:55:06,002 DEBUG [Listener at localhost.localdomain/41049] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-12 03:55:06,007 INFO [Listener at localhost.localdomain/41049] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-02-12 03:55:06,043 INFO [Listener at localhost.localdomain/41049] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 3 del files, 12 selected files, and 0 irrelevant files table 'testCompactionWithHFileLink' and column 'family1' 2023-02-12 03:55:06,047 INFO [Listener at localhost.localdomain/41049] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20230212a0b8eb6d30a3462b98f5a549945b6748_del 2023-02-12 03:55:06,050 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/family2/9094c6fd8f824ee288f6545ee8d61038, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/family2/82632c718e894427ab9e68941a927668, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/family2/d98fbbdcc7af49b48050c5145edd38da, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/family2/54b7be21dbb245e787729ac2c1f02542, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/family2/bb0d640629de4082a43900ea2855860e] to archive 2023-02-12 03:55:06,051 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-12 03:55:06,052 INFO [Listener at localhost.localdomain/41049] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20230212a3092d201c404b71b3f600acb24fd0db_del 2023-02-12 03:55:06,053 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/family2/9094c6fd8f824ee288f6545ee8d61038 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/family2/9094c6fd8f824ee288f6545ee8d61038 2023-02-12 03:55:06,055 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/family2/82632c718e894427ab9e68941a927668 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/family2/82632c718e894427ab9e68941a927668 2023-02-12 03:55:06,056 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/family2/d98fbbdcc7af49b48050c5145edd38da to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/family2/d98fbbdcc7af49b48050c5145edd38da 2023-02-12 03:55:06,056 INFO [Listener at localhost.localdomain/41049] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202302128c6d609f01ed49cca911854ab9bbf632_del 2023-02-12 03:55:06,056 INFO [Listener at localhost.localdomain/41049] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='testCompactionWithHFileLink' column='family1' 2023-02-12 03:55:06,057 DEBUG [Listener at localhost.localdomain/41049] zookeeper.ReadOnlyZKClient(139): Connect 0x5863e3a3 to 127.0.0.1:59556 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 03:55:06,057 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/family2/54b7be21dbb245e787729ac2c1f02542 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/family2/54b7be21dbb245e787729ac2c1f02542 2023-02-12 03:55:06,061 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/family2/bb0d640629de4082a43900ea2855860e to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/family2/bb0d640629de4082a43900ea2855860e 2023-02-12 03:55:06,061 DEBUG [Listener at localhost.localdomain/41049] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7d778528, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 03:55:06,062 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20230212 for table='testCompactionWithHFileLink' and column='family1' 2023-02-12 03:55:06,062 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20230212 for table='testCompactionWithHFileLink' and column='family1' 2023-02-12 03:55:06,062 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20230212 for table='testCompactionWithHFileLink' and column='family1' 2023-02-12 03:55:06,529 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230212c6296acd0d7d4d04bcd2989db836a4fb to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230212c6296acd0d7d4d04bcd2989db836a4fb 2023-02-12 03:55:06,531 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230212 table='testCompactionWithHFileLink' column='family1' 2023-02-12 03:55:06,545 DEBUG [MobFileCompactionChore-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-12 03:55:06,549 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:53788, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-12 03:55:06,556 DEBUG [MobFileCompactionChore-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-12 03:55:06,558 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:56826, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-12 03:55:06,566 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230212/family1/2f17280941c240b8b6bb7f3125e075f3 first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x07] 2023-02-12 03:55:06,566 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testCompactionWithHFileLink,2,1676174084167.369851c5c3dd6d38afc3b2a16e1a3ffc., hostname=jenkins-hbase20.apache.org,39639,1676173982450, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230212/family1/2f17280941c240b8b6bb7f3125e075f3}] 2023-02-12 03:55:06,570 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230212/family1/2f17280941c240b8b6bb7f3125e075f3 for inclusion in 369851c5c3dd6d38afc3b2a16e1a3ffc/family1 2023-02-12 03:55:06,572 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x07 2023-02-12 03:55:06,572 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HStore(777): Region bounds: first=2 last= 2023-02-12 03:55:06,572 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HRegion(2445): Flush status journal for 369851c5c3dd6d38afc3b2a16e1a3ffc: 2023-02-12 03:55:06,572 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230212/family1/2f17280941c240b8b6bb7f3125e075f3 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/staging/jenkins__testCompactionWithHFileLink__26etnr8sdco7apnfc14auhfgt7964ac2a4ruc9easmaq1iqov02g14l8kfd9724c/family1/2f17280941c240b8b6bb7f3125e075f3 2023-02-12 03:55:06,574 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/staging/jenkins__testCompactionWithHFileLink__26etnr8sdco7apnfc14auhfgt7964ac2a4ruc9easmaq1iqov02g14l8kfd9724c/family1/2f17280941c240b8b6bb7f3125e075f3 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/family1/204e08da11ec480cbc075254d8419faf_SeqId_29_ 2023-02-12 03:55:06,575 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/staging/jenkins__testCompactionWithHFileLink__26etnr8sdco7apnfc14auhfgt7964ac2a4ruc9easmaq1iqov02g14l8kfd9724c/family1/2f17280941c240b8b6bb7f3125e075f3 into 369851c5c3dd6d38afc3b2a16e1a3ffc/family1 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/family1/204e08da11ec480cbc075254d8419faf_SeqId_29_ - updating store file list. 2023-02-12 03:55:06,577 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/family1/204e08da11ec480cbc075254d8419faf_SeqId_29_ into 369851c5c3dd6d38afc3b2a16e1a3ffc/family1 2023-02-12 03:55:06,578 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/staging/jenkins__testCompactionWithHFileLink__26etnr8sdco7apnfc14auhfgt7964ac2a4ruc9easmaq1iqov02g14l8kfd9724c/family1/2f17280941c240b8b6bb7f3125e075f3 into 369851c5c3dd6d38afc3b2a16e1a3ffc/family1 (new location: hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/family1/204e08da11ec480cbc075254d8419faf_SeqId_29_) 2023-02-12 03:55:06,578 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/staging/jenkins__testCompactionWithHFileLink__26etnr8sdco7apnfc14auhfgt7964ac2a4ruc9easmaq1iqov02g14l8kfd9724c/family1/2f17280941c240b8b6bb7f3125e075f3 2023-02-12 03:55:06,580 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230212 table='testCompactionWithHFileLink' column='family1' 2023-02-12 03:55:06,580 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-02-12 03:55:06,582 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202302123ccb2e9b5c43466f9e396ae6b2e4e7e6 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202302123ccb2e9b5c43466f9e396ae6b2e4e7e6 2023-02-12 03:55:06,582 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202302126112c32489b74171a8463897751a6913 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202302126112c32489b74171a8463897751a6913 2023-02-12 03:55:06,583 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202302128e17b0c2b0934395b74d1c0fa5415109 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202302128e17b0c2b0934395b74d1c0fa5415109 2023-02-12 03:55:06,584 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230212d6057bca00184504b708b6acd6d48f2d to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230212d6057bca00184504b708b6acd6d48f2d 2023-02-12 03:55:06,584 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-02-12 03:55:06,584 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230212' 2023-02-12 03:55:06,585 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20230212 for table='testCompactionWithHFileLink' and column='family1' 2023-02-12 03:55:06,918 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202302122191bb4a95864de4adbe0eae1aa2ec13 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202302122191bb4a95864de4adbe0eae1aa2ec13 2023-02-12 03:55:06,919 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230212 table='testCompactionWithHFileLink' column='family1' 2023-02-12 03:55:06,929 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230212d7dc82dddc7343c0a42a619df22d1725 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230212d7dc82dddc7343c0a42a619df22d1725 2023-02-12 03:55:06,930 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230212 table='testCompactionWithHFileLink' column='family1' 2023-02-12 03:55:06,943 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230212/family1/46d3f91fd0874ce4b52b41ae3942fc5e first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x07] 2023-02-12 03:55:06,945 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testCompactionWithHFileLink,,1676174084167.4e8254a6d12aded099b366c106c6930d., hostname=jenkins-hbase20.apache.org,39639,1676173982450, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230212/family1/46d3f91fd0874ce4b52b41ae3942fc5e}] 2023-02-12 03:55:06,947 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230212/family1/46d3f91fd0874ce4b52b41ae3942fc5e for inclusion in 4e8254a6d12aded099b366c106c6930d/family1 2023-02-12 03:55:06,949 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x07 2023-02-12 03:55:06,949 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HStore(777): Region bounds: first= last=1 2023-02-12 03:55:06,949 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HRegion(2445): Flush status journal for 4e8254a6d12aded099b366c106c6930d: 2023-02-12 03:55:06,951 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230212/family1/46d3f91fd0874ce4b52b41ae3942fc5e to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/staging/jenkins__testCompactionWithHFileLink__13the05n8cmb78udaiddd9alq2319070aq3tt6srcf6120sfi4v6i8bp1u82q318/family1/46d3f91fd0874ce4b52b41ae3942fc5e 2023-02-12 03:55:06,953 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/staging/jenkins__testCompactionWithHFileLink__13the05n8cmb78udaiddd9alq2319070aq3tt6srcf6120sfi4v6i8bp1u82q318/family1/46d3f91fd0874ce4b52b41ae3942fc5e as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/family1/2b9cfdd2593e401fadc30caee5c7d923_SeqId_29_ 2023-02-12 03:55:06,953 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230212/family1/6bb2f84275194f058f5d5e707897c487 first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x07] 2023-02-12 03:55:06,954 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testCompactionWithHFileLink,1,1676174084167.0e9d0e06e60b6abe7b05797a5112bb5e., hostname=jenkins-hbase20.apache.org,39639,1676173982450, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230212/family1/6bb2f84275194f058f5d5e707897c487}] 2023-02-12 03:55:06,954 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/staging/jenkins__testCompactionWithHFileLink__13the05n8cmb78udaiddd9alq2319070aq3tt6srcf6120sfi4v6i8bp1u82q318/family1/46d3f91fd0874ce4b52b41ae3942fc5e into 4e8254a6d12aded099b366c106c6930d/family1 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/family1/2b9cfdd2593e401fadc30caee5c7d923_SeqId_29_ - updating store file list. 2023-02-12 03:55:06,955 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39639] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230212/family1/6bb2f84275194f058f5d5e707897c487 for inclusion in 0e9d0e06e60b6abe7b05797a5112bb5e/family1 2023-02-12 03:55:06,957 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39639] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x07 2023-02-12 03:55:06,957 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/family1/2b9cfdd2593e401fadc30caee5c7d923_SeqId_29_ into 4e8254a6d12aded099b366c106c6930d/family1 2023-02-12 03:55:06,958 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39639] regionserver.HStore(777): Region bounds: first=1 last=2 2023-02-12 03:55:06,958 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/staging/jenkins__testCompactionWithHFileLink__13the05n8cmb78udaiddd9alq2319070aq3tt6srcf6120sfi4v6i8bp1u82q318/family1/46d3f91fd0874ce4b52b41ae3942fc5e into 4e8254a6d12aded099b366c106c6930d/family1 (new location: hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/family1/2b9cfdd2593e401fadc30caee5c7d923_SeqId_29_) 2023-02-12 03:55:06,958 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39639] regionserver.HRegion(2445): Flush status journal for 0e9d0e06e60b6abe7b05797a5112bb5e: 2023-02-12 03:55:06,958 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/staging/jenkins__testCompactionWithHFileLink__13the05n8cmb78udaiddd9alq2319070aq3tt6srcf6120sfi4v6i8bp1u82q318/family1/46d3f91fd0874ce4b52b41ae3942fc5e 2023-02-12 03:55:06,960 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39639] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230212/family1/6bb2f84275194f058f5d5e707897c487 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/staging/jenkins__testCompactionWithHFileLink__u8660e9ut3fahhki7r30o9d5igj29gidckei60uardeq8aghkgumurrgltgqej6j/family1/6bb2f84275194f058f5d5e707897c487 2023-02-12 03:55:06,961 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230212 table='testCompactionWithHFileLink' column='family1' 2023-02-12 03:55:06,961 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-02-12 03:55:06,962 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39639] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/staging/jenkins__testCompactionWithHFileLink__u8660e9ut3fahhki7r30o9d5igj29gidckei60uardeq8aghkgumurrgltgqej6j/family1/6bb2f84275194f058f5d5e707897c487 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/family1/4622d7ea8794458eb200e5b2d74762f0_SeqId_29_ 2023-02-12 03:55:06,962 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39639] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/staging/jenkins__testCompactionWithHFileLink__u8660e9ut3fahhki7r30o9d5igj29gidckei60uardeq8aghkgumurrgltgqej6j/family1/6bb2f84275194f058f5d5e707897c487 into 0e9d0e06e60b6abe7b05797a5112bb5e/family1 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/family1/4622d7ea8794458eb200e5b2d74762f0_SeqId_29_ - updating store file list. 2023-02-12 03:55:06,963 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023021240d363ee3ba045559336952277303653 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023021240d363ee3ba045559336952277303653 2023-02-12 03:55:06,963 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202302129d5ad3f18fe94f96af9319afb047dc3a to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202302129d5ad3f18fe94f96af9319afb047dc3a 2023-02-12 03:55:06,964 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230212de3ba320365e4c209e5e5905c42d1e7b to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230212de3ba320365e4c209e5e5905c42d1e7b 2023-02-12 03:55:06,965 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230212e33bb280a79e495589b956efc4e3e56c to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230212e33bb280a79e495589b956efc4e3e56c 2023-02-12 03:55:06,965 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-02-12 03:55:06,965 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230212' 2023-02-12 03:55:06,965 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39639] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/family1/4622d7ea8794458eb200e5b2d74762f0_SeqId_29_ into 0e9d0e06e60b6abe7b05797a5112bb5e/family1 2023-02-12 03:55:06,965 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39639] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/staging/jenkins__testCompactionWithHFileLink__u8660e9ut3fahhki7r30o9d5igj29gidckei60uardeq8aghkgumurrgltgqej6j/family1/6bb2f84275194f058f5d5e707897c487 into 0e9d0e06e60b6abe7b05797a5112bb5e/family1 (new location: hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/family1/4622d7ea8794458eb200e5b2d74762f0_SeqId_29_) 2023-02-12 03:55:06,965 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20230212 for table='testCompactionWithHFileLink' and column='family1' 2023-02-12 03:55:06,965 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39639] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/staging/jenkins__testCompactionWithHFileLink__u8660e9ut3fahhki7r30o9d5igj29gidckei60uardeq8aghkgumurrgltgqej6j/family1/6bb2f84275194f058f5d5e707897c487 2023-02-12 03:55:06,967 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230212 table='testCompactionWithHFileLink' column='family1' 2023-02-12 03:55:06,967 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-12 03:55:06,968 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230212216703835d1543e0bf1aa9f72faf4287 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230212216703835d1543e0bf1aa9f72faf4287 2023-02-12 03:55:06,969 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230212a3a6d6339686408ba5d6e047ec635631 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230212a3a6d6339686408ba5d6e047ec635631 2023-02-12 03:55:06,970 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230212a401f6430c8c4a8d88a379f214b16ffb to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230212a401f6430c8c4a8d88a379f214b16ffb 2023-02-12 03:55:06,970 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230212b7f58914f1a44008b811b6dc8d0875e3 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230212b7f58914f1a44008b811b6dc8d0875e3 2023-02-12 03:55:06,971 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-02-12 03:55:06,971 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230212' 2023-02-12 03:55:06,971 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20230212 for table='testCompactionWithHFileLink' and column='family1' 2023-02-12 03:55:06,971 INFO [Listener at localhost.localdomain/41049] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testCompactionWithHFileLink' column='family1' 2023-02-12 03:55:06,971 INFO [Listener at localhost.localdomain/41049] compactions.PartitionedMobCompactor(364): After a mob compaction with all files selected, archiving the del files for table='testCompactionWithHFileLink' and column='family1' 2023-02-12 03:55:06,971 INFO [Listener at localhost.localdomain/41049] compactions.PartitionedMobCompactor(367): [hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230212a0b8eb6d30a3462b98f5a549945b6748_del] 2023-02-12 03:55:06,971 DEBUG [Listener at localhost.localdomain/41049] backup.HFileArchiver(360): Archiving compacted files. 2023-02-12 03:55:06,973 DEBUG [Listener at localhost.localdomain/41049] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230212a0b8eb6d30a3462b98f5a549945b6748_del to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230212a0b8eb6d30a3462b98f5a549945b6748_del 2023-02-12 03:55:06,973 INFO [Listener at localhost.localdomain/41049] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-02-12 03:55:06,973 INFO [Listener at localhost.localdomain/41049] compactions.PartitionedMobCompactor(367): [hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230212a3092d201c404b71b3f600acb24fd0db_del] 2023-02-12 03:55:06,973 DEBUG [Listener at localhost.localdomain/41049] backup.HFileArchiver(360): Archiving compacted files. 2023-02-12 03:55:06,974 DEBUG [Listener at localhost.localdomain/41049] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230212a3092d201c404b71b3f600acb24fd0db_del to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230212a3092d201c404b71b3f600acb24fd0db_del 2023-02-12 03:55:06,974 INFO [Listener at localhost.localdomain/41049] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-02-12 03:55:06,974 INFO [Listener at localhost.localdomain/41049] compactions.PartitionedMobCompactor(367): [hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202302128c6d609f01ed49cca911854ab9bbf632_del] 2023-02-12 03:55:06,975 DEBUG [Listener at localhost.localdomain/41049] backup.HFileArchiver(360): Archiving compacted files. 2023-02-12 03:55:06,976 DEBUG [Listener at localhost.localdomain/41049] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202302128c6d609f01ed49cca911854ab9bbf632_del to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202302128c6d609f01ed49cca911854ab9bbf632_del 2023-02-12 03:55:06,976 INFO [Listener at localhost.localdomain/41049] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-02-12 03:55:06,979 DEBUG [Listener at localhost.localdomain/41049] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-12 03:55:06,981 DEBUG [Listener at localhost.localdomain/41049] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-12 03:55:06,985 DEBUG [Listener at localhost.localdomain/41049] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-12 03:55:06,986 DEBUG [Listener at localhost.localdomain/41049] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-12 03:55:06,993 INFO [Listener at localhost.localdomain/41049] client.HBaseAdmin$15(890): Started disable of testCompactionWithHFileLink 2023-02-12 03:55:06,994 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.HMaster$11(2405): Client=jenkins//148.251.75.209 disable testCompactionWithHFileLink 2023-02-12 03:55:06,995 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] procedure2.ProcedureExecutor(1029): Stored pid=88, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testCompactionWithHFileLink 2023-02-12 03:55:06,997 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(1227): Checking to see if procedure is done pid=88 2023-02-12 03:55:06,997 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676174106997"}]},"ts":"1676174106997"} 2023-02-12 03:55:06,999 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=DISABLING in hbase:meta 2023-02-12 03:55:07,000 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testCompactionWithHFileLink to state=DISABLING 2023-02-12 03:55:07,001 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=89, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=4e8254a6d12aded099b366c106c6930d, UNASSIGN}, {pid=90, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=0e9d0e06e60b6abe7b05797a5112bb5e, UNASSIGN}, {pid=91, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=369851c5c3dd6d38afc3b2a16e1a3ffc, UNASSIGN}] 2023-02-12 03:55:07,003 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=369851c5c3dd6d38afc3b2a16e1a3ffc, UNASSIGN 2023-02-12 03:55:07,003 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=89, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=4e8254a6d12aded099b366c106c6930d, UNASSIGN 2023-02-12 03:55:07,003 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=90, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=0e9d0e06e60b6abe7b05797a5112bb5e, UNASSIGN 2023-02-12 03:55:07,004 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=369851c5c3dd6d38afc3b2a16e1a3ffc, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:07,004 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=89 updating hbase:meta row=4e8254a6d12aded099b366c106c6930d, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:07,004 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=90 updating hbase:meta row=0e9d0e06e60b6abe7b05797a5112bb5e, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:07,004 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1676174084167.369851c5c3dd6d38afc3b2a16e1a3ffc.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1676174107004"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676174107004"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676174107004"}]},"ts":"1676174107004"} 2023-02-12 03:55:07,004 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1676174084167.4e8254a6d12aded099b366c106c6930d.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1676174107004"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676174107004"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676174107004"}]},"ts":"1676174107004"} 2023-02-12 03:55:07,004 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1676174084167.0e9d0e06e60b6abe7b05797a5112bb5e.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1676174107004"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676174107004"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676174107004"}]},"ts":"1676174107004"} 2023-02-12 03:55:07,006 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=92, ppid=91, state=RUNNABLE; CloseRegionProcedure 369851c5c3dd6d38afc3b2a16e1a3ffc, server=jenkins-hbase20.apache.org,39639,1676173982450}] 2023-02-12 03:55:07,006 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=93, ppid=89, state=RUNNABLE; CloseRegionProcedure 4e8254a6d12aded099b366c106c6930d, server=jenkins-hbase20.apache.org,39639,1676173982450}] 2023-02-12 03:55:07,007 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=94, ppid=90, state=RUNNABLE; CloseRegionProcedure 0e9d0e06e60b6abe7b05797a5112bb5e, server=jenkins-hbase20.apache.org,39639,1676173982450}] 2023-02-12 03:55:07,099 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(1227): Checking to see if procedure is done pid=88 2023-02-12 03:55:07,158 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(109): Close 369851c5c3dd6d38afc3b2a16e1a3ffc 2023-02-12 03:55:07,159 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 369851c5c3dd6d38afc3b2a16e1a3ffc, disabling compactions & flushes 2023-02-12 03:55:07,159 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testCompactionWithHFileLink,2,1676174084167.369851c5c3dd6d38afc3b2a16e1a3ffc. 2023-02-12 03:55:07,159 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1676174084167.369851c5c3dd6d38afc3b2a16e1a3ffc. 2023-02-12 03:55:07,159 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testCompactionWithHFileLink,2,1676174084167.369851c5c3dd6d38afc3b2a16e1a3ffc. after waiting 0 ms 2023-02-12 03:55:07,159 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testCompactionWithHFileLink,2,1676174084167.369851c5c3dd6d38afc3b2a16e1a3ffc. 2023-02-12 03:55:07,171 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-02-12 03:55:07,173 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testCompactionWithHFileLink,2,1676174084167.369851c5c3dd6d38afc3b2a16e1a3ffc. 2023-02-12 03:55:07,173 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 369851c5c3dd6d38afc3b2a16e1a3ffc: Waiting for close lock at 1676174107159Running coprocessor pre-close hooks at 1676174107159Disabling compacts and flushes for region at 1676174107159Disabling writes for close at 1676174107159Writing region close event to WAL at 1676174107165 (+6 ms)Running coprocessor post-close hooks at 1676174107172 (+7 ms)Closed at 1676174107173 (+1 ms) 2023-02-12 03:55:07,176 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(147): Closed 369851c5c3dd6d38afc3b2a16e1a3ffc 2023-02-12 03:55:07,176 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(109): Close 0e9d0e06e60b6abe7b05797a5112bb5e 2023-02-12 03:55:07,176 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 0e9d0e06e60b6abe7b05797a5112bb5e, disabling compactions & flushes 2023-02-12 03:55:07,176 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testCompactionWithHFileLink,1,1676174084167.0e9d0e06e60b6abe7b05797a5112bb5e. 2023-02-12 03:55:07,176 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1676174084167.0e9d0e06e60b6abe7b05797a5112bb5e. 2023-02-12 03:55:07,176 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testCompactionWithHFileLink,1,1676174084167.0e9d0e06e60b6abe7b05797a5112bb5e. after waiting 0 ms 2023-02-12 03:55:07,176 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testCompactionWithHFileLink,1,1676174084167.0e9d0e06e60b6abe7b05797a5112bb5e. 2023-02-12 03:55:07,176 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=369851c5c3dd6d38afc3b2a16e1a3ffc, regionState=CLOSED 2023-02-12 03:55:07,177 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1676174084167.369851c5c3dd6d38afc3b2a16e1a3ffc.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1676174107176"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676174107176"}]},"ts":"1676174107176"} 2023-02-12 03:55:07,184 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=92, resume processing ppid=91 2023-02-12 03:55:07,184 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=92, ppid=91, state=SUCCESS; CloseRegionProcedure 369851c5c3dd6d38afc3b2a16e1a3ffc, server=jenkins-hbase20.apache.org,39639,1676173982450 in 175 msec 2023-02-12 03:55:07,185 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-02-12 03:55:07,185 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=91, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=369851c5c3dd6d38afc3b2a16e1a3ffc, UNASSIGN in 183 msec 2023-02-12 03:55:07,186 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testCompactionWithHFileLink,1,1676174084167.0e9d0e06e60b6abe7b05797a5112bb5e. 2023-02-12 03:55:07,187 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 0e9d0e06e60b6abe7b05797a5112bb5e: Waiting for close lock at 1676174107176Running coprocessor pre-close hooks at 1676174107176Disabling compacts and flushes for region at 1676174107176Disabling writes for close at 1676174107176Writing region close event to WAL at 1676174107181 (+5 ms)Running coprocessor post-close hooks at 1676174107186 (+5 ms)Closed at 1676174107186 2023-02-12 03:55:07,188 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(147): Closed 0e9d0e06e60b6abe7b05797a5112bb5e 2023-02-12 03:55:07,188 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(109): Close 4e8254a6d12aded099b366c106c6930d 2023-02-12 03:55:07,188 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 4e8254a6d12aded099b366c106c6930d, disabling compactions & flushes 2023-02-12 03:55:07,188 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testCompactionWithHFileLink,,1676174084167.4e8254a6d12aded099b366c106c6930d. 2023-02-12 03:55:07,188 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testCompactionWithHFileLink,,1676174084167.4e8254a6d12aded099b366c106c6930d. 2023-02-12 03:55:07,188 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testCompactionWithHFileLink,,1676174084167.4e8254a6d12aded099b366c106c6930d. after waiting 0 ms 2023-02-12 03:55:07,188 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testCompactionWithHFileLink,,1676174084167.4e8254a6d12aded099b366c106c6930d. 2023-02-12 03:55:07,188 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=90 updating hbase:meta row=0e9d0e06e60b6abe7b05797a5112bb5e, regionState=CLOSED 2023-02-12 03:55:07,188 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1676174084167.0e9d0e06e60b6abe7b05797a5112bb5e.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1676174107188"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676174107188"}]},"ts":"1676174107188"} 2023-02-12 03:55:07,193 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=94, resume processing ppid=90 2023-02-12 03:55:07,193 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=94, ppid=90, state=SUCCESS; CloseRegionProcedure 0e9d0e06e60b6abe7b05797a5112bb5e, server=jenkins-hbase20.apache.org,39639,1676173982450 in 185 msec 2023-02-12 03:55:07,194 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=90, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=0e9d0e06e60b6abe7b05797a5112bb5e, UNASSIGN in 192 msec 2023-02-12 03:55:07,194 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-02-12 03:55:07,195 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testCompactionWithHFileLink,,1676174084167.4e8254a6d12aded099b366c106c6930d. 2023-02-12 03:55:07,195 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 4e8254a6d12aded099b366c106c6930d: Waiting for close lock at 1676174107188Running coprocessor pre-close hooks at 1676174107188Disabling compacts and flushes for region at 1676174107188Disabling writes for close at 1676174107188Writing region close event to WAL at 1676174107192 (+4 ms)Running coprocessor post-close hooks at 1676174107195 (+3 ms)Closed at 1676174107195 2023-02-12 03:55:07,197 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(147): Closed 4e8254a6d12aded099b366c106c6930d 2023-02-12 03:55:07,197 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=89 updating hbase:meta row=4e8254a6d12aded099b366c106c6930d, regionState=CLOSED 2023-02-12 03:55:07,197 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1676174084167.4e8254a6d12aded099b366c106c6930d.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1676174107197"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676174107197"}]},"ts":"1676174107197"} 2023-02-12 03:55:07,199 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=93, resume processing ppid=89 2023-02-12 03:55:07,199 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=93, ppid=89, state=SUCCESS; CloseRegionProcedure 4e8254a6d12aded099b366c106c6930d, server=jenkins-hbase20.apache.org,39639,1676173982450 in 192 msec 2023-02-12 03:55:07,201 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=89, resume processing ppid=88 2023-02-12 03:55:07,201 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=89, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=4e8254a6d12aded099b366c106c6930d, UNASSIGN in 198 msec 2023-02-12 03:55:07,201 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676174107201"}]},"ts":"1676174107201"} 2023-02-12 03:55:07,202 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=DISABLED in hbase:meta 2023-02-12 03:55:07,203 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testCompactionWithHFileLink to state=DISABLED 2023-02-12 03:55:07,205 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=88, state=SUCCESS; DisableTableProcedure table=testCompactionWithHFileLink in 210 msec 2023-02-12 03:55:07,300 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(1227): Checking to see if procedure is done pid=88 2023-02-12 03:55:07,301 INFO [Listener at localhost.localdomain/41049] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testCompactionWithHFileLink, procId: 88 completed 2023-02-12 03:55:07,314 INFO [Listener at localhost.localdomain/41049] client.HBaseAdmin(2586): Taking restore-failsafe snapshot: hbase-failsafe-snaptb-1676174093579-1676174107314 2023-02-12 03:55:07,315 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(1580): Client=jenkins//148.251.75.209 snapshot request for:{ ss=hbase-failsafe-snaptb-1676174093579-1676174107314 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-02-12 03:55:07,315 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1676174107315 (current time:1676174107315). 2023-02-12 03:55:07,315 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-12 03:55:07,315 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] zookeeper.ReadOnlyZKClient(139): Connect 0x1d072d7a to 127.0.0.1:59556 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 03:55:07,319 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7429251e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 03:55:07,320 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-12 03:55:07,321 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:53790, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-12 03:55:07,322 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1d072d7a to 127.0.0.1:59556 2023-02-12 03:55:07,322 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 03:55:07,322 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-12 03:55:07,322 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] snapshot.SnapshotManager(659): Table is disabled, running snapshot entirely on master for { ss=hbase-failsafe-snaptb-1676174093579-1676174107314 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-02-12 03:55:07,325 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] procedure2.ProcedureExecutor(1029): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-02-12 03:55:07,326 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-02-12 03:55:07,326 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE; timeout=600000, timestamp=1676174707326 2023-02-12 03:55:07,327 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] snapshot.SnapshotManager(664): Started snapshot: { ss=hbase-failsafe-snaptb-1676174093579-1676174107314 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-02-12 03:55:07,327 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running DISABLED table snapshot hbase-failsafe-snaptb-1676174093579-1676174107314 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink 2023-02-12 03:55:07,327 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=hbase-failsafe-snaptb-1676174093579-1676174107314 table=testCompactionWithHFileLink type=FLUSH ttl=0 }'' to complete. (max 300000 ms per retry) 2023-02-12 03:55:07,327 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-12 03:55:07,428 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-12 03:55:07,430 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1676174093579-1676174107314 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-12 03:55:07,430 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] snapshot.SnapshotManager(404): Snapshoting '{ ss=hbase-failsafe-snaptb-1676174093579-1676174107314 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-02-12 03:55:07,430 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-12 03:55:07,631 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-12 03:55:07,632 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1676174093579-1676174107314 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-12 03:55:07,632 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] snapshot.SnapshotManager(404): Snapshoting '{ ss=hbase-failsafe-snaptb-1676174093579-1676174107314 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-02-12 03:55:07,632 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-02-12 03:55:07,734 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.DisabledTableSnapshotHandler(97): Starting to write region info and WALs for regions for offline snapshot:{ ss=hbase-failsafe-snaptb-1676174093579-1676174107314 table=testCompactionWithHFileLink type=DISABLED ttl=0 } 2023-02-12 03:55:07,736 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-02-12 03:55:07,736 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-02-12 03:55:07,736 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-02-12 03:55:07,736 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-02-12 03:55:07,736 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-02-12 03:55:07,737 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-02-12 03:55:07,736 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-02-12 03:55:07,737 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-02-12 03:55:07,740 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/family1/204e08da11ec480cbc075254d8419faf_SeqId_29_, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/family1/ab81feae660f4af8aa8ed6d44cc28dad] hfiles 2023-02-12 03:55:07,740 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/family1/204e08da11ec480cbc075254d8419faf_SeqId_29_ 2023-02-12 03:55:07,740 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/family1/2b9cfdd2593e401fadc30caee5c7d923_SeqId_29_, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/family1/7730098863a144d3a17241ccf222a945] hfiles 2023-02-12 03:55:07,741 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/family1/ab81feae660f4af8aa8ed6d44cc28dad 2023-02-12 03:55:07,741 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/family1/2b9cfdd2593e401fadc30caee5c7d923_SeqId_29_ 2023-02-12 03:55:07,741 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230212d7dc82dddc7343c0a42a619df22d1725, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230212c6296acd0d7d4d04bcd2989db836a4fb, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202302122191bb4a95864de4adbe0eae1aa2ec13] hfiles 2023-02-12 03:55:07,740 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/family1/4622d7ea8794458eb200e5b2d74762f0_SeqId_29_, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/family1/7f4abed2edde4309b8fcefad8528958d] hfiles 2023-02-12 03:55:07,741 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (1/3): hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230212d7dc82dddc7343c0a42a619df22d1725 2023-02-12 03:55:07,741 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/family1/7730098863a144d3a17241ccf222a945 2023-02-12 03:55:07,741 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (2/3): hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230212c6296acd0d7d4d04bcd2989db836a4fb 2023-02-12 03:55:07,741 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/family1/4622d7ea8794458eb200e5b2d74762f0_SeqId_29_ 2023-02-12 03:55:07,741 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (3/3): hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202302122191bb4a95864de4adbe0eae1aa2ec13 2023-02-12 03:55:07,741 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/family1/7f4abed2edde4309b8fcefad8528958d 2023-02-12 03:55:07,742 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/family2/e6d75c83fc51486ebd93ba76e83caf12] hfiles 2023-02-12 03:55:07,742 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/family2/e6d75c83fc51486ebd93ba76e83caf12 2023-02-12 03:55:07,742 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/family2/be8941937c7447efaf7957668a4fb103] hfiles 2023-02-12 03:55:07,742 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/family2/be8941937c7447efaf7957668a4fb103 2023-02-12 03:55:07,742 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/family2/a09e474efda84c1e8ffb5a29f5530324] hfiles 2023-02-12 03:55:07,743 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/family2/a09e474efda84c1e8ffb5a29f5530324 2023-02-12 03:55:07,747 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202302122d66f473fe004147a0ef1f76a920c9e1, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202302127d6644667bea45bb867daf9b1ac0ecc3, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202302129e8cfbdfc0ec4fd8a9436aaa8c0bca05, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202302129f55f3a10ba94b29972e398fcaff9e90_del, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230212ea5af1d598ed41cf9f7220dba350a175, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202302121782cb197ab641539a6ad7c95e81357b, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023021220a2e9433eba4d98a6904d7ad86e0ae2_del, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202302129836d7cedd0346f0ab8d3b4fc30f7371, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230212cb32f8b6a63641388ce6c4c10f214ad3, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230212f429c7c7e2f04873a4522d785a7fa596, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023021218f5c72f02694ad2965ea5a26f85029b, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023021223f4e32022b3458c99697b28d40de768_del, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230212734a01057dd74d75841e87f3ac454484, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230212b19a5db2fcd54e20b4d9ad64a100884e, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230212f7df8ff2eb5b43de9ff5fa96b9d4804b] hfiles 2023-02-12 03:55:07,747 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (1/15): hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202302122d66f473fe004147a0ef1f76a920c9e1 2023-02-12 03:55:07,747 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (2/15): hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202302127d6644667bea45bb867daf9b1ac0ecc3 2023-02-12 03:55:07,747 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (3/15): hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202302129e8cfbdfc0ec4fd8a9436aaa8c0bca05 2023-02-12 03:55:07,747 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (4/15): hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202302129f55f3a10ba94b29972e398fcaff9e90_del 2023-02-12 03:55:07,747 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (5/15): hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230212ea5af1d598ed41cf9f7220dba350a175 2023-02-12 03:55:07,747 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (6/15): hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202302121782cb197ab641539a6ad7c95e81357b 2023-02-12 03:55:07,747 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (7/15): hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023021220a2e9433eba4d98a6904d7ad86e0ae2_del 2023-02-12 03:55:07,747 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (8/15): hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202302129836d7cedd0346f0ab8d3b4fc30f7371 2023-02-12 03:55:07,747 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (9/15): hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230212cb32f8b6a63641388ce6c4c10f214ad3 2023-02-12 03:55:07,747 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (10/15): hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230212f429c7c7e2f04873a4522d785a7fa596 2023-02-12 03:55:07,747 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (11/15): hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023021218f5c72f02694ad2965ea5a26f85029b 2023-02-12 03:55:07,748 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (12/15): hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023021223f4e32022b3458c99697b28d40de768_del 2023-02-12 03:55:07,748 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (13/15): hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230212734a01057dd74d75841e87f3ac454484 2023-02-12 03:55:07,748 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (14/15): hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230212b19a5db2fcd54e20b4d9ad64a100884e 2023-02-12 03:55:07,748 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (15/15): hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230212f7df8ff2eb5b43de9ff5fa96b9d4804b 2023-02-12 03:55:07,932 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-12 03:55:07,934 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1676174093579-1676174107314 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-12 03:55:07,934 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] snapshot.SnapshotManager(404): Snapshoting '{ ss=hbase-failsafe-snaptb-1676174093579-1676174107314 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-02-12 03:55:07,934 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-02-12 03:55:08,162 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.DisabledTableSnapshotHandler(120): Marking snapshot{ ss=hbase-failsafe-snaptb-1676174093579-1676174107314 table=testCompactionWithHFileLink type=DISABLED ttl=0 } as finished. 2023-02-12 03:55:08,162 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for hbase-failsafe-snaptb-1676174093579-1676174107314 2023-02-12 03:55:08,163 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1676174093579-1676174107314 2023-02-12 03:55:08,434 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-12 03:55:08,435 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1676174093579-1676174107314 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-12 03:55:08,435 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] snapshot.SnapshotManager(404): Snapshoting '{ ss=hbase-failsafe-snaptb-1676174093579-1676174107314 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-02-12 03:55:08,435 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-02-12 03:55:08,594 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1676174093579-1676174107314 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/.hbase-snapshot/hbase-failsafe-snaptb-1676174093579-1676174107314 2023-02-12 03:55:09,436 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-12 03:55:09,438 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1676174093579-1676174107314 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-12 03:55:09,438 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] snapshot.SnapshotManager(404): Snapshoting '{ ss=hbase-failsafe-snaptb-1676174093579-1676174107314 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-02-12 03:55:09,439 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2428): (#6) Sleeping: 2000ms while waiting for snapshot completion. 2023-02-12 03:55:09,465 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot hbase-failsafe-snaptb-1676174093579-1676174107314 of table testCompactionWithHFileLink completed 2023-02-12 03:55:09,465 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1676174093579-1676174107314 2023-02-12 03:55:09,466 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1676174093579-1676174107314 2023-02-12 03:55:09,466 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running DISABLED table snapshot hbase-failsafe-snaptb-1676174093579-1676174107314 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink at 1676174107327Starting to write region info and WALs for regions for offline snapshot:{ ss=hbase-failsafe-snaptb-1676174093579-1676174107314 table=testCompactionWithHFileLink type=DISABLED ttl=0 } at 1676174107734 (+407 ms)Consolidate snapshot: hbase-failsafe-snaptb-1676174093579-1676174107314 at 1676174108162 (+428 ms)Loading Region manifests for hbase-failsafe-snaptb-1676174093579-1676174107314 at 1676174108162Writing data manifest for hbase-failsafe-snaptb-1676174093579-1676174107314 at 1676174108166 (+4 ms)Verifying snapshot: hbase-failsafe-snaptb-1676174093579-1676174107314 at 1676174108578 (+412 ms)Snapshot hbase-failsafe-snaptb-1676174093579-1676174107314 of table testCompactionWithHFileLink completed at 1676174109465 (+887 ms) 2023-02-12 03:55:09,467 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-02-12 03:55:09,469 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE in 2.1430 sec 2023-02-12 03:55:11,439 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-12 03:55:11,441 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1676174093579-1676174107314 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-12 03:55:11,441 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] snapshot.SnapshotManager(401): Snapshot '{ ss=hbase-failsafe-snaptb-1676174093579-1676174107314 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-12 03:55:11,490 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] procedure2.ProcedureExecutor(1029): Stored pid=96, state=RUNNABLE:RESTORE_SNAPSHOT_PRE_OPERATION; RestoreSnapshotProcedure (table=testCompactionWithHFileLink snapshot=name: "snaptb-1676174093579" table: "testCompactionWithHFileLink" creation_time: 1676174093596 type: FLUSH version: 2 ttl: 0 ) 2023-02-12 03:55:11,490 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] snapshot.SnapshotManager(880): Restore snapshot=snaptb-1676174093579 as table=testCompactionWithHFileLink 2023-02-12 03:55:11,493 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(1227): Checking to see if procedure is done pid=96 2023-02-12 03:55:11,500 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000002 2023-02-12 03:55:11,501 DEBUG [PEWorker-2] util.FSTableDescriptors(519): Deleted hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000001 2023-02-12 03:55:11,501 INFO [PEWorker-2] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000002 2023-02-12 03:55:11,502 INFO [PEWorker-2] procedure.RestoreSnapshotProcedure(374): Starting restore snapshot={ ss=snaptb-1676174093579 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-02-12 03:55:11,506 INFO [PEWorker-2] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "snaptb-1676174093579" table: "testCompactionWithHFileLink" creation_time: 1676174093596 type: FLUSH version: 2 ttl: 0 2023-02-12 03:55:11,506 DEBUG [PEWorker-2] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink 2023-02-12 03:55:11,511 DEBUG [PEWorker-2] snapshot.RestoreSnapshotHelper(797): found 3 regions for table=testCompactionWithHFileLink 2023-02-12 03:55:11,514 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230212d7dc82dddc7343c0a42a619df22d1725 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230212d7dc82dddc7343c0a42a619df22d1725 2023-02-12 03:55:11,516 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202302122191bb4a95864de4adbe0eae1aa2ec13 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202302122191bb4a95864de4adbe0eae1aa2ec13 2023-02-12 03:55:11,517 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230212c6296acd0d7d4d04bcd2989db836a4fb to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230212c6296acd0d7d4d04bcd2989db836a4fb 2023-02-12 03:55:11,517 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b20230212216703835d1543e0bf1aa9f72faf4287 of snapshot=snaptb-1676174093579 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-12 03:55:11,520 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b20230212a3a6d6339686408ba5d6e047ec635631 of snapshot=snaptb-1676174093579 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-12 03:55:11,523 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b20230212a401f6430c8c4a8d88a379f214b16ffb of snapshot=snaptb-1676174093579 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-12 03:55:11,525 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b20230212b7f58914f1a44008b811b6dc8d0875e3 of snapshot=snaptb-1676174093579 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-12 03:55:11,528 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c202302123ccb2e9b5c43466f9e396ae6b2e4e7e6 of snapshot=snaptb-1676174093579 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-12 03:55:11,530 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c202302126112c32489b74171a8463897751a6913 of snapshot=snaptb-1676174093579 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-12 03:55:11,532 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c202302128e17b0c2b0934395b74d1c0fa5415109 of snapshot=snaptb-1676174093579 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-12 03:55:11,534 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c20230212d6057bca00184504b708b6acd6d48f2d of snapshot=snaptb-1676174093579 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-12 03:55:11,537 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e2023021240d363ee3ba045559336952277303653 of snapshot=snaptb-1676174093579 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-12 03:55:11,540 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e202302129d5ad3f18fe94f96af9319afb047dc3a of snapshot=snaptb-1676174093579 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-12 03:55:11,542 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e20230212de3ba320365e4c209e5e5905c42d1e7b of snapshot=snaptb-1676174093579 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-12 03:55:11,545 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e20230212e33bb280a79e495589b956efc4e3e56c of snapshot=snaptb-1676174093579 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-12 03:55:11,550 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202302129f55f3a10ba94b29972e398fcaff9e90_del to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202302129f55f3a10ba94b29972e398fcaff9e90_del 2023-02-12 03:55:11,551 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023021220a2e9433eba4d98a6904d7ad86e0ae2_del to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023021220a2e9433eba4d98a6904d7ad86e0ae2_del 2023-02-12 03:55:11,552 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023021223f4e32022b3458c99697b28d40de768_del to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023021223f4e32022b3458c99697b28d40de768_del 2023-02-12 03:55:11,552 INFO [PEWorker-2] snapshot.RestoreSnapshotHelper(223): region to restore: 0e9d0e06e60b6abe7b05797a5112bb5e 2023-02-12 03:55:11,552 INFO [PEWorker-2] snapshot.RestoreSnapshotHelper(223): region to restore: 369851c5c3dd6d38afc3b2a16e1a3ffc 2023-02-12 03:55:11,552 INFO [PEWorker-2] snapshot.RestoreSnapshotHelper(223): region to restore: 4e8254a6d12aded099b366c106c6930d 2023-02-12 03:55:11,554 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/family1/2b9cfdd2593e401fadc30caee5c7d923_SeqId_29_ to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/family1/2b9cfdd2593e401fadc30caee5c7d923_SeqId_29_ 2023-02-12 03:55:11,555 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/family1/ab81feae660f4af8aa8ed6d44cc28dad to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/family1/ab81feae660f4af8aa8ed6d44cc28dad 2023-02-12 03:55:11,555 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/family1/4622d7ea8794458eb200e5b2d74762f0_SeqId_29_ to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/family1/4622d7ea8794458eb200e5b2d74762f0_SeqId_29_ 2023-02-12 03:55:11,556 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/family1/7730098863a144d3a17241ccf222a945 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/family1/7730098863a144d3a17241ccf222a945 2023-02-12 03:55:11,556 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 67634b9f7088459b8c692fbefde445c4 of snapshot=snaptb-1676174093579 to region=4e8254a6d12aded099b366c106c6930d table=testCompactionWithHFileLink 2023-02-12 03:55:11,556 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/family1/204e08da11ec480cbc075254d8419faf_SeqId_29_ to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/family1/204e08da11ec480cbc075254d8419faf_SeqId_29_ 2023-02-12 03:55:11,556 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/family1/7f4abed2edde4309b8fcefad8528958d to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/family1/7f4abed2edde4309b8fcefad8528958d 2023-02-12 03:55:11,556 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 57336479cdcf48c297824f71584356ca of snapshot=snaptb-1676174093579 to region=369851c5c3dd6d38afc3b2a16e1a3ffc table=testCompactionWithHFileLink 2023-02-12 03:55:11,556 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink ca25e354821f41239297823f77effa98 of snapshot=snaptb-1676174093579 to region=0e9d0e06e60b6abe7b05797a5112bb5e table=testCompactionWithHFileLink 2023-02-12 03:55:11,558 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink f16c24a6c05c4ffc99cbbd8f419bdc6b of snapshot=snaptb-1676174093579 to region=4e8254a6d12aded099b366c106c6930d table=testCompactionWithHFileLink 2023-02-12 03:55:11,559 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 28a38cf350244da7830c9753b7964958 of snapshot=snaptb-1676174093579 to region=369851c5c3dd6d38afc3b2a16e1a3ffc table=testCompactionWithHFileLink 2023-02-12 03:55:11,559 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 1680fc2fd19047b9a4d476b5505a9420 of snapshot=snaptb-1676174093579 to region=0e9d0e06e60b6abe7b05797a5112bb5e table=testCompactionWithHFileLink 2023-02-12 03:55:11,562 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 24c9ba5b866a46329c7fb8ab8a046ca8 of snapshot=snaptb-1676174093579 to region=4e8254a6d12aded099b366c106c6930d table=testCompactionWithHFileLink 2023-02-12 03:55:11,562 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 87d4d7959ed5460db9686869a40435c0 of snapshot=snaptb-1676174093579 to region=369851c5c3dd6d38afc3b2a16e1a3ffc table=testCompactionWithHFileLink 2023-02-12 03:55:11,562 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink ad5e5cac5663442fb628697e0ac1cb74 of snapshot=snaptb-1676174093579 to region=0e9d0e06e60b6abe7b05797a5112bb5e table=testCompactionWithHFileLink 2023-02-12 03:55:11,565 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 74306a4c7f9e4c4d90d47fe163c451c2 of snapshot=snaptb-1676174093579 to region=4e8254a6d12aded099b366c106c6930d table=testCompactionWithHFileLink 2023-02-12 03:55:11,565 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink cc7410dc341d435da9efadbba79ec3d5 of snapshot=snaptb-1676174093579 to region=369851c5c3dd6d38afc3b2a16e1a3ffc table=testCompactionWithHFileLink 2023-02-12 03:55:11,565 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 3cd14dd59fa842fba2f6ca863062ef1f of snapshot=snaptb-1676174093579 to region=0e9d0e06e60b6abe7b05797a5112bb5e table=testCompactionWithHFileLink 2023-02-12 03:55:11,572 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/family2/be8941937c7447efaf7957668a4fb103 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/family2/be8941937c7447efaf7957668a4fb103 2023-02-12 03:55:11,572 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 9094c6fd8f824ee288f6545ee8d61038 of snapshot=snaptb-1676174093579 to region=4e8254a6d12aded099b366c106c6930d table=testCompactionWithHFileLink 2023-02-12 03:55:11,572 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/family2/a09e474efda84c1e8ffb5a29f5530324 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/family2/a09e474efda84c1e8ffb5a29f5530324 2023-02-12 03:55:11,572 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/family2/e6d75c83fc51486ebd93ba76e83caf12 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/family2/e6d75c83fc51486ebd93ba76e83caf12 2023-02-12 03:55:11,572 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink dd64bba239ac4a7491ca0594815ff9af of snapshot=snaptb-1676174093579 to region=0e9d0e06e60b6abe7b05797a5112bb5e table=testCompactionWithHFileLink 2023-02-12 03:55:11,572 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink fef2cc5193ee4c29bf399d13cb8afa3b of snapshot=snaptb-1676174093579 to region=369851c5c3dd6d38afc3b2a16e1a3ffc table=testCompactionWithHFileLink 2023-02-12 03:55:11,575 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 82632c718e894427ab9e68941a927668 of snapshot=snaptb-1676174093579 to region=4e8254a6d12aded099b366c106c6930d table=testCompactionWithHFileLink 2023-02-12 03:55:11,575 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink e45c7d1c8c914c029f7acb4750386b15 of snapshot=snaptb-1676174093579 to region=369851c5c3dd6d38afc3b2a16e1a3ffc table=testCompactionWithHFileLink 2023-02-12 03:55:11,575 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 109b596bd4c145e380fc107ade6f1be3 of snapshot=snaptb-1676174093579 to region=0e9d0e06e60b6abe7b05797a5112bb5e table=testCompactionWithHFileLink 2023-02-12 03:55:11,577 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d98fbbdcc7af49b48050c5145edd38da of snapshot=snaptb-1676174093579 to region=4e8254a6d12aded099b366c106c6930d table=testCompactionWithHFileLink 2023-02-12 03:55:11,577 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 0ee9478488594ba3b7336e26366747b1 of snapshot=snaptb-1676174093579 to region=369851c5c3dd6d38afc3b2a16e1a3ffc table=testCompactionWithHFileLink 2023-02-12 03:55:11,577 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink bd136b408a804ed88601e3708f60c2a2 of snapshot=snaptb-1676174093579 to region=0e9d0e06e60b6abe7b05797a5112bb5e table=testCompactionWithHFileLink 2023-02-12 03:55:11,579 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 54b7be21dbb245e787729ac2c1f02542 of snapshot=snaptb-1676174093579 to region=4e8254a6d12aded099b366c106c6930d table=testCompactionWithHFileLink 2023-02-12 03:55:11,579 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 46d19779813b4d9e825a09db392f3515 of snapshot=snaptb-1676174093579 to region=369851c5c3dd6d38afc3b2a16e1a3ffc table=testCompactionWithHFileLink 2023-02-12 03:55:11,580 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink cf35ea8d9268481bbf9aeec68aa1adb6 of snapshot=snaptb-1676174093579 to region=0e9d0e06e60b6abe7b05797a5112bb5e table=testCompactionWithHFileLink 2023-02-12 03:55:11,582 INFO [PEWorker-2] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "snaptb-1676174093579" table: "testCompactionWithHFileLink" creation_time: 1676174093596 type: FLUSH version: 2 ttl: 0 2023-02-12 03:55:11,583 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,1,1676174084167.0e9d0e06e60b6abe7b05797a5112bb5e.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676174111583"}]},"ts":"9223372036854775807"} 2023-02-12 03:55:11,583 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,2,1676174084167.369851c5c3dd6d38afc3b2a16e1a3ffc.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676174111583"}]},"ts":"9223372036854775807"} 2023-02-12 03:55:11,583 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,,1676174084167.4e8254a6d12aded099b366c106c6930d.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1676174111583"}]},"ts":"9223372036854775807"} 2023-02-12 03:55:11,585 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 3 regions from META 2023-02-12 03:55:11,585 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 0e9d0e06e60b6abe7b05797a5112bb5e, NAME => 'testCompactionWithHFileLink,1,1676174084167.0e9d0e06e60b6abe7b05797a5112bb5e.', STARTKEY => '1', ENDKEY => '2'}, {ENCODED => 369851c5c3dd6d38afc3b2a16e1a3ffc, NAME => 'testCompactionWithHFileLink,2,1676174084167.369851c5c3dd6d38afc3b2a16e1a3ffc.', STARTKEY => '2', ENDKEY => ''}, {ENCODED => 4e8254a6d12aded099b366c106c6930d, NAME => 'testCompactionWithHFileLink,,1676174084167.4e8254a6d12aded099b366c106c6930d.', STARTKEY => '', ENDKEY => '1'}] 2023-02-12 03:55:11,585 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1676174084167.0e9d0e06e60b6abe7b05797a5112bb5e.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1676174111584"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676174111584"}]},"ts":"1676174111584"} 2023-02-12 03:55:11,585 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1676174084167.369851c5c3dd6d38afc3b2a16e1a3ffc.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1676174111584"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676174111584"}]},"ts":"1676174111584"} 2023-02-12 03:55:11,585 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1676174084167.4e8254a6d12aded099b366c106c6930d.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1676174111584"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676174111584"}]},"ts":"1676174111584"} 2023-02-12 03:55:11,586 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-02-12 03:55:11,586 INFO [PEWorker-2] hbase.MetaTableAccessor(1810): Overwritten 3 regions to Meta 2023-02-12 03:55:11,586 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1811): Overwritten regions: [{ENCODED => 0e9d0e06e60b6abe7b05797a5112bb5e, NAME => 'testCompactionWithHFileLink,1,1676174084167.0e9d0e06e60b6abe7b05797a5112bb5e.', STARTKEY => '1', ENDKEY => '2'}, {ENCODED => 369851c5c3dd6d38afc3b2a16e1a3ffc, NAME => 'testCompactionWithHFileLink,2,1676174084167.369851c5c3dd6d38afc3b2a16e1a3ffc.', STARTKEY => '2', ENDKEY => ''}, {ENCODED => 4e8254a6d12aded099b366c106c6930d, NAME => 'testCompactionWithHFileLink,,1676174084167.4e8254a6d12aded099b366c106c6930d.', STARTKEY => '', ENDKEY => '1'}] 2023-02-12 03:55:11,587 INFO [PEWorker-2] procedure.RestoreSnapshotProcedure(447): Restore snapshot={ ss=snaptb-1676174093579 table=testCompactionWithHFileLink type=FLUSH ttl=0 } on table=testCompactionWithHFileLink completed! 2023-02-12 03:55:11,589 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=96, state=SUCCESS; RestoreSnapshotProcedure (table=testCompactionWithHFileLink snapshot=name: "snaptb-1676174093579" table: "testCompactionWithHFileLink" creation_time: 1676174093596 type: FLUSH version: 2 ttl: 0 ) in 106 msec 2023-02-12 03:55:11,594 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(1227): Checking to see if procedure is done pid=96 2023-02-12 03:55:11,594 INFO [Listener at localhost.localdomain/41049] client.HBaseAdmin$TableFuture(3541): Operation: MODIFY, Table Name: default:testCompactionWithHFileLink, procId: 96 completed 2023-02-12 03:55:11,595 INFO [Listener at localhost.localdomain/41049] client.HBaseAdmin(2618): Deleting restore-failsafe snapshot: hbase-failsafe-snaptb-1676174093579-1676174107314 2023-02-12 03:55:11,598 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(748): Client=jenkins//148.251.75.209 delete name: "hbase-failsafe-snaptb-1676174093579-1676174107314" 2023-02-12 03:55:11,600 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] snapshot.SnapshotManager(333): Deleting snapshot: hbase-failsafe-snaptb-1676174093579-1676174107314 2023-02-12 03:55:11,602 INFO [Listener at localhost.localdomain/41049] client.HBaseAdmin$14(830): Started enable of testCompactionWithHFileLink 2023-02-12 03:55:11,605 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.HMaster$10(2372): Client=jenkins//148.251.75.209 enable testCompactionWithHFileLink 2023-02-12 03:55:11,609 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] procedure2.ProcedureExecutor(1029): Stored pid=97, state=RUNNABLE:ENABLE_TABLE_PREPARE; EnableTableProcedure table=testCompactionWithHFileLink 2023-02-12 03:55:11,612 INFO [PEWorker-1] procedure.EnableTableProcedure(296): Attempting to enable the table testCompactionWithHFileLink 2023-02-12 03:55:11,612 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676174111612"}]},"ts":"1676174111612"} 2023-02-12 03:55:11,612 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(1227): Checking to see if procedure is done pid=97 2023-02-12 03:55:11,613 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLING in hbase:meta 2023-02-12 03:55:11,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(1227): Checking to see if procedure is done pid=97 2023-02-12 03:55:11,785 DEBUG [PEWorker-1] procedure.EnableTableProcedure(107): No change in number of region replicas (configuredReplicaCount=1); assigning. 2023-02-12 03:55:11,785 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=4e8254a6d12aded099b366c106c6930d, ASSIGN}, {pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=0e9d0e06e60b6abe7b05797a5112bb5e, ASSIGN}, {pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=369851c5c3dd6d38afc3b2a16e1a3ffc, ASSIGN}] 2023-02-12 03:55:11,790 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=369851c5c3dd6d38afc3b2a16e1a3ffc, ASSIGN 2023-02-12 03:55:11,790 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=0e9d0e06e60b6abe7b05797a5112bb5e, ASSIGN 2023-02-12 03:55:11,790 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=4e8254a6d12aded099b366c106c6930d, ASSIGN 2023-02-12 03:55:11,792 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=369851c5c3dd6d38afc3b2a16e1a3ffc, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-02-12 03:55:11,792 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=4e8254a6d12aded099b366c106c6930d, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-02-12 03:55:11,792 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=0e9d0e06e60b6abe7b05797a5112bb5e, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-02-12 03:55:11,915 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(1227): Checking to see if procedure is done pid=97 2023-02-12 03:55:11,944 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=99 updating hbase:meta row=0e9d0e06e60b6abe7b05797a5112bb5e, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:11,944 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=98 updating hbase:meta row=4e8254a6d12aded099b366c106c6930d, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:11,944 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1676174084167.0e9d0e06e60b6abe7b05797a5112bb5e.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1676174111944"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676174111944"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676174111944"}]},"ts":"1676174111944"} 2023-02-12 03:55:11,944 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1676174084167.4e8254a6d12aded099b366c106c6930d.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1676174111944"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676174111944"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676174111944"}]},"ts":"1676174111944"} 2023-02-12 03:55:11,944 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=369851c5c3dd6d38afc3b2a16e1a3ffc, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:11,945 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1676174084167.369851c5c3dd6d38afc3b2a16e1a3ffc.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1676174111944"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676174111944"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676174111944"}]},"ts":"1676174111944"} 2023-02-12 03:55:11,946 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=101, ppid=99, state=RUNNABLE; OpenRegionProcedure 0e9d0e06e60b6abe7b05797a5112bb5e, server=jenkins-hbase20.apache.org,39639,1676173982450}] 2023-02-12 03:55:11,947 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=102, ppid=98, state=RUNNABLE; OpenRegionProcedure 4e8254a6d12aded099b366c106c6930d, server=jenkins-hbase20.apache.org,39639,1676173982450}] 2023-02-12 03:55:11,947 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=103, ppid=100, state=RUNNABLE; OpenRegionProcedure 369851c5c3dd6d38afc3b2a16e1a3ffc, server=jenkins-hbase20.apache.org,39639,1676173982450}] 2023-02-12 03:55:12,106 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,,1676174084167.4e8254a6d12aded099b366c106c6930d. 2023-02-12 03:55:12,106 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 4e8254a6d12aded099b366c106c6930d, NAME => 'testCompactionWithHFileLink,,1676174084167.4e8254a6d12aded099b366c106c6930d.', STARTKEY => '', ENDKEY => '1'} 2023-02-12 03:55:12,107 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 4e8254a6d12aded099b366c106c6930d 2023-02-12 03:55:12,107 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testCompactionWithHFileLink,,1676174084167.4e8254a6d12aded099b366c106c6930d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:55:12,107 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 4e8254a6d12aded099b366c106c6930d 2023-02-12 03:55:12,107 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 4e8254a6d12aded099b366c106c6930d 2023-02-12 03:55:12,109 INFO [StoreOpener-4e8254a6d12aded099b366c106c6930d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 4e8254a6d12aded099b366c106c6930d 2023-02-12 03:55:12,111 DEBUG [StoreOpener-4e8254a6d12aded099b366c106c6930d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/family1 2023-02-12 03:55:12,111 DEBUG [StoreOpener-4e8254a6d12aded099b366c106c6930d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/family1 2023-02-12 03:55:12,112 INFO [StoreOpener-4e8254a6d12aded099b366c106c6930d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4e8254a6d12aded099b366c106c6930d columnFamilyName family1 2023-02-12 03:55:12,129 DEBUG [StoreOpener-4e8254a6d12aded099b366c106c6930d-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/family1/testCompactionWithHFileLink=4e8254a6d12aded099b366c106c6930d-24c9ba5b866a46329c7fb8ab8a046ca8 2023-02-12 03:55:12,135 DEBUG [StoreOpener-4e8254a6d12aded099b366c106c6930d-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/family1/testCompactionWithHFileLink=4e8254a6d12aded099b366c106c6930d-67634b9f7088459b8c692fbefde445c4 2023-02-12 03:55:12,141 DEBUG [StoreOpener-4e8254a6d12aded099b366c106c6930d-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/family1/testCompactionWithHFileLink=4e8254a6d12aded099b366c106c6930d-74306a4c7f9e4c4d90d47fe163c451c2 2023-02-12 03:55:12,149 DEBUG [StoreOpener-4e8254a6d12aded099b366c106c6930d-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/family1/testCompactionWithHFileLink=4e8254a6d12aded099b366c106c6930d-f16c24a6c05c4ffc99cbbd8f419bdc6b 2023-02-12 03:55:12,149 INFO [StoreOpener-4e8254a6d12aded099b366c106c6930d-1] regionserver.HStore(310): Store=4e8254a6d12aded099b366c106c6930d/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:55:12,149 INFO [StoreOpener-4e8254a6d12aded099b366c106c6930d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 4e8254a6d12aded099b366c106c6930d 2023-02-12 03:55:12,151 DEBUG [StoreOpener-4e8254a6d12aded099b366c106c6930d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/family2 2023-02-12 03:55:12,151 DEBUG [StoreOpener-4e8254a6d12aded099b366c106c6930d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/family2 2023-02-12 03:55:12,151 INFO [StoreOpener-4e8254a6d12aded099b366c106c6930d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4e8254a6d12aded099b366c106c6930d columnFamilyName family2 2023-02-12 03:55:12,160 DEBUG [StoreOpener-4e8254a6d12aded099b366c106c6930d-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/family2/testCompactionWithHFileLink=4e8254a6d12aded099b366c106c6930d-54b7be21dbb245e787729ac2c1f02542 2023-02-12 03:55:12,166 DEBUG [StoreOpener-4e8254a6d12aded099b366c106c6930d-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/family2/testCompactionWithHFileLink=4e8254a6d12aded099b366c106c6930d-82632c718e894427ab9e68941a927668 2023-02-12 03:55:12,171 DEBUG [StoreOpener-4e8254a6d12aded099b366c106c6930d-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/family2/testCompactionWithHFileLink=4e8254a6d12aded099b366c106c6930d-9094c6fd8f824ee288f6545ee8d61038 2023-02-12 03:55:12,178 DEBUG [StoreOpener-4e8254a6d12aded099b366c106c6930d-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/family2/testCompactionWithHFileLink=4e8254a6d12aded099b366c106c6930d-d98fbbdcc7af49b48050c5145edd38da 2023-02-12 03:55:12,178 INFO [StoreOpener-4e8254a6d12aded099b366c106c6930d-1] regionserver.HStore(310): Store=4e8254a6d12aded099b366c106c6930d/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:55:12,180 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d 2023-02-12 03:55:12,180 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d 2023-02-12 03:55:12,182 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 03:55:12,183 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 4e8254a6d12aded099b366c106c6930d 2023-02-12 03:55:12,183 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 4e8254a6d12aded099b366c106c6930d; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69231784, jitterRate=0.031633973121643066}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 03:55:12,184 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 4e8254a6d12aded099b366c106c6930d: Running coprocessor pre-open hook at 1676174112107Writing region info on filesystem at 1676174112107Initializing all the Stores at 1676174112109 (+2 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676174112109Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676174112109Cleaning up temporary data from old regions at 1676174112181 (+72 ms)Cleaning up detritus from prior splits at 1676174112181Running coprocessor post-open hooks at 1676174112184 (+3 ms)Region opened successfully at 1676174112184 2023-02-12 03:55:12,184 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,,1676174084167.4e8254a6d12aded099b366c106c6930d., pid=102, masterSystemTime=1676174112098 2023-02-12 03:55:12,184 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-12 03:55:12,185 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-02-12 03:55:12,185 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-02-12 03:55:12,185 DEBUG [RS:0;jenkins-hbase20:39639-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-02-12 03:55:12,186 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,,1676174084167.4e8254a6d12aded099b366c106c6930d. 2023-02-12 03:55:12,186 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,,1676174084167.4e8254a6d12aded099b366c106c6930d. 2023-02-12 03:55:12,186 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,2,1676174084167.369851c5c3dd6d38afc3b2a16e1a3ffc. 2023-02-12 03:55:12,187 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 369851c5c3dd6d38afc3b2a16e1a3ffc, NAME => 'testCompactionWithHFileLink,2,1676174084167.369851c5c3dd6d38afc3b2a16e1a3ffc.', STARTKEY => '2', ENDKEY => ''} 2023-02-12 03:55:12,187 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=98 updating hbase:meta row=4e8254a6d12aded099b366c106c6930d, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:12,187 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,,1676174084167.4e8254a6d12aded099b366c106c6930d.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1676174112187"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676174112187"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676174112187"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676174112187"}]},"ts":"1676174112187"} 2023-02-12 03:55:12,187 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 369851c5c3dd6d38afc3b2a16e1a3ffc 2023-02-12 03:55:12,187 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testCompactionWithHFileLink,2,1676174084167.369851c5c3dd6d38afc3b2a16e1a3ffc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:55:12,187 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 369851c5c3dd6d38afc3b2a16e1a3ffc 2023-02-12 03:55:12,187 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 369851c5c3dd6d38afc3b2a16e1a3ffc 2023-02-12 03:55:12,188 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 22152 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-02-12 03:55:12,188 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] regionserver.HStore(1912): 4e8254a6d12aded099b366c106c6930d/family1 is initiating minor compaction (all files) 2023-02-12 03:55:12,188 INFO [RS:0;jenkins-hbase20:39639-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 4e8254a6d12aded099b366c106c6930d/family1 in testCompactionWithHFileLink,,1676174084167.4e8254a6d12aded099b366c106c6930d. 2023-02-12 03:55:12,188 INFO [RS:0;jenkins-hbase20:39639-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/family1/testCompactionWithHFileLink=4e8254a6d12aded099b366c106c6930d-67634b9f7088459b8c692fbefde445c4, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/family1/testCompactionWithHFileLink=4e8254a6d12aded099b366c106c6930d-f16c24a6c05c4ffc99cbbd8f419bdc6b, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/family1/testCompactionWithHFileLink=4e8254a6d12aded099b366c106c6930d-24c9ba5b866a46329c7fb8ab8a046ca8, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/family1/testCompactionWithHFileLink=4e8254a6d12aded099b366c106c6930d-74306a4c7f9e4c4d90d47fe163c451c2] into tmpdir=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/.tmp, totalSize=21.6 K 2023-02-12 03:55:12,188 DEBUG [RS:0;jenkins-hbase20:39639-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-02-12 03:55:12,189 DEBUG [RS:0;jenkins-hbase20:39639-longCompactions-0] regionserver.HStore(1912): 4e8254a6d12aded099b366c106c6930d/family2 is initiating minor compaction (all files) 2023-02-12 03:55:12,189 INFO [RS:0;jenkins-hbase20:39639-longCompactions-0] regionserver.HRegion(2258): Starting compaction of 4e8254a6d12aded099b366c106c6930d/family2 in testCompactionWithHFileLink,,1676174084167.4e8254a6d12aded099b366c106c6930d. 2023-02-12 03:55:12,189 INFO [RS:0;jenkins-hbase20:39639-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/family2/testCompactionWithHFileLink=4e8254a6d12aded099b366c106c6930d-9094c6fd8f824ee288f6545ee8d61038, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/family2/testCompactionWithHFileLink=4e8254a6d12aded099b366c106c6930d-82632c718e894427ab9e68941a927668, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/family2/testCompactionWithHFileLink=4e8254a6d12aded099b366c106c6930d-d98fbbdcc7af49b48050c5145edd38da, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/family2/testCompactionWithHFileLink=4e8254a6d12aded099b366c106c6930d-54b7be21dbb245e787729ac2c1f02542] into tmpdir=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/.tmp, totalSize=20.4 K 2023-02-12 03:55:12,189 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=4e8254a6d12aded099b366c106c6930d-67634b9f7088459b8c692fbefde445c4, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676174086289 2023-02-12 03:55:12,189 INFO [StoreOpener-369851c5c3dd6d38afc3b2a16e1a3ffc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 369851c5c3dd6d38afc3b2a16e1a3ffc 2023-02-12 03:55:12,190 DEBUG [RS:0;jenkins-hbase20:39639-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=4e8254a6d12aded099b366c106c6930d-9094c6fd8f824ee288f6545ee8d61038, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676174086289 2023-02-12 03:55:12,190 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=4e8254a6d12aded099b366c106c6930d-f16c24a6c05c4ffc99cbbd8f419bdc6b, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676174088114 2023-02-12 03:55:12,190 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=102, resume processing ppid=98 2023-02-12 03:55:12,190 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=102, ppid=98, state=SUCCESS; OpenRegionProcedure 4e8254a6d12aded099b366c106c6930d, server=jenkins-hbase20.apache.org,39639,1676173982450 in 241 msec 2023-02-12 03:55:12,191 DEBUG [StoreOpener-369851c5c3dd6d38afc3b2a16e1a3ffc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/family1 2023-02-12 03:55:12,191 DEBUG [StoreOpener-369851c5c3dd6d38afc3b2a16e1a3ffc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/family1 2023-02-12 03:55:12,191 INFO [StoreOpener-369851c5c3dd6d38afc3b2a16e1a3ffc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 369851c5c3dd6d38afc3b2a16e1a3ffc columnFamilyName family1 2023-02-12 03:55:12,191 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=4e8254a6d12aded099b366c106c6930d-24c9ba5b866a46329c7fb8ab8a046ca8, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676174089931 2023-02-12 03:55:12,191 DEBUG [RS:0;jenkins-hbase20:39639-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=4e8254a6d12aded099b366c106c6930d-82632c718e894427ab9e68941a927668, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676174088114 2023-02-12 03:55:12,192 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=98, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=4e8254a6d12aded099b366c106c6930d, ASSIGN in 405 msec 2023-02-12 03:55:12,192 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=4e8254a6d12aded099b366c106c6930d-74306a4c7f9e4c4d90d47fe163c451c2, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676174091751 2023-02-12 03:55:12,192 DEBUG [RS:0;jenkins-hbase20:39639-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=4e8254a6d12aded099b366c106c6930d-d98fbbdcc7af49b48050c5145edd38da, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676174089931 2023-02-12 03:55:12,194 DEBUG [RS:0;jenkins-hbase20:39639-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=4e8254a6d12aded099b366c106c6930d-54b7be21dbb245e787729ac2c1f02542, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676174091751 2023-02-12 03:55:12,217 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(1227): Checking to see if procedure is done pid=97 2023-02-12 03:55:12,218 DEBUG [StoreOpener-369851c5c3dd6d38afc3b2a16e1a3ffc-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/family1/testCompactionWithHFileLink=369851c5c3dd6d38afc3b2a16e1a3ffc-28a38cf350244da7830c9753b7964958 2023-02-12 03:55:12,247 DEBUG [StoreOpener-369851c5c3dd6d38afc3b2a16e1a3ffc-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/family1/testCompactionWithHFileLink=369851c5c3dd6d38afc3b2a16e1a3ffc-57336479cdcf48c297824f71584356ca 2023-02-12 03:55:12,267 INFO [RS:0;jenkins-hbase20:39639-longCompactions-0] throttle.PressureAwareThroughputController(145): 4e8254a6d12aded099b366c106c6930d#family2#compaction#114 average throughput is 0.12 MB/second, slept 0 time(s) and total slept time is 0 ms. 1 active operations remaining, total limit is 57.69 MB/second 2023-02-12 03:55:12,267 INFO [RS:0;jenkins-hbase20:39639-shortCompactions-0] throttle.PressureAwareThroughputController(145): 4e8254a6d12aded099b366c106c6930d#family1#compaction#115 average throughput is 0.21 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 57.69 MB/second 2023-02-12 03:55:12,268 DEBUG [StoreOpener-369851c5c3dd6d38afc3b2a16e1a3ffc-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/family1/testCompactionWithHFileLink=369851c5c3dd6d38afc3b2a16e1a3ffc-87d4d7959ed5460db9686869a40435c0 2023-02-12 03:55:12,282 DEBUG [StoreOpener-369851c5c3dd6d38afc3b2a16e1a3ffc-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/family1/testCompactionWithHFileLink=369851c5c3dd6d38afc3b2a16e1a3ffc-cc7410dc341d435da9efadbba79ec3d5 2023-02-12 03:55:12,282 INFO [StoreOpener-369851c5c3dd6d38afc3b2a16e1a3ffc-1] regionserver.HStore(310): Store=369851c5c3dd6d38afc3b2a16e1a3ffc/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:55:12,282 INFO [StoreOpener-369851c5c3dd6d38afc3b2a16e1a3ffc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 369851c5c3dd6d38afc3b2a16e1a3ffc 2023-02-12 03:55:12,283 DEBUG [StoreOpener-369851c5c3dd6d38afc3b2a16e1a3ffc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/family2 2023-02-12 03:55:12,283 DEBUG [StoreOpener-369851c5c3dd6d38afc3b2a16e1a3ffc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/family2 2023-02-12 03:55:12,284 INFO [StoreOpener-369851c5c3dd6d38afc3b2a16e1a3ffc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 369851c5c3dd6d38afc3b2a16e1a3ffc columnFamilyName family2 2023-02-12 03:55:12,293 DEBUG [StoreOpener-369851c5c3dd6d38afc3b2a16e1a3ffc-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/family2/testCompactionWithHFileLink=369851c5c3dd6d38afc3b2a16e1a3ffc-0ee9478488594ba3b7336e26366747b1 2023-02-12 03:55:12,299 DEBUG [StoreOpener-369851c5c3dd6d38afc3b2a16e1a3ffc-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/family2/testCompactionWithHFileLink=369851c5c3dd6d38afc3b2a16e1a3ffc-46d19779813b4d9e825a09db392f3515 2023-02-12 03:55:12,305 DEBUG [StoreOpener-369851c5c3dd6d38afc3b2a16e1a3ffc-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/family2/testCompactionWithHFileLink=369851c5c3dd6d38afc3b2a16e1a3ffc-e45c7d1c8c914c029f7acb4750386b15 2023-02-12 03:55:12,310 DEBUG [StoreOpener-369851c5c3dd6d38afc3b2a16e1a3ffc-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/family2/testCompactionWithHFileLink=369851c5c3dd6d38afc3b2a16e1a3ffc-fef2cc5193ee4c29bf399d13cb8afa3b 2023-02-12 03:55:12,310 INFO [StoreOpener-369851c5c3dd6d38afc3b2a16e1a3ffc-1] regionserver.HStore(310): Store=369851c5c3dd6d38afc3b2a16e1a3ffc/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:55:12,311 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc 2023-02-12 03:55:12,312 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc 2023-02-12 03:55:12,314 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 03:55:12,315 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 369851c5c3dd6d38afc3b2a16e1a3ffc 2023-02-12 03:55:12,315 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 369851c5c3dd6d38afc3b2a16e1a3ffc; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70443349, jitterRate=0.0496876984834671}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 03:55:12,315 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 369851c5c3dd6d38afc3b2a16e1a3ffc: Running coprocessor pre-open hook at 1676174112187Writing region info on filesystem at 1676174112187Initializing all the Stores at 1676174112189 (+2 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676174112189Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676174112189Cleaning up temporary data from old regions at 1676174112313 (+124 ms)Cleaning up detritus from prior splits at 1676174112313Running coprocessor post-open hooks at 1676174112315 (+2 ms)Region opened successfully at 1676174112315 2023-02-12 03:55:12,316 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,2,1676174084167.369851c5c3dd6d38afc3b2a16e1a3ffc., pid=103, masterSystemTime=1676174112098 2023-02-12 03:55:12,316 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-02-12 03:55:12,316 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=2), splitQueue=0 2023-02-12 03:55:12,317 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,2,1676174084167.369851c5c3dd6d38afc3b2a16e1a3ffc. 2023-02-12 03:55:12,317 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,2,1676174084167.369851c5c3dd6d38afc3b2a16e1a3ffc. 2023-02-12 03:55:12,317 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,1,1676174084167.0e9d0e06e60b6abe7b05797a5112bb5e. 2023-02-12 03:55:12,317 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 0e9d0e06e60b6abe7b05797a5112bb5e, NAME => 'testCompactionWithHFileLink,1,1676174084167.0e9d0e06e60b6abe7b05797a5112bb5e.', STARTKEY => '1', ENDKEY => '2'} 2023-02-12 03:55:12,317 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=369851c5c3dd6d38afc3b2a16e1a3ffc, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:12,318 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 0e9d0e06e60b6abe7b05797a5112bb5e 2023-02-12 03:55:12,318 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,2,1676174084167.369851c5c3dd6d38afc3b2a16e1a3ffc.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1676174112317"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676174112317"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676174112317"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676174112317"}]},"ts":"1676174112317"} 2023-02-12 03:55:12,318 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testCompactionWithHFileLink,1,1676174084167.0e9d0e06e60b6abe7b05797a5112bb5e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:55:12,318 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 0e9d0e06e60b6abe7b05797a5112bb5e 2023-02-12 03:55:12,318 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 0e9d0e06e60b6abe7b05797a5112bb5e 2023-02-12 03:55:12,319 INFO [StoreOpener-0e9d0e06e60b6abe7b05797a5112bb5e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 0e9d0e06e60b6abe7b05797a5112bb5e 2023-02-12 03:55:12,320 DEBUG [StoreOpener-0e9d0e06e60b6abe7b05797a5112bb5e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/family1 2023-02-12 03:55:12,320 DEBUG [StoreOpener-0e9d0e06e60b6abe7b05797a5112bb5e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/family1 2023-02-12 03:55:12,320 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=103, resume processing ppid=100 2023-02-12 03:55:12,320 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=103, ppid=100, state=SUCCESS; OpenRegionProcedure 369851c5c3dd6d38afc3b2a16e1a3ffc, server=jenkins-hbase20.apache.org,39639,1676173982450 in 372 msec 2023-02-12 03:55:12,320 INFO [StoreOpener-0e9d0e06e60b6abe7b05797a5112bb5e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0e9d0e06e60b6abe7b05797a5112bb5e columnFamilyName family1 2023-02-12 03:55:12,321 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=100, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=369851c5c3dd6d38afc3b2a16e1a3ffc, ASSIGN in 535 msec 2023-02-12 03:55:12,327 DEBUG [StoreOpener-0e9d0e06e60b6abe7b05797a5112bb5e-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/family1/testCompactionWithHFileLink=0e9d0e06e60b6abe7b05797a5112bb5e-1680fc2fd19047b9a4d476b5505a9420 2023-02-12 03:55:12,335 DEBUG [StoreOpener-0e9d0e06e60b6abe7b05797a5112bb5e-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/family1/testCompactionWithHFileLink=0e9d0e06e60b6abe7b05797a5112bb5e-3cd14dd59fa842fba2f6ca863062ef1f 2023-02-12 03:55:12,342 DEBUG [StoreOpener-0e9d0e06e60b6abe7b05797a5112bb5e-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/family1/testCompactionWithHFileLink=0e9d0e06e60b6abe7b05797a5112bb5e-ad5e5cac5663442fb628697e0ac1cb74 2023-02-12 03:55:12,349 DEBUG [StoreOpener-0e9d0e06e60b6abe7b05797a5112bb5e-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/family1/testCompactionWithHFileLink=0e9d0e06e60b6abe7b05797a5112bb5e-ca25e354821f41239297823f77effa98 2023-02-12 03:55:12,349 INFO [StoreOpener-0e9d0e06e60b6abe7b05797a5112bb5e-1] regionserver.HStore(310): Store=0e9d0e06e60b6abe7b05797a5112bb5e/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:55:12,350 INFO [StoreOpener-0e9d0e06e60b6abe7b05797a5112bb5e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 0e9d0e06e60b6abe7b05797a5112bb5e 2023-02-12 03:55:12,351 DEBUG [StoreOpener-0e9d0e06e60b6abe7b05797a5112bb5e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/family2 2023-02-12 03:55:12,351 DEBUG [StoreOpener-0e9d0e06e60b6abe7b05797a5112bb5e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/family2 2023-02-12 03:55:12,351 INFO [StoreOpener-0e9d0e06e60b6abe7b05797a5112bb5e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0e9d0e06e60b6abe7b05797a5112bb5e columnFamilyName family2 2023-02-12 03:55:12,362 DEBUG [StoreOpener-0e9d0e06e60b6abe7b05797a5112bb5e-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/family2/testCompactionWithHFileLink=0e9d0e06e60b6abe7b05797a5112bb5e-109b596bd4c145e380fc107ade6f1be3 2023-02-12 03:55:12,373 DEBUG [StoreOpener-0e9d0e06e60b6abe7b05797a5112bb5e-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/family2/testCompactionWithHFileLink=0e9d0e06e60b6abe7b05797a5112bb5e-bd136b408a804ed88601e3708f60c2a2 2023-02-12 03:55:12,381 DEBUG [StoreOpener-0e9d0e06e60b6abe7b05797a5112bb5e-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/family2/testCompactionWithHFileLink=0e9d0e06e60b6abe7b05797a5112bb5e-cf35ea8d9268481bbf9aeec68aa1adb6 2023-02-12 03:55:12,388 DEBUG [StoreOpener-0e9d0e06e60b6abe7b05797a5112bb5e-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/family2/testCompactionWithHFileLink=0e9d0e06e60b6abe7b05797a5112bb5e-dd64bba239ac4a7491ca0594815ff9af 2023-02-12 03:55:12,388 INFO [StoreOpener-0e9d0e06e60b6abe7b05797a5112bb5e-1] regionserver.HStore(310): Store=0e9d0e06e60b6abe7b05797a5112bb5e/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:55:12,389 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e 2023-02-12 03:55:12,390 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e 2023-02-12 03:55:12,392 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 03:55:12,393 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 0e9d0e06e60b6abe7b05797a5112bb5e 2023-02-12 03:55:12,393 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 0e9d0e06e60b6abe7b05797a5112bb5e; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74378184, jitterRate=0.10832130908966064}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 03:55:12,394 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 0e9d0e06e60b6abe7b05797a5112bb5e: Running coprocessor pre-open hook at 1676174112318Writing region info on filesystem at 1676174112318Initializing all the Stores at 1676174112318Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676174112319 (+1 ms)Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676174112319Cleaning up temporary data from old regions at 1676174112390 (+71 ms)Cleaning up detritus from prior splits at 1676174112391 (+1 ms)Running coprocessor post-open hooks at 1676174112394 (+3 ms)Region opened successfully at 1676174112394 2023-02-12 03:55:12,394 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,1,1676174084167.0e9d0e06e60b6abe7b05797a5112bb5e., pid=101, masterSystemTime=1676174112098 2023-02-12 03:55:12,394 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=3), splitQueue=0 2023-02-12 03:55:12,394 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=4), splitQueue=0 2023-02-12 03:55:12,395 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,1,1676174084167.0e9d0e06e60b6abe7b05797a5112bb5e. 2023-02-12 03:55:12,396 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,1,1676174084167.0e9d0e06e60b6abe7b05797a5112bb5e. 2023-02-12 03:55:12,396 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=99 updating hbase:meta row=0e9d0e06e60b6abe7b05797a5112bb5e, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:12,396 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,1,1676174084167.0e9d0e06e60b6abe7b05797a5112bb5e.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1676174112396"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676174112396"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676174112396"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676174112396"}]},"ts":"1676174112396"} 2023-02-12 03:55:12,399 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=101, resume processing ppid=99 2023-02-12 03:55:12,399 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=101, ppid=99, state=SUCCESS; OpenRegionProcedure 0e9d0e06e60b6abe7b05797a5112bb5e, server=jenkins-hbase20.apache.org,39639,1676173982450 in 452 msec 2023-02-12 03:55:12,400 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=99, resume processing ppid=97 2023-02-12 03:55:12,400 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=99, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=0e9d0e06e60b6abe7b05797a5112bb5e, ASSIGN in 614 msec 2023-02-12 03:55:12,400 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676174112400"}]},"ts":"1676174112400"} 2023-02-12 03:55:12,401 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLED in hbase:meta 2023-02-12 03:55:12,402 INFO [PEWorker-2] procedure.EnableTableProcedure(310): Table 'testCompactionWithHFileLink' was successfully enabled. 2023-02-12 03:55:12,403 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=97, state=SUCCESS; EnableTableProcedure table=testCompactionWithHFileLink in 796 msec 2023-02-12 03:55:12,718 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40099] master.MasterRpcServices(1227): Checking to see if procedure is done pid=97 2023-02-12 03:55:12,719 INFO [Listener at localhost.localdomain/41049] client.HBaseAdmin$TableFuture(3541): Operation: ENABLE, Table Name: default:testCompactionWithHFileLink, procId: 97 completed 2023-02-12 03:55:12,724 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-12 03:55:12,737 DEBUG [Listener at localhost.localdomain/41049] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-12 03:55:12,745 DEBUG [Listener at localhost.localdomain/41049] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-12 03:55:12,753 DEBUG [Listener at localhost.localdomain/41049] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-12 03:55:12,754 DEBUG [Listener at localhost.localdomain/41049] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-12 03:55:12,761 INFO [Listener at localhost.localdomain/41049] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-02-12 03:55:12,774 INFO [Listener at localhost.localdomain/41049] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 12 selected files, and 0 irrelevant files table 'testCompactionWithHFileLink' and column 'family1' 2023-02-12 03:55:12,774 INFO [Listener at localhost.localdomain/41049] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testCompactionWithHFileLink' column='family1' 2023-02-12 03:55:12,774 DEBUG [Listener at localhost.localdomain/41049] zookeeper.ReadOnlyZKClient(139): Connect 0x1d1b1480 to 127.0.0.1:59556 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 03:55:12,777 DEBUG [Listener at localhost.localdomain/41049] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4ae88535, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 03:55:12,778 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20230212 for table='testCompactionWithHFileLink' and column='family1' 2023-02-12 03:55:12,778 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20230212 for table='testCompactionWithHFileLink' and column='family1' 2023-02-12 03:55:12,778 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20230212 for table='testCompactionWithHFileLink' and column='family1' 2023-02-12 03:55:13,508 DEBUG [RS:0;jenkins-hbase20:39639-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/.tmp/family2/9e93078b3d304f8d902e849090ef9e61 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/family2/9e93078b3d304f8d902e849090ef9e61 2023-02-12 03:55:13,508 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/.tmp/family1/c796414ad95b4d51b8fe1403901965c4 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/family1/c796414ad95b4d51b8fe1403901965c4 2023-02-12 03:55:13,515 DEBUG [RS:0;jenkins-hbase20:39639-longCompactions-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testCompactionWithHFileLink' 2023-02-12 03:55:13,515 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testCompactionWithHFileLink' 2023-02-12 03:55:13,516 INFO [RS:0;jenkins-hbase20:39639-longCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in 4e8254a6d12aded099b366c106c6930d/family2 of 4e8254a6d12aded099b366c106c6930d into 9e93078b3d304f8d902e849090ef9e61(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-12 03:55:13,516 INFO [RS:0;jenkins-hbase20:39639-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in 4e8254a6d12aded099b366c106c6930d/family1 of 4e8254a6d12aded099b366c106c6930d into c796414ad95b4d51b8fe1403901965c4(size=7.6 K), total size for store is 7.6 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-12 03:55:13,516 DEBUG [RS:0;jenkins-hbase20:39639-longCompactions-0] regionserver.HRegion(2288): Compaction status journal for 4e8254a6d12aded099b366c106c6930d: 2023-02-12 03:55:13,516 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 4e8254a6d12aded099b366c106c6930d: 2023-02-12 03:55:13,516 INFO [RS:0;jenkins-hbase20:39639-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,,1676174084167.4e8254a6d12aded099b366c106c6930d., storeName=4e8254a6d12aded099b366c106c6930d/family2, priority=12, startTime=1676174112185; duration=1sec 2023-02-12 03:55:13,516 INFO [RS:0;jenkins-hbase20:39639-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,,1676174084167.4e8254a6d12aded099b366c106c6930d., storeName=4e8254a6d12aded099b366c106c6930d/family1, priority=12, startTime=1676174112184; duration=1sec 2023-02-12 03:55:13,516 DEBUG [RS:0;jenkins-hbase20:39639-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=4), splitQueue=0 2023-02-12 03:55:13,516 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=3), splitQueue=0 2023-02-12 03:55:13,517 DEBUG [RS:0;jenkins-hbase20:39639-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-02-12 03:55:13,517 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-02-12 03:55:13,520 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-02-12 03:55:13,520 DEBUG [RS:0;jenkins-hbase20:39639-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 22152 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-02-12 03:55:13,520 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] regionserver.HStore(1912): 0e9d0e06e60b6abe7b05797a5112bb5e/family2 is initiating minor compaction (all files) 2023-02-12 03:55:13,520 DEBUG [RS:0;jenkins-hbase20:39639-longCompactions-0] regionserver.HStore(1912): 369851c5c3dd6d38afc3b2a16e1a3ffc/family1 is initiating minor compaction (all files) 2023-02-12 03:55:13,520 INFO [RS:0;jenkins-hbase20:39639-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 0e9d0e06e60b6abe7b05797a5112bb5e/family2 in testCompactionWithHFileLink,1,1676174084167.0e9d0e06e60b6abe7b05797a5112bb5e. 2023-02-12 03:55:13,520 INFO [RS:0;jenkins-hbase20:39639-longCompactions-0] regionserver.HRegion(2258): Starting compaction of 369851c5c3dd6d38afc3b2a16e1a3ffc/family1 in testCompactionWithHFileLink,2,1676174084167.369851c5c3dd6d38afc3b2a16e1a3ffc. 2023-02-12 03:55:13,520 INFO [RS:0;jenkins-hbase20:39639-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/family2/testCompactionWithHFileLink=0e9d0e06e60b6abe7b05797a5112bb5e-dd64bba239ac4a7491ca0594815ff9af, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/family2/testCompactionWithHFileLink=0e9d0e06e60b6abe7b05797a5112bb5e-109b596bd4c145e380fc107ade6f1be3, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/family2/testCompactionWithHFileLink=0e9d0e06e60b6abe7b05797a5112bb5e-bd136b408a804ed88601e3708f60c2a2, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/family2/testCompactionWithHFileLink=0e9d0e06e60b6abe7b05797a5112bb5e-cf35ea8d9268481bbf9aeec68aa1adb6] into tmpdir=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/.tmp, totalSize=20.4 K 2023-02-12 03:55:13,520 INFO [RS:0;jenkins-hbase20:39639-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/family1/testCompactionWithHFileLink=369851c5c3dd6d38afc3b2a16e1a3ffc-57336479cdcf48c297824f71584356ca, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/family1/testCompactionWithHFileLink=369851c5c3dd6d38afc3b2a16e1a3ffc-28a38cf350244da7830c9753b7964958, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/family1/testCompactionWithHFileLink=369851c5c3dd6d38afc3b2a16e1a3ffc-87d4d7959ed5460db9686869a40435c0, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/family1/testCompactionWithHFileLink=369851c5c3dd6d38afc3b2a16e1a3ffc-cc7410dc341d435da9efadbba79ec3d5] into tmpdir=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/.tmp, totalSize=21.6 K 2023-02-12 03:55:13,521 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=0e9d0e06e60b6abe7b05797a5112bb5e-dd64bba239ac4a7491ca0594815ff9af, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676174086290 2023-02-12 03:55:13,521 DEBUG [RS:0;jenkins-hbase20:39639-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=369851c5c3dd6d38afc3b2a16e1a3ffc-57336479cdcf48c297824f71584356ca, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676174086291 2023-02-12 03:55:13,521 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=0e9d0e06e60b6abe7b05797a5112bb5e-109b596bd4c145e380fc107ade6f1be3, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676174088114 2023-02-12 03:55:13,521 DEBUG [RS:0;jenkins-hbase20:39639-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=369851c5c3dd6d38afc3b2a16e1a3ffc-28a38cf350244da7830c9753b7964958, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676174088114 2023-02-12 03:55:13,522 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=0e9d0e06e60b6abe7b05797a5112bb5e-bd136b408a804ed88601e3708f60c2a2, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676174089931 2023-02-12 03:55:13,522 DEBUG [RS:0;jenkins-hbase20:39639-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=369851c5c3dd6d38afc3b2a16e1a3ffc-87d4d7959ed5460db9686869a40435c0, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676174089932 2023-02-12 03:55:13,522 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=0e9d0e06e60b6abe7b05797a5112bb5e-cf35ea8d9268481bbf9aeec68aa1adb6, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676174091752 2023-02-12 03:55:13,523 DEBUG [RS:0;jenkins-hbase20:39639-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=369851c5c3dd6d38afc3b2a16e1a3ffc-cc7410dc341d435da9efadbba79ec3d5, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676174091752 2023-02-12 03:55:13,535 INFO [RS:0;jenkins-hbase20:39639-shortCompactions-0] throttle.PressureAwareThroughputController(145): 0e9d0e06e60b6abe7b05797a5112bb5e#family2#compaction#116 average throughput is 0.58 MB/second, slept 0 time(s) and total slept time is 0 ms. 1 active operations remaining, total limit is 57.69 MB/second 2023-02-12 03:55:13,536 INFO [RS:0;jenkins-hbase20:39639-longCompactions-0] throttle.PressureAwareThroughputController(145): 369851c5c3dd6d38afc3b2a16e1a3ffc#family1#compaction#117 average throughput is 1.17 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 57.69 MB/second 2023-02-12 03:55:13,558 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/family1/testCompactionWithHFileLink=4e8254a6d12aded099b366c106c6930d-67634b9f7088459b8c692fbefde445c4, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/family1/testCompactionWithHFileLink=4e8254a6d12aded099b366c106c6930d-f16c24a6c05c4ffc99cbbd8f419bdc6b, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/family1/testCompactionWithHFileLink=4e8254a6d12aded099b366c106c6930d-24c9ba5b866a46329c7fb8ab8a046ca8, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/family1/testCompactionWithHFileLink=4e8254a6d12aded099b366c106c6930d-74306a4c7f9e4c4d90d47fe163c451c2] to archive 2023-02-12 03:55:13,558 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-12 03:55:13,560 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/family1/testCompactionWithHFileLink=4e8254a6d12aded099b366c106c6930d-67634b9f7088459b8c692fbefde445c4 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/family1/testCompactionWithHFileLink=4e8254a6d12aded099b366c106c6930d-67634b9f7088459b8c692fbefde445c4 2023-02-12 03:55:13,561 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/family1/testCompactionWithHFileLink=4e8254a6d12aded099b366c106c6930d-f16c24a6c05c4ffc99cbbd8f419bdc6b to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/family1/testCompactionWithHFileLink=4e8254a6d12aded099b366c106c6930d-f16c24a6c05c4ffc99cbbd8f419bdc6b 2023-02-12 03:55:13,562 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/family1/testCompactionWithHFileLink=4e8254a6d12aded099b366c106c6930d-24c9ba5b866a46329c7fb8ab8a046ca8 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/family1/testCompactionWithHFileLink=4e8254a6d12aded099b366c106c6930d-24c9ba5b866a46329c7fb8ab8a046ca8 2023-02-12 03:55:13,563 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/family1/testCompactionWithHFileLink=4e8254a6d12aded099b366c106c6930d-74306a4c7f9e4c4d90d47fe163c451c2 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/family1/testCompactionWithHFileLink=4e8254a6d12aded099b366c106c6930d-74306a4c7f9e4c4d90d47fe163c451c2 2023-02-12 03:55:13,567 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/family2/testCompactionWithHFileLink=4e8254a6d12aded099b366c106c6930d-9094c6fd8f824ee288f6545ee8d61038, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/family2/testCompactionWithHFileLink=4e8254a6d12aded099b366c106c6930d-82632c718e894427ab9e68941a927668, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/family2/testCompactionWithHFileLink=4e8254a6d12aded099b366c106c6930d-d98fbbdcc7af49b48050c5145edd38da, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/family2/testCompactionWithHFileLink=4e8254a6d12aded099b366c106c6930d-54b7be21dbb245e787729ac2c1f02542] to archive 2023-02-12 03:55:13,567 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-12 03:55:13,569 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/family2/testCompactionWithHFileLink=4e8254a6d12aded099b366c106c6930d-9094c6fd8f824ee288f6545ee8d61038 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/family2/testCompactionWithHFileLink=4e8254a6d12aded099b366c106c6930d-9094c6fd8f824ee288f6545ee8d61038 2023-02-12 03:55:13,570 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/family2/testCompactionWithHFileLink=4e8254a6d12aded099b366c106c6930d-82632c718e894427ab9e68941a927668 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/family2/testCompactionWithHFileLink=4e8254a6d12aded099b366c106c6930d-82632c718e894427ab9e68941a927668 2023-02-12 03:55:13,570 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/family2/testCompactionWithHFileLink=4e8254a6d12aded099b366c106c6930d-d98fbbdcc7af49b48050c5145edd38da to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/family2/testCompactionWithHFileLink=4e8254a6d12aded099b366c106c6930d-d98fbbdcc7af49b48050c5145edd38da 2023-02-12 03:55:13,572 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/family2/testCompactionWithHFileLink=4e8254a6d12aded099b366c106c6930d-54b7be21dbb245e787729ac2c1f02542 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/family2/testCompactionWithHFileLink=4e8254a6d12aded099b366c106c6930d-54b7be21dbb245e787729ac2c1f02542 2023-02-12 03:55:13,655 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230212edb524270ef54a3baa6b8ed6cd592e99 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230212edb524270ef54a3baa6b8ed6cd592e99 2023-02-12 03:55:13,655 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202302127c759660718e4917bad328b4a590ed17 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202302127c759660718e4917bad328b4a590ed17 2023-02-12 03:55:13,655 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230212bab20347e9d84f8985006d99447189ef to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230212bab20347e9d84f8985006d99447189ef 2023-02-12 03:55:13,656 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230212 table='testCompactionWithHFileLink' column='family1' 2023-02-12 03:55:13,657 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230212 table='testCompactionWithHFileLink' column='family1' 2023-02-12 03:55:13,657 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230212 table='testCompactionWithHFileLink' column='family1' 2023-02-12 03:55:13,667 DEBUG [MobFileCompactionChore-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-12 03:55:13,670 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:53806, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-12 03:55:13,678 DEBUG [MobFileCompactionChore-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-12 03:55:13,681 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:56840, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-12 03:55:13,700 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230212/family1/8fa23e8eaa864ae1ad7f2d8242aa6d3a first=Optional[2\x00\x00\x00\x00] last=Optional[2\x00\x00\x00\x07] 2023-02-12 03:55:13,700 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testCompactionWithHFileLink,2,1676174084167.369851c5c3dd6d38afc3b2a16e1a3ffc., hostname=jenkins-hbase20.apache.org,39639,1676173982450, seqNum=32 for row 2 with hfile group [{family1,hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230212/family1/8fa23e8eaa864ae1ad7f2d8242aa6d3a}] 2023-02-12 03:55:13,701 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230212/family1/6bafe0b877d14d92a429be606b813c98 first=Optional[0\x00\x00\x00\x00] last=Optional[0\x00\x00\x00\x07] 2023-02-12 03:55:13,701 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testCompactionWithHFileLink,,1676174084167.4e8254a6d12aded099b366c106c6930d., hostname=jenkins-hbase20.apache.org,39639,1676173982450, seqNum=32 for row with hfile group [{family1,hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230212/family1/6bafe0b877d14d92a429be606b813c98}] 2023-02-12 03:55:13,706 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230212/family1/4a35ea2d7e9a44d39567a23c298da07e first=Optional[1\x00\x00\x00\x00] last=Optional[1\x00\x00\x00\x07] 2023-02-12 03:55:13,707 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testCompactionWithHFileLink,1,1676174084167.0e9d0e06e60b6abe7b05797a5112bb5e., hostname=jenkins-hbase20.apache.org,39639,1676173982450, seqNum=32 for row 1 with hfile group [{family1,hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230212/family1/4a35ea2d7e9a44d39567a23c298da07e}] 2023-02-12 03:55:13,707 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230212/family1/8fa23e8eaa864ae1ad7f2d8242aa6d3a for inclusion in 369851c5c3dd6d38afc3b2a16e1a3ffc/family1 2023-02-12 03:55:13,707 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39639] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230212/family1/6bafe0b877d14d92a429be606b813c98 for inclusion in 4e8254a6d12aded099b366c106c6930d/family1 2023-02-12 03:55:13,708 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39639] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230212/family1/4a35ea2d7e9a44d39567a23c298da07e for inclusion in 0e9d0e06e60b6abe7b05797a5112bb5e/family1 2023-02-12 03:55:13,709 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x00 last=2\x00\x00\x00\x07 2023-02-12 03:55:13,709 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HStore(777): Region bounds: first=2 last= 2023-02-12 03:55:13,709 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39639] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x00 last=0\x00\x00\x00\x07 2023-02-12 03:55:13,709 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39639] regionserver.HStore(777): Region bounds: first= last=1 2023-02-12 03:55:13,709 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HRegion(2445): Flush status journal for 369851c5c3dd6d38afc3b2a16e1a3ffc: 2023-02-12 03:55:13,709 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39639] regionserver.HRegion(2445): Flush status journal for 4e8254a6d12aded099b366c106c6930d: 2023-02-12 03:55:13,710 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39639] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x00 last=1\x00\x00\x00\x07 2023-02-12 03:55:13,710 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39639] regionserver.HStore(777): Region bounds: first=1 last=2 2023-02-12 03:55:13,710 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39639] regionserver.HRegion(2445): Flush status journal for 0e9d0e06e60b6abe7b05797a5112bb5e: 2023-02-12 03:55:13,711 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39639] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230212/family1/6bafe0b877d14d92a429be606b813c98 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/staging/jenkins__testCompactionWithHFileLink__v9njc3598oi5amihrsnt5nfr3kssarkorkh4d0gbdd0o28p42j65aftns0p62j4f/family1/6bafe0b877d14d92a429be606b813c98 2023-02-12 03:55:13,711 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230212/family1/8fa23e8eaa864ae1ad7f2d8242aa6d3a to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/staging/jenkins__testCompactionWithHFileLink__dndsgvd2r48l1ok2bakd9pn2tmif00nggr8j2du69sahf9tilolr2chus2o47cdp/family1/8fa23e8eaa864ae1ad7f2d8242aa6d3a 2023-02-12 03:55:13,711 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39639] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230212/family1/4a35ea2d7e9a44d39567a23c298da07e to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/staging/jenkins__testCompactionWithHFileLink__tcur4ctn8en1srp7673eqn28a559698nl668e266774hnptgoiilln7due6bangv/family1/4a35ea2d7e9a44d39567a23c298da07e 2023-02-12 03:55:13,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39639] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/staging/jenkins__testCompactionWithHFileLink__v9njc3598oi5amihrsnt5nfr3kssarkorkh4d0gbdd0o28p42j65aftns0p62j4f/family1/6bafe0b877d14d92a429be606b813c98 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/family1/5f6205b0b8624fdd93248c2cec99594a_SeqId_36_ 2023-02-12 03:55:13,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39639] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/staging/jenkins__testCompactionWithHFileLink__tcur4ctn8en1srp7673eqn28a559698nl668e266774hnptgoiilln7due6bangv/family1/4a35ea2d7e9a44d39567a23c298da07e as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/family1/4ba48b0ee1a1424cb46dd72feb678b50_SeqId_34_ 2023-02-12 03:55:13,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/staging/jenkins__testCompactionWithHFileLink__dndsgvd2r48l1ok2bakd9pn2tmif00nggr8j2du69sahf9tilolr2chus2o47cdp/family1/8fa23e8eaa864ae1ad7f2d8242aa6d3a as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/family1/ce54fe840657428599f4ed631e389d38_SeqId_34_ 2023-02-12 03:55:13,713 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39639] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/staging/jenkins__testCompactionWithHFileLink__v9njc3598oi5amihrsnt5nfr3kssarkorkh4d0gbdd0o28p42j65aftns0p62j4f/family1/6bafe0b877d14d92a429be606b813c98 into 4e8254a6d12aded099b366c106c6930d/family1 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/family1/5f6205b0b8624fdd93248c2cec99594a_SeqId_36_ - updating store file list. 2023-02-12 03:55:13,714 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39639] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/staging/jenkins__testCompactionWithHFileLink__tcur4ctn8en1srp7673eqn28a559698nl668e266774hnptgoiilln7due6bangv/family1/4a35ea2d7e9a44d39567a23c298da07e into 0e9d0e06e60b6abe7b05797a5112bb5e/family1 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/family1/4ba48b0ee1a1424cb46dd72feb678b50_SeqId_34_ - updating store file list. 2023-02-12 03:55:13,714 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/staging/jenkins__testCompactionWithHFileLink__dndsgvd2r48l1ok2bakd9pn2tmif00nggr8j2du69sahf9tilolr2chus2o47cdp/family1/8fa23e8eaa864ae1ad7f2d8242aa6d3a into 369851c5c3dd6d38afc3b2a16e1a3ffc/family1 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/family1/ce54fe840657428599f4ed631e389d38_SeqId_34_ - updating store file list. 2023-02-12 03:55:13,717 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39639] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/family1/5f6205b0b8624fdd93248c2cec99594a_SeqId_36_ into 4e8254a6d12aded099b366c106c6930d/family1 2023-02-12 03:55:13,717 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/family1/ce54fe840657428599f4ed631e389d38_SeqId_34_ into 369851c5c3dd6d38afc3b2a16e1a3ffc/family1 2023-02-12 03:55:13,717 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39639] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/staging/jenkins__testCompactionWithHFileLink__v9njc3598oi5amihrsnt5nfr3kssarkorkh4d0gbdd0o28p42j65aftns0p62j4f/family1/6bafe0b877d14d92a429be606b813c98 into 4e8254a6d12aded099b366c106c6930d/family1 (new location: hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/family1/5f6205b0b8624fdd93248c2cec99594a_SeqId_36_) 2023-02-12 03:55:13,717 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39639] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/family1/4ba48b0ee1a1424cb46dd72feb678b50_SeqId_34_ into 0e9d0e06e60b6abe7b05797a5112bb5e/family1 2023-02-12 03:55:13,717 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/staging/jenkins__testCompactionWithHFileLink__dndsgvd2r48l1ok2bakd9pn2tmif00nggr8j2du69sahf9tilolr2chus2o47cdp/family1/8fa23e8eaa864ae1ad7f2d8242aa6d3a into 369851c5c3dd6d38afc3b2a16e1a3ffc/family1 (new location: hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/family1/ce54fe840657428599f4ed631e389d38_SeqId_34_) 2023-02-12 03:55:13,717 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39639] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/staging/jenkins__testCompactionWithHFileLink__tcur4ctn8en1srp7673eqn28a559698nl668e266774hnptgoiilln7due6bangv/family1/4a35ea2d7e9a44d39567a23c298da07e into 0e9d0e06e60b6abe7b05797a5112bb5e/family1 (new location: hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/family1/4ba48b0ee1a1424cb46dd72feb678b50_SeqId_34_) 2023-02-12 03:55:13,717 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=39639] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/staging/jenkins__testCompactionWithHFileLink__v9njc3598oi5amihrsnt5nfr3kssarkorkh4d0gbdd0o28p42j65aftns0p62j4f/family1/6bafe0b877d14d92a429be606b813c98 2023-02-12 03:55:13,717 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39639] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/staging/jenkins__testCompactionWithHFileLink__tcur4ctn8en1srp7673eqn28a559698nl668e266774hnptgoiilln7due6bangv/family1/4a35ea2d7e9a44d39567a23c298da07e 2023-02-12 03:55:13,717 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/staging/jenkins__testCompactionWithHFileLink__dndsgvd2r48l1ok2bakd9pn2tmif00nggr8j2du69sahf9tilolr2chus2o47cdp/family1/8fa23e8eaa864ae1ad7f2d8242aa6d3a 2023-02-12 03:55:13,717 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39639] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-12 03:55:13,719 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230212 table='testCompactionWithHFileLink' column='family1' 2023-02-12 03:55:13,719 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230212 table='testCompactionWithHFileLink' column='family1' 2023-02-12 03:55:13,719 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-02-12 03:55:13,719 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-02-12 03:55:13,720 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39639] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 5 files of size 29606 starting at candidate #0 after considering 6 permutations with 6 in ratio 2023-02-12 03:55:13,720 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39639] regionserver.HStore(1912): 0e9d0e06e60b6abe7b05797a5112bb5e/family1 is initiating minor compaction (all files) 2023-02-12 03:55:13,720 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39639] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@30ebf9dd; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=3), splitQueue=0 2023-02-12 03:55:13,720 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c202302123ccb2e9b5c43466f9e396ae6b2e4e7e6 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c202302123ccb2e9b5c43466f9e396ae6b2e4e7e6 2023-02-12 03:55:13,721 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e2023021240d363ee3ba045559336952277303653 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e2023021240d363ee3ba045559336952277303653 2023-02-12 03:55:13,721 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230212 table='testCompactionWithHFileLink' column='family1' 2023-02-12 03:55:13,721 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c202302126112c32489b74171a8463897751a6913 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c202302126112c32489b74171a8463897751a6913 2023-02-12 03:55:13,722 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e202302129d5ad3f18fe94f96af9319afb047dc3a to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e202302129d5ad3f18fe94f96af9319afb047dc3a 2023-02-12 03:55:13,722 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-12 03:55:13,722 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c202302128e17b0c2b0934395b74d1c0fa5415109 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c202302128e17b0c2b0934395b74d1c0fa5415109 2023-02-12 03:55:13,722 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20230212de3ba320365e4c209e5e5905c42d1e7b to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20230212de3ba320365e4c209e5e5905c42d1e7b 2023-02-12 03:55:13,723 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20230212216703835d1543e0bf1aa9f72faf4287 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20230212216703835d1543e0bf1aa9f72faf4287 2023-02-12 03:55:13,723 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20230212d6057bca00184504b708b6acd6d48f2d to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20230212d6057bca00184504b708b6acd6d48f2d 2023-02-12 03:55:13,723 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-02-12 03:55:13,723 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230212' 2023-02-12 03:55:13,723 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20230212e33bb280a79e495589b956efc4e3e56c to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20230212e33bb280a79e495589b956efc4e3e56c 2023-02-12 03:55:13,723 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-02-12 03:55:13,723 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230212' 2023-02-12 03:55:13,724 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20230212 for table='testCompactionWithHFileLink' and column='family1' 2023-02-12 03:55:13,724 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20230212 for table='testCompactionWithHFileLink' and column='family1' 2023-02-12 03:55:13,724 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20230212a3a6d6339686408ba5d6e047ec635631 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20230212a3a6d6339686408ba5d6e047ec635631 2023-02-12 03:55:13,724 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20230212a401f6430c8c4a8d88a379f214b16ffb to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20230212a401f6430c8c4a8d88a379f214b16ffb 2023-02-12 03:55:13,725 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20230212b7f58914f1a44008b811b6dc8d0875e3 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20230212b7f58914f1a44008b811b6dc8d0875e3 2023-02-12 03:55:13,725 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-02-12 03:55:13,725 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230212' 2023-02-12 03:55:13,726 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20230212 for table='testCompactionWithHFileLink' and column='family1' 2023-02-12 03:55:13,726 INFO [Listener at localhost.localdomain/41049] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testCompactionWithHFileLink' column='family1' 2023-02-12 03:55:13,731 DEBUG [Listener at localhost.localdomain/41049] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-12 03:55:13,734 DEBUG [Listener at localhost.localdomain/41049] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-12 03:55:13,738 DEBUG [Listener at localhost.localdomain/41049] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-12 03:55:13,739 DEBUG [Listener at localhost.localdomain/41049] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-12 03:55:13,746 DEBUG [Listener at localhost.localdomain/41049] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-12 03:55:13,747 DEBUG [Listener at localhost.localdomain/41049] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-12 03:55:13,762 INFO [Listener at localhost.localdomain/41049] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testCompactionWithHFileLink Thread=283 (was 244) - Thread LEAK? -, OpenFileDescriptor=752 (was 614) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=130 (was 188), ProcessCount=164 (was 164), AvailableMemoryMB=3923 (was 4014) 2023-02-12 03:55:13,772 INFO [Listener at localhost.localdomain/41049] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompaction Thread=283, OpenFileDescriptor=752, MaxFileDescriptor=60000, SystemLoadAverage=130, ProcessCount=164, AvailableMemoryMB=3922 2023-02-12 03:55:13,778 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40099] master.HMaster$15(2997): Client=jenkins//148.251.75.209 creating {NAME => 'ns'} 2023-02-12 03:55:13,779 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40099] procedure2.ProcedureExecutor(1029): Stored pid=104, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=ns 2023-02-12 03:55:13,784 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40099] master.MasterRpcServices(1227): Checking to see if procedure is done pid=104 2023-02-12 03:55:13,785 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-12 03:55:13,787 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=104, state=SUCCESS; CreateNamespaceProcedure, namespace=ns in 8 msec 2023-02-12 03:55:13,885 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40099] master.MasterRpcServices(1227): Checking to see if procedure is done pid=104 2023-02-12 03:55:13,889 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40099] master.HMaster$4(2102): Client=jenkins//148.251.75.209 create 'ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-02-12 03:55:13,890 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40099] procedure2.ProcedureExecutor(1029): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=ns:testMinorCompaction 2023-02-12 03:55:13,893 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_PRE_OPERATION 2023-02-12 03:55:13,894 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40099] master.MasterRpcServices(697): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "ns" qualifier: "testMinorCompaction" procId is: 105 2023-02-12 03:55:13,895 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-12 03:55:13,895 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40099] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-02-12 03:55:13,898 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/.tmp/data/ns/testMinorCompaction/7a34b5c93155c75d8e84f8d88f767143 2023-02-12 03:55:13,898 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/.tmp/data/ns/testMinorCompaction/413323817eab6eca83ffbd861a4ef441 2023-02-12 03:55:13,899 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/.tmp/data/ns/testMinorCompaction/5de519c4afe22c04111a6724c632530e 2023-02-12 03:55:13,899 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/.tmp/data/ns/testMinorCompaction/7a34b5c93155c75d8e84f8d88f767143 empty. 2023-02-12 03:55:13,899 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/.tmp/data/ns/testMinorCompaction/5de519c4afe22c04111a6724c632530e empty. 2023-02-12 03:55:13,900 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/.tmp/data/ns/testMinorCompaction/413323817eab6eca83ffbd861a4ef441 empty. 2023-02-12 03:55:13,900 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/.tmp/data/ns/testMinorCompaction/7a34b5c93155c75d8e84f8d88f767143 2023-02-12 03:55:13,900 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/.tmp/data/ns/testMinorCompaction/5de519c4afe22c04111a6724c632530e 2023-02-12 03:55:13,900 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/.tmp/data/ns/testMinorCompaction/413323817eab6eca83ffbd861a4ef441 2023-02-12 03:55:13,900 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived ns:testMinorCompaction regions 2023-02-12 03:55:13,997 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40099] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-02-12 03:55:14,199 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40099] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-02-12 03:55:14,313 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/.tmp/data/ns/testMinorCompaction/.tabledesc/.tableinfo.0000000001 2023-02-12 03:55:14,315 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(7671): creating {ENCODED => 7a34b5c93155c75d8e84f8d88f767143, NAME => 'ns:testMinorCompaction,,1676174113888.7a34b5c93155c75d8e84f8d88f767143.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/.tmp 2023-02-12 03:55:14,315 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(7671): creating {ENCODED => 5de519c4afe22c04111a6724c632530e, NAME => 'ns:testMinorCompaction,2,1676174113888.5de519c4afe22c04111a6724c632530e.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/.tmp 2023-02-12 03:55:14,316 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(7671): creating {ENCODED => 413323817eab6eca83ffbd861a4ef441, NAME => 'ns:testMinorCompaction,1,1676174113888.413323817eab6eca83ffbd861a4ef441.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/.tmp 2023-02-12 03:55:14,325 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(865): Instantiated ns:testMinorCompaction,2,1676174113888.5de519c4afe22c04111a6724c632530e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:55:14,325 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1603): Closing 5de519c4afe22c04111a6724c632530e, disabling compactions & flushes 2023-02-12 03:55:14,325 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1625): Closing region ns:testMinorCompaction,2,1676174113888.5de519c4afe22c04111a6724c632530e. 2023-02-12 03:55:14,325 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on ns:testMinorCompaction,2,1676174113888.5de519c4afe22c04111a6724c632530e. 2023-02-12 03:55:14,325 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1713): Acquired close lock on ns:testMinorCompaction,2,1676174113888.5de519c4afe22c04111a6724c632530e. after waiting 0 ms 2023-02-12 03:55:14,325 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1723): Updates disabled for region ns:testMinorCompaction,2,1676174113888.5de519c4afe22c04111a6724c632530e. 2023-02-12 03:55:14,325 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1837): Closed ns:testMinorCompaction,2,1676174113888.5de519c4afe22c04111a6724c632530e. 2023-02-12 03:55:14,325 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1557): Region close journal for 5de519c4afe22c04111a6724c632530e: Waiting for close lock at 1676174114325Disabling compacts and flushes for region at 1676174114325Disabling writes for close at 1676174114325Writing region close event to WAL at 1676174114325Closed at 1676174114325 2023-02-12 03:55:14,500 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40099] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-02-12 03:55:14,725 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(865): Instantiated ns:testMinorCompaction,,1676174113888.7a34b5c93155c75d8e84f8d88f767143.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:55:14,725 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(865): Instantiated ns:testMinorCompaction,1,1676174113888.413323817eab6eca83ffbd861a4ef441.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:55:14,725 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1603): Closing 7a34b5c93155c75d8e84f8d88f767143, disabling compactions & flushes 2023-02-12 03:55:14,726 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1603): Closing 413323817eab6eca83ffbd861a4ef441, disabling compactions & flushes 2023-02-12 03:55:14,726 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1625): Closing region ns:testMinorCompaction,,1676174113888.7a34b5c93155c75d8e84f8d88f767143. 2023-02-12 03:55:14,726 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1625): Closing region ns:testMinorCompaction,1,1676174113888.413323817eab6eca83ffbd861a4ef441. 2023-02-12 03:55:14,726 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on ns:testMinorCompaction,,1676174113888.7a34b5c93155c75d8e84f8d88f767143. 2023-02-12 03:55:14,726 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on ns:testMinorCompaction,1,1676174113888.413323817eab6eca83ffbd861a4ef441. 2023-02-12 03:55:14,726 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1713): Acquired close lock on ns:testMinorCompaction,,1676174113888.7a34b5c93155c75d8e84f8d88f767143. after waiting 0 ms 2023-02-12 03:55:14,726 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1713): Acquired close lock on ns:testMinorCompaction,1,1676174113888.413323817eab6eca83ffbd861a4ef441. after waiting 0 ms 2023-02-12 03:55:14,726 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1723): Updates disabled for region ns:testMinorCompaction,,1676174113888.7a34b5c93155c75d8e84f8d88f767143. 2023-02-12 03:55:14,726 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1723): Updates disabled for region ns:testMinorCompaction,1,1676174113888.413323817eab6eca83ffbd861a4ef441. 2023-02-12 03:55:14,726 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1837): Closed ns:testMinorCompaction,,1676174113888.7a34b5c93155c75d8e84f8d88f767143. 2023-02-12 03:55:14,726 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1837): Closed ns:testMinorCompaction,1,1676174113888.413323817eab6eca83ffbd861a4ef441. 2023-02-12 03:55:14,726 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1557): Region close journal for 7a34b5c93155c75d8e84f8d88f767143: Waiting for close lock at 1676174114725Disabling compacts and flushes for region at 1676174114725Disabling writes for close at 1676174114726 (+1 ms)Writing region close event to WAL at 1676174114726Closed at 1676174114726 2023-02-12 03:55:14,726 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1557): Region close journal for 413323817eab6eca83ffbd861a4ef441: Waiting for close lock at 1676174114726Disabling compacts and flushes for region at 1676174114726Disabling writes for close at 1676174114726Writing region close event to WAL at 1676174114726Closed at 1676174114726 2023-02-12 03:55:14,729 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_ADD_TO_META 2023-02-12 03:55:14,730 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,2,1676174113888.5de519c4afe22c04111a6724c632530e.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1676174114730"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676174114730"}]},"ts":"1676174114730"} 2023-02-12 03:55:14,730 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,,1676174113888.7a34b5c93155c75d8e84f8d88f767143.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1676174114730"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676174114730"}]},"ts":"1676174114730"} 2023-02-12 03:55:14,730 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,1,1676174113888.413323817eab6eca83ffbd861a4ef441.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1676174114730"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676174114730"}]},"ts":"1676174114730"} 2023-02-12 03:55:14,733 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-02-12 03:55:14,734 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-12 03:55:14,734 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"ns:testMinorCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676174114734"}]},"ts":"1676174114734"} 2023-02-12 03:55:14,736 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=ns:testMinorCompaction, state=ENABLING in hbase:meta 2023-02-12 03:55:14,739 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=7a34b5c93155c75d8e84f8d88f767143, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=413323817eab6eca83ffbd861a4ef441, ASSIGN}, {pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=5de519c4afe22c04111a6724c632530e, ASSIGN}] 2023-02-12 03:55:14,741 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=7a34b5c93155c75d8e84f8d88f767143, ASSIGN 2023-02-12 03:55:14,741 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=5de519c4afe22c04111a6724c632530e, ASSIGN 2023-02-12 03:55:14,741 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=413323817eab6eca83ffbd861a4ef441, ASSIGN 2023-02-12 03:55:14,742 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=7a34b5c93155c75d8e84f8d88f767143, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,39639,1676173982450; forceNewPlan=false, retain=false 2023-02-12 03:55:14,742 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=5de519c4afe22c04111a6724c632530e, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,39639,1676173982450; forceNewPlan=false, retain=false 2023-02-12 03:55:14,742 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=413323817eab6eca83ffbd861a4ef441, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,39639,1676173982450; forceNewPlan=false, retain=false 2023-02-12 03:55:14,766 DEBUG [RS:0;jenkins-hbase20:39639-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/.tmp/family1/9a6c668ddd0f4879b92050ee23be4ed8 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/family1/9a6c668ddd0f4879b92050ee23be4ed8 2023-02-12 03:55:14,766 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/.tmp/family2/840fb1ed306e4cceb239d4c7b95f5614 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/family2/840fb1ed306e4cceb239d4c7b95f5614 2023-02-12 03:55:14,771 INFO [RS:0;jenkins-hbase20:39639-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in 0e9d0e06e60b6abe7b05797a5112bb5e/family2 of 0e9d0e06e60b6abe7b05797a5112bb5e into 840fb1ed306e4cceb239d4c7b95f5614(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-12 03:55:14,771 INFO [RS:0;jenkins-hbase20:39639-longCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in 369851c5c3dd6d38afc3b2a16e1a3ffc/family1 of 369851c5c3dd6d38afc3b2a16e1a3ffc into 9a6c668ddd0f4879b92050ee23be4ed8(size=7.6 K), total size for store is 14.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-12 03:55:14,771 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 0e9d0e06e60b6abe7b05797a5112bb5e: 2023-02-12 03:55:14,771 DEBUG [RS:0;jenkins-hbase20:39639-longCompactions-0] regionserver.HRegion(2288): Compaction status journal for 369851c5c3dd6d38afc3b2a16e1a3ffc: 2023-02-12 03:55:14,771 INFO [RS:0;jenkins-hbase20:39639-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,1,1676174084167.0e9d0e06e60b6abe7b05797a5112bb5e., storeName=0e9d0e06e60b6abe7b05797a5112bb5e/family2, priority=12, startTime=1676174112394; duration=1sec 2023-02-12 03:55:14,771 INFO [RS:0;jenkins-hbase20:39639-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,2,1676174084167.369851c5c3dd6d38afc3b2a16e1a3ffc., storeName=369851c5c3dd6d38afc3b2a16e1a3ffc/family1, priority=12, startTime=1676174112316; duration=1sec 2023-02-12 03:55:14,771 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=3), splitQueue=0 2023-02-12 03:55:14,771 DEBUG [RS:0;jenkins-hbase20:39639-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=2), splitQueue=0 2023-02-12 03:55:14,771 INFO [RS:0;jenkins-hbase20:39639-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 0e9d0e06e60b6abe7b05797a5112bb5e/family1 in testCompactionWithHFileLink,1,1676174084167.0e9d0e06e60b6abe7b05797a5112bb5e. 2023-02-12 03:55:14,771 DEBUG [RS:0;jenkins-hbase20:39639-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 5 compacting, 0 eligible, 16 blocking 2023-02-12 03:55:14,771 DEBUG [RS:0;jenkins-hbase20:39639-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 0 files of size 0 starting at candidate #-1 after considering 0 permutations with 0 in ratio 2023-02-12 03:55:14,771 DEBUG [RS:0;jenkins-hbase20:39639-longCompactions-0] compactions.SortedCompactionPolicy(232): Not compacting files because we only have 0 files ready for compaction. Need 3 to initiate. 2023-02-12 03:55:14,771 DEBUG [RS:0;jenkins-hbase20:39639-longCompactions-0] regionserver.CompactSplit(415): Not compacting testCompactionWithHFileLink,1,1676174084167.0e9d0e06e60b6abe7b05797a5112bb5e. because compaction request was cancelled 2023-02-12 03:55:14,771 INFO [RS:0;jenkins-hbase20:39639-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/family1/testCompactionWithHFileLink=0e9d0e06e60b6abe7b05797a5112bb5e-ca25e354821f41239297823f77effa98, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/family1/testCompactionWithHFileLink=0e9d0e06e60b6abe7b05797a5112bb5e-1680fc2fd19047b9a4d476b5505a9420, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/family1/testCompactionWithHFileLink=0e9d0e06e60b6abe7b05797a5112bb5e-ad5e5cac5663442fb628697e0ac1cb74, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/family1/testCompactionWithHFileLink=0e9d0e06e60b6abe7b05797a5112bb5e-3cd14dd59fa842fba2f6ca863062ef1f, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/family1/4ba48b0ee1a1424cb46dd72feb678b50_SeqId_34_] into tmpdir=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/.tmp, totalSize=28.9 K 2023-02-12 03:55:14,771 DEBUG [RS:0;jenkins-hbase20:39639-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-02-12 03:55:14,772 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=0e9d0e06e60b6abe7b05797a5112bb5e-ca25e354821f41239297823f77effa98, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676174086290 2023-02-12 03:55:14,773 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=0e9d0e06e60b6abe7b05797a5112bb5e-1680fc2fd19047b9a4d476b5505a9420, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676174088114 2023-02-12 03:55:14,774 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=0e9d0e06e60b6abe7b05797a5112bb5e-ad5e5cac5663442fb628697e0ac1cb74, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676174089931 2023-02-12 03:55:14,774 DEBUG [RS:0;jenkins-hbase20:39639-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-02-12 03:55:14,774 DEBUG [RS:0;jenkins-hbase20:39639-longCompactions-0] regionserver.HStore(1912): 369851c5c3dd6d38afc3b2a16e1a3ffc/family2 is initiating minor compaction (all files) 2023-02-12 03:55:14,774 INFO [RS:0;jenkins-hbase20:39639-longCompactions-0] regionserver.HRegion(2258): Starting compaction of 369851c5c3dd6d38afc3b2a16e1a3ffc/family2 in testCompactionWithHFileLink,2,1676174084167.369851c5c3dd6d38afc3b2a16e1a3ffc. 2023-02-12 03:55:14,774 INFO [RS:0;jenkins-hbase20:39639-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/family2/testCompactionWithHFileLink=369851c5c3dd6d38afc3b2a16e1a3ffc-fef2cc5193ee4c29bf399d13cb8afa3b, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/family2/testCompactionWithHFileLink=369851c5c3dd6d38afc3b2a16e1a3ffc-e45c7d1c8c914c029f7acb4750386b15, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/family2/testCompactionWithHFileLink=369851c5c3dd6d38afc3b2a16e1a3ffc-0ee9478488594ba3b7336e26366747b1, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/family2/testCompactionWithHFileLink=369851c5c3dd6d38afc3b2a16e1a3ffc-46d19779813b4d9e825a09db392f3515] into tmpdir=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/.tmp, totalSize=20.4 K 2023-02-12 03:55:14,774 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=0e9d0e06e60b6abe7b05797a5112bb5e-3cd14dd59fa842fba2f6ca863062ef1f, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676174091752 2023-02-12 03:55:14,775 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] compactions.Compactor(207): Compacting 4ba48b0ee1a1424cb46dd72feb678b50_SeqId_34_, keycount=16, bloomtype=ROW, size=7.3 K, encoding=NONE, compression=NONE, seqNum=35, earliestPutTs=1676174086290 2023-02-12 03:55:14,775 DEBUG [RS:0;jenkins-hbase20:39639-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=369851c5c3dd6d38afc3b2a16e1a3ffc-fef2cc5193ee4c29bf399d13cb8afa3b, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676174086291 2023-02-12 03:55:14,776 DEBUG [RS:0;jenkins-hbase20:39639-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=369851c5c3dd6d38afc3b2a16e1a3ffc-e45c7d1c8c914c029f7acb4750386b15, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676174088114 2023-02-12 03:55:14,777 DEBUG [RS:0;jenkins-hbase20:39639-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=369851c5c3dd6d38afc3b2a16e1a3ffc-0ee9478488594ba3b7336e26366747b1, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676174089932 2023-02-12 03:55:14,778 DEBUG [RS:0;jenkins-hbase20:39639-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=369851c5c3dd6d38afc3b2a16e1a3ffc-46d19779813b4d9e825a09db392f3515, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676174091752 2023-02-12 03:55:14,791 INFO [RS:0;jenkins-hbase20:39639-shortCompactions-0] throttle.PressureAwareThroughputController(145): 0e9d0e06e60b6abe7b05797a5112bb5e#family1#compaction#118 average throughput is 0.78 MB/second, slept 0 time(s) and total slept time is 0 ms. 1 active operations remaining, total limit is 57.69 MB/second 2023-02-12 03:55:14,792 INFO [RS:0;jenkins-hbase20:39639-longCompactions-0] throttle.PressureAwareThroughputController(145): 369851c5c3dd6d38afc3b2a16e1a3ffc#family2#compaction#119 average throughput is 0.58 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 57.69 MB/second 2023-02-12 03:55:14,863 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/family2/testCompactionWithHFileLink=0e9d0e06e60b6abe7b05797a5112bb5e-dd64bba239ac4a7491ca0594815ff9af, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/family2/testCompactionWithHFileLink=0e9d0e06e60b6abe7b05797a5112bb5e-109b596bd4c145e380fc107ade6f1be3, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/family2/testCompactionWithHFileLink=0e9d0e06e60b6abe7b05797a5112bb5e-bd136b408a804ed88601e3708f60c2a2, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/family2/testCompactionWithHFileLink=0e9d0e06e60b6abe7b05797a5112bb5e-cf35ea8d9268481bbf9aeec68aa1adb6] to archive 2023-02-12 03:55:14,864 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-12 03:55:14,868 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/family2/testCompactionWithHFileLink=0e9d0e06e60b6abe7b05797a5112bb5e-dd64bba239ac4a7491ca0594815ff9af to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/family2/testCompactionWithHFileLink=0e9d0e06e60b6abe7b05797a5112bb5e-dd64bba239ac4a7491ca0594815ff9af 2023-02-12 03:55:14,869 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/family2/testCompactionWithHFileLink=0e9d0e06e60b6abe7b05797a5112bb5e-109b596bd4c145e380fc107ade6f1be3 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/family2/testCompactionWithHFileLink=0e9d0e06e60b6abe7b05797a5112bb5e-109b596bd4c145e380fc107ade6f1be3 2023-02-12 03:55:14,870 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/family2/testCompactionWithHFileLink=0e9d0e06e60b6abe7b05797a5112bb5e-bd136b408a804ed88601e3708f60c2a2 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/family2/testCompactionWithHFileLink=0e9d0e06e60b6abe7b05797a5112bb5e-bd136b408a804ed88601e3708f60c2a2 2023-02-12 03:55:14,872 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/family2/testCompactionWithHFileLink=0e9d0e06e60b6abe7b05797a5112bb5e-cf35ea8d9268481bbf9aeec68aa1adb6 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/family2/testCompactionWithHFileLink=0e9d0e06e60b6abe7b05797a5112bb5e-cf35ea8d9268481bbf9aeec68aa1adb6 2023-02-12 03:55:14,878 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/family1/testCompactionWithHFileLink=369851c5c3dd6d38afc3b2a16e1a3ffc-57336479cdcf48c297824f71584356ca, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/family1/testCompactionWithHFileLink=369851c5c3dd6d38afc3b2a16e1a3ffc-28a38cf350244da7830c9753b7964958, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/family1/testCompactionWithHFileLink=369851c5c3dd6d38afc3b2a16e1a3ffc-87d4d7959ed5460db9686869a40435c0, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/family1/testCompactionWithHFileLink=369851c5c3dd6d38afc3b2a16e1a3ffc-cc7410dc341d435da9efadbba79ec3d5] to archive 2023-02-12 03:55:14,879 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-12 03:55:14,881 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/family1/testCompactionWithHFileLink=369851c5c3dd6d38afc3b2a16e1a3ffc-57336479cdcf48c297824f71584356ca to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/family1/testCompactionWithHFileLink=369851c5c3dd6d38afc3b2a16e1a3ffc-57336479cdcf48c297824f71584356ca 2023-02-12 03:55:14,883 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/family1/testCompactionWithHFileLink=369851c5c3dd6d38afc3b2a16e1a3ffc-28a38cf350244da7830c9753b7964958 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/family1/testCompactionWithHFileLink=369851c5c3dd6d38afc3b2a16e1a3ffc-28a38cf350244da7830c9753b7964958 2023-02-12 03:55:14,884 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/family1/testCompactionWithHFileLink=369851c5c3dd6d38afc3b2a16e1a3ffc-87d4d7959ed5460db9686869a40435c0 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/family1/testCompactionWithHFileLink=369851c5c3dd6d38afc3b2a16e1a3ffc-87d4d7959ed5460db9686869a40435c0 2023-02-12 03:55:14,885 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/family1/testCompactionWithHFileLink=369851c5c3dd6d38afc3b2a16e1a3ffc-cc7410dc341d435da9efadbba79ec3d5 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/family1/testCompactionWithHFileLink=369851c5c3dd6d38afc3b2a16e1a3ffc-cc7410dc341d435da9efadbba79ec3d5 2023-02-12 03:55:14,895 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=108 updating hbase:meta row=5de519c4afe22c04111a6724c632530e, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:14,895 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=413323817eab6eca83ffbd861a4ef441, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:14,895 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=7a34b5c93155c75d8e84f8d88f767143, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:14,895 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,2,1676174113888.5de519c4afe22c04111a6724c632530e.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1676174114895"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676174114895"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676174114895"}]},"ts":"1676174114895"} 2023-02-12 03:55:14,896 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,,1676174113888.7a34b5c93155c75d8e84f8d88f767143.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1676174114895"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676174114895"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676174114895"}]},"ts":"1676174114895"} 2023-02-12 03:55:14,895 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,1,1676174113888.413323817eab6eca83ffbd861a4ef441.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1676174114895"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676174114895"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676174114895"}]},"ts":"1676174114895"} 2023-02-12 03:55:14,898 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=109, ppid=108, state=RUNNABLE; OpenRegionProcedure 5de519c4afe22c04111a6724c632530e, server=jenkins-hbase20.apache.org,39639,1676173982450}] 2023-02-12 03:55:14,898 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=110, ppid=106, state=RUNNABLE; OpenRegionProcedure 7a34b5c93155c75d8e84f8d88f767143, server=jenkins-hbase20.apache.org,39639,1676173982450}] 2023-02-12 03:55:14,899 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=111, ppid=107, state=RUNNABLE; OpenRegionProcedure 413323817eab6eca83ffbd861a4ef441, server=jenkins-hbase20.apache.org,39639,1676173982450}] 2023-02-12 03:55:15,001 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40099] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-02-12 03:55:15,054 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open ns:testMinorCompaction,1,1676174113888.413323817eab6eca83ffbd861a4ef441. 2023-02-12 03:55:15,054 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 413323817eab6eca83ffbd861a4ef441, NAME => 'ns:testMinorCompaction,1,1676174113888.413323817eab6eca83ffbd861a4ef441.', STARTKEY => '1', ENDKEY => '2'} 2023-02-12 03:55:15,054 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction 413323817eab6eca83ffbd861a4ef441 2023-02-12 03:55:15,054 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated ns:testMinorCompaction,1,1676174113888.413323817eab6eca83ffbd861a4ef441.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:55:15,054 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 413323817eab6eca83ffbd861a4ef441 2023-02-12 03:55:15,054 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 413323817eab6eca83ffbd861a4ef441 2023-02-12 03:55:15,057 INFO [StoreOpener-413323817eab6eca83ffbd861a4ef441-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 413323817eab6eca83ffbd861a4ef441 2023-02-12 03:55:15,059 DEBUG [StoreOpener-413323817eab6eca83ffbd861a4ef441-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/413323817eab6eca83ffbd861a4ef441/family1 2023-02-12 03:55:15,059 DEBUG [StoreOpener-413323817eab6eca83ffbd861a4ef441-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/413323817eab6eca83ffbd861a4ef441/family1 2023-02-12 03:55:15,060 INFO [StoreOpener-413323817eab6eca83ffbd861a4ef441-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 413323817eab6eca83ffbd861a4ef441 columnFamilyName family1 2023-02-12 03:55:15,062 INFO [StoreOpener-413323817eab6eca83ffbd861a4ef441-1] regionserver.HStore(310): Store=413323817eab6eca83ffbd861a4ef441/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:55:15,063 INFO [StoreOpener-413323817eab6eca83ffbd861a4ef441-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 413323817eab6eca83ffbd861a4ef441 2023-02-12 03:55:15,064 DEBUG [StoreOpener-413323817eab6eca83ffbd861a4ef441-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/413323817eab6eca83ffbd861a4ef441/family2 2023-02-12 03:55:15,064 DEBUG [StoreOpener-413323817eab6eca83ffbd861a4ef441-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/413323817eab6eca83ffbd861a4ef441/family2 2023-02-12 03:55:15,065 INFO [StoreOpener-413323817eab6eca83ffbd861a4ef441-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 413323817eab6eca83ffbd861a4ef441 columnFamilyName family2 2023-02-12 03:55:15,066 INFO [StoreOpener-413323817eab6eca83ffbd861a4ef441-1] regionserver.HStore(310): Store=413323817eab6eca83ffbd861a4ef441/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:55:15,067 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/413323817eab6eca83ffbd861a4ef441 2023-02-12 03:55:15,067 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/413323817eab6eca83ffbd861a4ef441 2023-02-12 03:55:15,069 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 03:55:15,071 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 413323817eab6eca83ffbd861a4ef441 2023-02-12 03:55:15,072 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/413323817eab6eca83ffbd861a4ef441/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 03:55:15,073 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 413323817eab6eca83ffbd861a4ef441; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74008517, jitterRate=0.10281284153461456}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 03:55:15,073 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 413323817eab6eca83ffbd861a4ef441: Running coprocessor pre-open hook at 1676174115054Writing region info on filesystem at 1676174115054Initializing all the Stores at 1676174115056 (+2 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676174115056Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676174115056Cleaning up temporary data from old regions at 1676174115068 (+12 ms)Cleaning up detritus from prior splits at 1676174115068Running coprocessor post-open hooks at 1676174115073 (+5 ms)Region opened successfully at 1676174115073 2023-02-12 03:55:15,074 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for ns:testMinorCompaction,1,1676174113888.413323817eab6eca83ffbd861a4ef441., pid=111, masterSystemTime=1676174115050 2023-02-12 03:55:15,075 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for ns:testMinorCompaction,1,1676174113888.413323817eab6eca83ffbd861a4ef441. 2023-02-12 03:55:15,075 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened ns:testMinorCompaction,1,1676174113888.413323817eab6eca83ffbd861a4ef441. 2023-02-12 03:55:15,075 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open ns:testMinorCompaction,2,1676174113888.5de519c4afe22c04111a6724c632530e. 2023-02-12 03:55:15,075 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 5de519c4afe22c04111a6724c632530e, NAME => 'ns:testMinorCompaction,2,1676174113888.5de519c4afe22c04111a6724c632530e.', STARTKEY => '2', ENDKEY => ''} 2023-02-12 03:55:15,075 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=413323817eab6eca83ffbd861a4ef441, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:15,075 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction 5de519c4afe22c04111a6724c632530e 2023-02-12 03:55:15,075 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,1,1676174113888.413323817eab6eca83ffbd861a4ef441.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1676174115075"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676174115075"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676174115075"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676174115075"}]},"ts":"1676174115075"} 2023-02-12 03:55:15,075 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated ns:testMinorCompaction,2,1676174113888.5de519c4afe22c04111a6724c632530e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:55:15,076 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 5de519c4afe22c04111a6724c632530e 2023-02-12 03:55:15,076 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 5de519c4afe22c04111a6724c632530e 2023-02-12 03:55:15,077 INFO [StoreOpener-5de519c4afe22c04111a6724c632530e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 5de519c4afe22c04111a6724c632530e 2023-02-12 03:55:15,078 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=111, resume processing ppid=107 2023-02-12 03:55:15,078 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=111, ppid=107, state=SUCCESS; OpenRegionProcedure 413323817eab6eca83ffbd861a4ef441, server=jenkins-hbase20.apache.org,39639,1676173982450 in 178 msec 2023-02-12 03:55:15,078 DEBUG [StoreOpener-5de519c4afe22c04111a6724c632530e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/5de519c4afe22c04111a6724c632530e/family1 2023-02-12 03:55:15,078 DEBUG [StoreOpener-5de519c4afe22c04111a6724c632530e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/5de519c4afe22c04111a6724c632530e/family1 2023-02-12 03:55:15,078 INFO [StoreOpener-5de519c4afe22c04111a6724c632530e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5de519c4afe22c04111a6724c632530e columnFamilyName family1 2023-02-12 03:55:15,079 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=413323817eab6eca83ffbd861a4ef441, ASSIGN in 339 msec 2023-02-12 03:55:15,079 INFO [StoreOpener-5de519c4afe22c04111a6724c632530e-1] regionserver.HStore(310): Store=5de519c4afe22c04111a6724c632530e/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:55:15,080 INFO [StoreOpener-5de519c4afe22c04111a6724c632530e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 5de519c4afe22c04111a6724c632530e 2023-02-12 03:55:15,081 DEBUG [StoreOpener-5de519c4afe22c04111a6724c632530e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/5de519c4afe22c04111a6724c632530e/family2 2023-02-12 03:55:15,081 DEBUG [StoreOpener-5de519c4afe22c04111a6724c632530e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/5de519c4afe22c04111a6724c632530e/family2 2023-02-12 03:55:15,081 INFO [StoreOpener-5de519c4afe22c04111a6724c632530e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5de519c4afe22c04111a6724c632530e columnFamilyName family2 2023-02-12 03:55:15,082 INFO [StoreOpener-5de519c4afe22c04111a6724c632530e-1] regionserver.HStore(310): Store=5de519c4afe22c04111a6724c632530e/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:55:15,082 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/5de519c4afe22c04111a6724c632530e 2023-02-12 03:55:15,083 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/5de519c4afe22c04111a6724c632530e 2023-02-12 03:55:15,084 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 03:55:15,085 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 5de519c4afe22c04111a6724c632530e 2023-02-12 03:55:15,087 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/5de519c4afe22c04111a6724c632530e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 03:55:15,087 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 5de519c4afe22c04111a6724c632530e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67898395, jitterRate=0.011764928698539734}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 03:55:15,087 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 5de519c4afe22c04111a6724c632530e: Running coprocessor pre-open hook at 1676174115076Writing region info on filesystem at 1676174115076Initializing all the Stores at 1676174115076Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676174115076Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676174115077 (+1 ms)Cleaning up temporary data from old regions at 1676174115083 (+6 ms)Cleaning up detritus from prior splits at 1676174115084 (+1 ms)Running coprocessor post-open hooks at 1676174115087 (+3 ms)Region opened successfully at 1676174115087 2023-02-12 03:55:15,088 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for ns:testMinorCompaction,2,1676174113888.5de519c4afe22c04111a6724c632530e., pid=109, masterSystemTime=1676174115050 2023-02-12 03:55:15,089 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for ns:testMinorCompaction,2,1676174113888.5de519c4afe22c04111a6724c632530e. 2023-02-12 03:55:15,089 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened ns:testMinorCompaction,2,1676174113888.5de519c4afe22c04111a6724c632530e. 2023-02-12 03:55:15,089 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open ns:testMinorCompaction,,1676174113888.7a34b5c93155c75d8e84f8d88f767143. 2023-02-12 03:55:15,090 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 7a34b5c93155c75d8e84f8d88f767143, NAME => 'ns:testMinorCompaction,,1676174113888.7a34b5c93155c75d8e84f8d88f767143.', STARTKEY => '', ENDKEY => '1'} 2023-02-12 03:55:15,090 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=108 updating hbase:meta row=5de519c4afe22c04111a6724c632530e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:15,090 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction 7a34b5c93155c75d8e84f8d88f767143 2023-02-12 03:55:15,090 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,2,1676174113888.5de519c4afe22c04111a6724c632530e.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1676174115090"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676174115090"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676174115090"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676174115090"}]},"ts":"1676174115090"} 2023-02-12 03:55:15,090 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated ns:testMinorCompaction,,1676174113888.7a34b5c93155c75d8e84f8d88f767143.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:55:15,090 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 7a34b5c93155c75d8e84f8d88f767143 2023-02-12 03:55:15,090 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 7a34b5c93155c75d8e84f8d88f767143 2023-02-12 03:55:15,092 INFO [StoreOpener-7a34b5c93155c75d8e84f8d88f767143-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 7a34b5c93155c75d8e84f8d88f767143 2023-02-12 03:55:15,093 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=109, resume processing ppid=108 2023-02-12 03:55:15,093 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=109, ppid=108, state=SUCCESS; OpenRegionProcedure 5de519c4afe22c04111a6724c632530e, server=jenkins-hbase20.apache.org,39639,1676173982450 in 193 msec 2023-02-12 03:55:15,093 DEBUG [StoreOpener-7a34b5c93155c75d8e84f8d88f767143-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/7a34b5c93155c75d8e84f8d88f767143/family1 2023-02-12 03:55:15,093 DEBUG [StoreOpener-7a34b5c93155c75d8e84f8d88f767143-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/7a34b5c93155c75d8e84f8d88f767143/family1 2023-02-12 03:55:15,094 INFO [StoreOpener-7a34b5c93155c75d8e84f8d88f767143-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7a34b5c93155c75d8e84f8d88f767143 columnFamilyName family1 2023-02-12 03:55:15,094 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=108, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=5de519c4afe22c04111a6724c632530e, ASSIGN in 354 msec 2023-02-12 03:55:15,094 INFO [StoreOpener-7a34b5c93155c75d8e84f8d88f767143-1] regionserver.HStore(310): Store=7a34b5c93155c75d8e84f8d88f767143/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:55:15,095 INFO [StoreOpener-7a34b5c93155c75d8e84f8d88f767143-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 7a34b5c93155c75d8e84f8d88f767143 2023-02-12 03:55:15,096 DEBUG [StoreOpener-7a34b5c93155c75d8e84f8d88f767143-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/7a34b5c93155c75d8e84f8d88f767143/family2 2023-02-12 03:55:15,096 DEBUG [StoreOpener-7a34b5c93155c75d8e84f8d88f767143-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/7a34b5c93155c75d8e84f8d88f767143/family2 2023-02-12 03:55:15,097 INFO [StoreOpener-7a34b5c93155c75d8e84f8d88f767143-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7a34b5c93155c75d8e84f8d88f767143 columnFamilyName family2 2023-02-12 03:55:15,097 INFO [StoreOpener-7a34b5c93155c75d8e84f8d88f767143-1] regionserver.HStore(310): Store=7a34b5c93155c75d8e84f8d88f767143/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:55:15,098 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/7a34b5c93155c75d8e84f8d88f767143 2023-02-12 03:55:15,099 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/7a34b5c93155c75d8e84f8d88f767143 2023-02-12 03:55:15,101 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 03:55:15,102 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 7a34b5c93155c75d8e84f8d88f767143 2023-02-12 03:55:15,104 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/7a34b5c93155c75d8e84f8d88f767143/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 03:55:15,104 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 7a34b5c93155c75d8e84f8d88f767143; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61630171, jitterRate=-0.0816388875246048}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 03:55:15,104 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 7a34b5c93155c75d8e84f8d88f767143: Running coprocessor pre-open hook at 1676174115090Writing region info on filesystem at 1676174115090Initializing all the Stores at 1676174115091 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676174115091Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676174115091Cleaning up temporary data from old regions at 1676174115100 (+9 ms)Cleaning up detritus from prior splits at 1676174115100Running coprocessor post-open hooks at 1676174115104 (+4 ms)Region opened successfully at 1676174115104 2023-02-12 03:55:15,105 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for ns:testMinorCompaction,,1676174113888.7a34b5c93155c75d8e84f8d88f767143., pid=110, masterSystemTime=1676174115050 2023-02-12 03:55:15,106 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for ns:testMinorCompaction,,1676174113888.7a34b5c93155c75d8e84f8d88f767143. 2023-02-12 03:55:15,106 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened ns:testMinorCompaction,,1676174113888.7a34b5c93155c75d8e84f8d88f767143. 2023-02-12 03:55:15,107 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=7a34b5c93155c75d8e84f8d88f767143, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:15,107 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,,1676174113888.7a34b5c93155c75d8e84f8d88f767143.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1676174115107"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676174115107"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676174115107"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676174115107"}]},"ts":"1676174115107"} 2023-02-12 03:55:15,111 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=110, resume processing ppid=106 2023-02-12 03:55:15,111 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=110, ppid=106, state=SUCCESS; OpenRegionProcedure 7a34b5c93155c75d8e84f8d88f767143, server=jenkins-hbase20.apache.org,39639,1676173982450 in 211 msec 2023-02-12 03:55:15,113 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=106, resume processing ppid=105 2023-02-12 03:55:15,113 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=7a34b5c93155c75d8e84f8d88f767143, ASSIGN in 372 msec 2023-02-12 03:55:15,113 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-12 03:55:15,114 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"ns:testMinorCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676174115113"}]},"ts":"1676174115113"} 2023-02-12 03:55:15,115 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=ns:testMinorCompaction, state=ENABLED in hbase:meta 2023-02-12 03:55:15,117 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_POST_OPERATION 2023-02-12 03:55:15,119 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=105, state=SUCCESS; CreateTableProcedure table=ns:testMinorCompaction in 1.2280 sec 2023-02-12 03:55:15,619 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/.tmp/family1/2fb8a8454d094522a1347446d3280e05 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/family1/2fb8a8454d094522a1347446d3280e05 2023-02-12 03:55:15,626 INFO [RS:0;jenkins-hbase20:39639-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 5 (all) file(s) in 0e9d0e06e60b6abe7b05797a5112bb5e/family1 of 0e9d0e06e60b6abe7b05797a5112bb5e into 2fb8a8454d094522a1347446d3280e05(size=7.6 K), total size for store is 7.6 K. This selection was in queue for 1sec, and took 0sec to execute. 2023-02-12 03:55:15,626 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 0e9d0e06e60b6abe7b05797a5112bb5e: 2023-02-12 03:55:15,626 INFO [RS:0;jenkins-hbase20:39639-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testCompactionWithHFileLink,1,1676174084167.0e9d0e06e60b6abe7b05797a5112bb5e., storeName=family1, fileCount=5, fileSize=28.9 K (5.4 K, 5.4 K, 5.4 K, 5.4 K, 7.3 K), priority=2, time=1676174113720; duration=0sec 2023-02-12 03:55:15,626 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-12 03:55:15,656 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/family1/testCompactionWithHFileLink=0e9d0e06e60b6abe7b05797a5112bb5e-ca25e354821f41239297823f77effa98, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/family1/testCompactionWithHFileLink=0e9d0e06e60b6abe7b05797a5112bb5e-1680fc2fd19047b9a4d476b5505a9420, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/family1/testCompactionWithHFileLink=0e9d0e06e60b6abe7b05797a5112bb5e-ad5e5cac5663442fb628697e0ac1cb74, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/family1/testCompactionWithHFileLink=0e9d0e06e60b6abe7b05797a5112bb5e-3cd14dd59fa842fba2f6ca863062ef1f, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/family1/4ba48b0ee1a1424cb46dd72feb678b50_SeqId_34_] to archive 2023-02-12 03:55:15,658 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-12 03:55:15,661 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/family1/testCompactionWithHFileLink=0e9d0e06e60b6abe7b05797a5112bb5e-ca25e354821f41239297823f77effa98 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/family1/testCompactionWithHFileLink=0e9d0e06e60b6abe7b05797a5112bb5e-ca25e354821f41239297823f77effa98 2023-02-12 03:55:15,664 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/family1/testCompactionWithHFileLink=0e9d0e06e60b6abe7b05797a5112bb5e-1680fc2fd19047b9a4d476b5505a9420 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/family1/testCompactionWithHFileLink=0e9d0e06e60b6abe7b05797a5112bb5e-1680fc2fd19047b9a4d476b5505a9420 2023-02-12 03:55:15,667 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/family1/testCompactionWithHFileLink=0e9d0e06e60b6abe7b05797a5112bb5e-ad5e5cac5663442fb628697e0ac1cb74 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/family1/testCompactionWithHFileLink=0e9d0e06e60b6abe7b05797a5112bb5e-ad5e5cac5663442fb628697e0ac1cb74 2023-02-12 03:55:15,670 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/family1/testCompactionWithHFileLink=0e9d0e06e60b6abe7b05797a5112bb5e-3cd14dd59fa842fba2f6ca863062ef1f to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/family1/testCompactionWithHFileLink=0e9d0e06e60b6abe7b05797a5112bb5e-3cd14dd59fa842fba2f6ca863062ef1f 2023-02-12 03:55:15,671 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/family1/4ba48b0ee1a1424cb46dd72feb678b50_SeqId_34_ to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/family1/4ba48b0ee1a1424cb46dd72feb678b50_SeqId_34_ 2023-02-12 03:55:16,002 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40099] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-02-12 03:55:16,003 INFO [Listener at localhost.localdomain/41049] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: ns:testMinorCompaction, procId: 105 completed 2023-02-12 03:55:16,012 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39639] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,,1676174113888.7a34b5c93155c75d8e84f8d88f767143. with WAL disabled. Data may be lost in the event of a crash. 2023-02-12 03:55:16,013 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39639] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,1,1676174113888.413323817eab6eca83ffbd861a4ef441. with WAL disabled. Data may be lost in the event of a crash. 2023-02-12 03:55:16,013 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39639] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,2,1676174113888.5de519c4afe22c04111a6724c632530e. with WAL disabled. Data may be lost in the event of a crash. 2023-02-12 03:55:16,018 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40099] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-12 03:55:16,021 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40099] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-02-12 03:55:16,021 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-02-12 03:55:16,021 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:55:16,021 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-02-12 03:55:16,021 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-02-12 03:55:16,022 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-12 03:55:16,022 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-12 03:55:16,023 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:55:16,023 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:16,023 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:55:16,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:55:16,024 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:16,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-12 03:55:16,024 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-12 03:55:16,024 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-12 03:55:16,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-12 03:55:16,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-12 03:55:16,025 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-02-12 03:55:16,026 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-02-12 03:55:16,026 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-02-12 03:55:16,026 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:55:16,026 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-02-12 03:55:16,026 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1676174113888.5de519c4afe22c04111a6724c632530e. 2023-02-12 03:55:16,027 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1676174113888.413323817eab6eca83ffbd861a4ef441. 2023-02-12 03:55:16,027 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1676174113888.7a34b5c93155c75d8e84f8d88f767143. 2023-02-12 03:55:16,027 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1676174113888.5de519c4afe22c04111a6724c632530e. started... 2023-02-12 03:55:16,027 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-12 03:55:16,027 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-12 03:55:16,027 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1676174113888.7a34b5c93155c75d8e84f8d88f767143. started... 2023-02-12 03:55:16,029 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 5de519c4afe22c04111a6724c632530e 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-02-12 03:55:16,029 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 7a34b5c93155c75d8e84f8d88f767143 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-02-12 03:55:16,027 DEBUG [RS:0;jenkins-hbase20:39639-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/.tmp/family2/939c19c38841456ea1a7e4b2ed1fda5f as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/family2/939c19c38841456ea1a7e4b2ed1fda5f 2023-02-12 03:55:16,027 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1676174113888.413323817eab6eca83ffbd861a4ef441. started... 2023-02-12 03:55:16,029 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 413323817eab6eca83ffbd861a4ef441 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-02-12 03:55:16,035 INFO [RS:0;jenkins-hbase20:39639-longCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in 369851c5c3dd6d38afc3b2a16e1a3ffc/family2 of 369851c5c3dd6d38afc3b2a16e1a3ffc into 939c19c38841456ea1a7e4b2ed1fda5f(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-12 03:55:16,035 DEBUG [RS:0;jenkins-hbase20:39639-longCompactions-0] regionserver.HRegion(2288): Compaction status journal for 369851c5c3dd6d38afc3b2a16e1a3ffc: 2023-02-12 03:55:16,035 INFO [RS:0;jenkins-hbase20:39639-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,2,1676174084167.369851c5c3dd6d38afc3b2a16e1a3ffc., storeName=369851c5c3dd6d38afc3b2a16e1a3ffc/family2, priority=12, startTime=1676174112316; duration=1sec 2023-02-12 03:55:16,036 DEBUG [RS:0;jenkins-hbase20:39639-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-12 03:55:16,043 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023021223724521fbfd4ee7b0a6aa102a84e607 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b2023021223724521fbfd4ee7b0a6aa102a84e607 2023-02-12 03:55:16,050 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/family2/testCompactionWithHFileLink=369851c5c3dd6d38afc3b2a16e1a3ffc-fef2cc5193ee4c29bf399d13cb8afa3b, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/family2/testCompactionWithHFileLink=369851c5c3dd6d38afc3b2a16e1a3ffc-e45c7d1c8c914c029f7acb4750386b15, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/family2/testCompactionWithHFileLink=369851c5c3dd6d38afc3b2a16e1a3ffc-0ee9478488594ba3b7336e26366747b1, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/family2/testCompactionWithHFileLink=369851c5c3dd6d38afc3b2a16e1a3ffc-46d19779813b4d9e825a09db392f3515] to archive 2023-02-12 03:55:16,051 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-12 03:55:16,052 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/family2/testCompactionWithHFileLink=369851c5c3dd6d38afc3b2a16e1a3ffc-fef2cc5193ee4c29bf399d13cb8afa3b to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/family2/testCompactionWithHFileLink=369851c5c3dd6d38afc3b2a16e1a3ffc-fef2cc5193ee4c29bf399d13cb8afa3b 2023-02-12 03:55:16,053 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/family2/testCompactionWithHFileLink=369851c5c3dd6d38afc3b2a16e1a3ffc-e45c7d1c8c914c029f7acb4750386b15 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/family2/testCompactionWithHFileLink=369851c5c3dd6d38afc3b2a16e1a3ffc-e45c7d1c8c914c029f7acb4750386b15 2023-02-12 03:55:16,054 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/family2/testCompactionWithHFileLink=369851c5c3dd6d38afc3b2a16e1a3ffc-0ee9478488594ba3b7336e26366747b1 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/family2/testCompactionWithHFileLink=369851c5c3dd6d38afc3b2a16e1a3ffc-0ee9478488594ba3b7336e26366747b1 2023-02-12 03:55:16,055 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/family2/testCompactionWithHFileLink=369851c5c3dd6d38afc3b2a16e1a3ffc-46d19779813b4d9e825a09db392f3515 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/family2/testCompactionWithHFileLink=369851c5c3dd6d38afc3b2a16e1a3ffc-46d19779813b4d9e825a09db392f3515 2023-02-12 03:55:16,081 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'ns:testMinorCompaction' 2023-02-12 03:55:16,446 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202302122ee956260f15416e99abc6f45f5646e1 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e202302122ee956260f15416e99abc6f45f5646e1 2023-02-12 03:55:16,448 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/413323817eab6eca83ffbd861a4ef441/.tmp/family1/832d59efaf24449d96673e90a22abe07 2023-02-12 03:55:16,453 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/7a34b5c93155c75d8e84f8d88f767143/.tmp/family1/d5a67bd19dc14108bd19f1fb7c83c99b 2023-02-12 03:55:16,453 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230212a5bd52694a574189afa15be802f39b6e to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20230212a5bd52694a574189afa15be802f39b6e 2023-02-12 03:55:16,470 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202302124f519658c0fd4699bcf1b97194f06780 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b202302124f519658c0fd4699bcf1b97194f06780 2023-02-12 03:55:16,860 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/5de519c4afe22c04111a6724c632530e/.tmp/family1/2396974621db49dbbe7b83f7da4c9173 2023-02-12 03:55:16,877 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230212292eb1a9483f4736a260b128b1c4fbb4 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e20230212292eb1a9483f4736a260b128b1c4fbb4 2023-02-12 03:55:16,877 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/413323817eab6eca83ffbd861a4ef441/.tmp/family2/f61ca03926be43e9bf36143978458e40 2023-02-12 03:55:16,882 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302128ee742b0a85e4adba2f6e86bdc5c8164 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c202302128ee742b0a85e4adba2f6e86bdc5c8164 2023-02-12 03:55:16,883 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/413323817eab6eca83ffbd861a4ef441/.tmp/family1/832d59efaf24449d96673e90a22abe07 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/413323817eab6eca83ffbd861a4ef441/family1/832d59efaf24449d96673e90a22abe07 2023-02-12 03:55:16,887 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/413323817eab6eca83ffbd861a4ef441/family1/832d59efaf24449d96673e90a22abe07, entries=4, sequenceid=5, filesize=5.4 K 2023-02-12 03:55:16,887 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/413323817eab6eca83ffbd861a4ef441/.tmp/family2/f61ca03926be43e9bf36143978458e40 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/413323817eab6eca83ffbd861a4ef441/family2/f61ca03926be43e9bf36143978458e40 2023-02-12 03:55:16,891 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/413323817eab6eca83ffbd861a4ef441/family2/f61ca03926be43e9bf36143978458e40, entries=2, sequenceid=5, filesize=5.1 K 2023-02-12 03:55:16,892 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 413323817eab6eca83ffbd861a4ef441 in 863ms, sequenceid=5, compaction requested=false 2023-02-12 03:55:16,892 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 413323817eab6eca83ffbd861a4ef441: 2023-02-12 03:55:16,892 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1676174113888.413323817eab6eca83ffbd861a4ef441. 2023-02-12 03:55:16,892 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-12 03:55:17,284 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/7a34b5c93155c75d8e84f8d88f767143/.tmp/family2/c65ae910683f419dbde3edb1607290b6 2023-02-12 03:55:17,287 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/5de519c4afe22c04111a6724c632530e/.tmp/family2/f58d16e17bd14bf3bbaa45a2a67776c2 2023-02-12 03:55:17,290 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/7a34b5c93155c75d8e84f8d88f767143/.tmp/family1/d5a67bd19dc14108bd19f1fb7c83c99b as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/7a34b5c93155c75d8e84f8d88f767143/family1/d5a67bd19dc14108bd19f1fb7c83c99b 2023-02-12 03:55:17,293 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/5de519c4afe22c04111a6724c632530e/.tmp/family1/2396974621db49dbbe7b83f7da4c9173 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/5de519c4afe22c04111a6724c632530e/family1/2396974621db49dbbe7b83f7da4c9173 2023-02-12 03:55:17,295 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/7a34b5c93155c75d8e84f8d88f767143/family1/d5a67bd19dc14108bd19f1fb7c83c99b, entries=4, sequenceid=5, filesize=5.4 K 2023-02-12 03:55:17,296 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/7a34b5c93155c75d8e84f8d88f767143/.tmp/family2/c65ae910683f419dbde3edb1607290b6 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/7a34b5c93155c75d8e84f8d88f767143/family2/c65ae910683f419dbde3edb1607290b6 2023-02-12 03:55:17,298 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/5de519c4afe22c04111a6724c632530e/family1/2396974621db49dbbe7b83f7da4c9173, entries=4, sequenceid=5, filesize=5.4 K 2023-02-12 03:55:17,299 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/5de519c4afe22c04111a6724c632530e/.tmp/family2/f58d16e17bd14bf3bbaa45a2a67776c2 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/5de519c4afe22c04111a6724c632530e/family2/f58d16e17bd14bf3bbaa45a2a67776c2 2023-02-12 03:55:17,301 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/7a34b5c93155c75d8e84f8d88f767143/family2/c65ae910683f419dbde3edb1607290b6, entries=2, sequenceid=5, filesize=5.1 K 2023-02-12 03:55:17,302 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 7a34b5c93155c75d8e84f8d88f767143 in 1273ms, sequenceid=5, compaction requested=false 2023-02-12 03:55:17,302 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 7a34b5c93155c75d8e84f8d88f767143: 2023-02-12 03:55:17,302 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1676174113888.7a34b5c93155c75d8e84f8d88f767143. 2023-02-12 03:55:17,302 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-12 03:55:17,303 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/5de519c4afe22c04111a6724c632530e/family2/f58d16e17bd14bf3bbaa45a2a67776c2, entries=2, sequenceid=5, filesize=5.1 K 2023-02-12 03:55:17,304 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 5de519c4afe22c04111a6724c632530e in 1275ms, sequenceid=5, compaction requested=false 2023-02-12 03:55:17,304 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 5de519c4afe22c04111a6724c632530e: 2023-02-12 03:55:17,304 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1676174113888.5de519c4afe22c04111a6724c632530e. 2023-02-12 03:55:17,304 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-12 03:55:17,304 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-12 03:55:17,304 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:17,304 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-02-12 03:55:17,304 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-02-12 03:55:17,306 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:17,306 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-12 03:55:17,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:17,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:55:17,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:55:17,306 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-12 03:55:17,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:55:17,306 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 03:55:17,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:55:17,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-12 03:55:17,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:17,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:55:17,308 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-02-12 03:55:17,308 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2e89829d[Count = 0] remaining members to acquire global barrier 2023-02-12 03:55:17,308 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-02-12 03:55:17,308 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-12 03:55:17,309 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-12 03:55:17,309 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-12 03:55:17,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-12 03:55:17,309 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-02-12 03:55:17,309 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:17,309 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-12 03:55:17,309 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-02-12 03:55:17,309 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase20.apache.org,39639,1676173982450' in zk 2023-02-12 03:55:17,310 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:17,310 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-02-12 03:55:17,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:17,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:55:17,310 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:55:17,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:55:17,310 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-02-12 03:55:17,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:55:17,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:55:17,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-12 03:55:17,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:17,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:55:17,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-12 03:55:17,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:17,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase20.apache.org,39639,1676173982450': 2023-02-12 03:55:17,313 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-02-12 03:55:17,313 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-02-12 03:55:17,313 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-12 03:55:17,313 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-12 03:55:17,313 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-02-12 03:55:17,313 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-12 03:55:17,314 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-12 03:55:17,314 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-12 03:55:17,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-12 03:55:17,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:55:17,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:55:17,314 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-12 03:55:17,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-12 03:55:17,314 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:55:17,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:55:17,315 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:55:17,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:55:17,315 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:17,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-12 03:55:17,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-12 03:55:17,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:55:17,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-12 03:55:17,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:17,316 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:17,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:55:17,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-12 03:55:17,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:17,318 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:55:17,318 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:17,318 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:55:17,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:55:17,318 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40099] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-02-12 03:55:17,318 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40099] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-12 03:55:17,318 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:55:17,318 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:55:17,318 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-12 03:55:17,318 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:55:17,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:55:17,318 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-12 03:55:17,318 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-02-12 03:55:17,318 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:17,319 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-12 03:55:17,319 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-12 03:55:17,319 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-12 03:55:17,319 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-12 03:55:17,419 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-12 03:55:17,421 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40099] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-12 03:55:17,424 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39639] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,,1676174113888.7a34b5c93155c75d8e84f8d88f767143. with WAL disabled. Data may be lost in the event of a crash. 2023-02-12 03:55:17,425 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39639] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,1,1676174113888.413323817eab6eca83ffbd861a4ef441. with WAL disabled. Data may be lost in the event of a crash. 2023-02-12 03:55:17,425 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39639] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,2,1676174113888.5de519c4afe22c04111a6724c632530e. with WAL disabled. Data may be lost in the event of a crash. 2023-02-12 03:55:17,430 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40099] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-12 03:55:17,433 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40099] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-02-12 03:55:17,433 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40099] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-02-12 03:55:17,433 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-02-12 03:55:17,433 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:55:17,433 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-02-12 03:55:17,433 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-02-12 03:55:17,434 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-12 03:55:17,434 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-12 03:55:17,436 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:17,436 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:55:17,436 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:55:17,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:55:17,436 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:17,437 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-12 03:55:17,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-12 03:55:17,438 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-12 03:55:17,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-12 03:55:17,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-12 03:55:17,438 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-02-12 03:55:17,439 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-02-12 03:55:17,439 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-02-12 03:55:17,439 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-02-12 03:55:17,439 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:55:17,439 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-02-12 03:55:17,440 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1676174113888.5de519c4afe22c04111a6724c632530e. 2023-02-12 03:55:17,440 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1676174113888.5de519c4afe22c04111a6724c632530e. started... 2023-02-12 03:55:17,440 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1676174113888.413323817eab6eca83ffbd861a4ef441. 2023-02-12 03:55:17,440 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-12 03:55:17,440 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-12 03:55:17,440 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1676174113888.413323817eab6eca83ffbd861a4ef441. started... 2023-02-12 03:55:17,440 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1676174113888.7a34b5c93155c75d8e84f8d88f767143. 2023-02-12 03:55:17,440 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 413323817eab6eca83ffbd861a4ef441 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-02-12 03:55:17,440 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 5de519c4afe22c04111a6724c632530e 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-02-12 03:55:17,440 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1676174113888.7a34b5c93155c75d8e84f8d88f767143. started... 2023-02-12 03:55:17,441 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 7a34b5c93155c75d8e84f8d88f767143 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-02-12 03:55:17,459 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230212c9899411d3974112968817fd84f98b9c to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20230212c9899411d3974112968817fd84f98b9c 2023-02-12 03:55:17,610 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-12 03:55:17,641 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-12 03:55:17,641 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1d1b1480 to 127.0.0.1:59556 2023-02-12 03:55:17,641 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 03:55:17,642 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-12 03:55:17,642 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5863e3a3 to 127.0.0.1:59556 2023-02-12 03:55:17,642 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 03:55:17,864 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/5de519c4afe22c04111a6724c632530e/.tmp/family1/ea385b501a774fb29cd07747b4f52235 2023-02-12 03:55:17,866 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202302121150023f5a44478996c7830ed71bc2de to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b202302121150023f5a44478996c7830ed71bc2de 2023-02-12 03:55:17,866 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202302120aaf0ba852674f7685445d48fa653beb to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e202302120aaf0ba852674f7685445d48fa653beb 2023-02-12 03:55:18,276 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/413323817eab6eca83ffbd861a4ef441/.tmp/family1/10f396331bbd4cfbb06425f2b18de8fa 2023-02-12 03:55:18,277 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/7a34b5c93155c75d8e84f8d88f767143/.tmp/family1/68a6d59ad9364b048a47cfc87a2099a8 2023-02-12 03:55:18,287 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230212234cbfc5d4e3446489fa4e8a289a7f81 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c20230212234cbfc5d4e3446489fa4e8a289a7f81 2023-02-12 03:55:18,694 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/5de519c4afe22c04111a6724c632530e/.tmp/family2/a00e3c9ec42d46868119e561ba373f6f 2023-02-12 03:55:18,703 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230212c57c7b6f4e2d4e0bb0b517cc1966b605 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b20230212c57c7b6f4e2d4e0bb0b517cc1966b605 2023-02-12 03:55:18,704 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/5de519c4afe22c04111a6724c632530e/.tmp/family1/ea385b501a774fb29cd07747b4f52235 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/5de519c4afe22c04111a6724c632530e/family1/ea385b501a774fb29cd07747b4f52235 2023-02-12 03:55:18,705 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230212821b7081a4054672a77a2de393163c82 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e20230212821b7081a4054672a77a2de393163c82 2023-02-12 03:55:18,710 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/5de519c4afe22c04111a6724c632530e/family1/ea385b501a774fb29cd07747b4f52235, entries=4, sequenceid=9, filesize=5.4 K 2023-02-12 03:55:18,710 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/5de519c4afe22c04111a6724c632530e/.tmp/family2/a00e3c9ec42d46868119e561ba373f6f as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/5de519c4afe22c04111a6724c632530e/family2/a00e3c9ec42d46868119e561ba373f6f 2023-02-12 03:55:18,713 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/5de519c4afe22c04111a6724c632530e/family2/a00e3c9ec42d46868119e561ba373f6f, entries=2, sequenceid=9, filesize=5.1 K 2023-02-12 03:55:18,714 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 5de519c4afe22c04111a6724c632530e in 1274ms, sequenceid=9, compaction requested=false 2023-02-12 03:55:18,714 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 5de519c4afe22c04111a6724c632530e: 2023-02-12 03:55:18,714 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1676174113888.5de519c4afe22c04111a6724c632530e. 2023-02-12 03:55:18,714 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-12 03:55:19,110 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/7a34b5c93155c75d8e84f8d88f767143/.tmp/family2/fd0e0d925d7b4b2585f6227a736b5f62 2023-02-12 03:55:19,111 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/413323817eab6eca83ffbd861a4ef441/.tmp/family2/0a4a526f21ac4440ac3be438652169ca 2023-02-12 03:55:19,118 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/7a34b5c93155c75d8e84f8d88f767143/.tmp/family1/68a6d59ad9364b048a47cfc87a2099a8 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/7a34b5c93155c75d8e84f8d88f767143/family1/68a6d59ad9364b048a47cfc87a2099a8 2023-02-12 03:55:19,119 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/413323817eab6eca83ffbd861a4ef441/.tmp/family1/10f396331bbd4cfbb06425f2b18de8fa as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/413323817eab6eca83ffbd861a4ef441/family1/10f396331bbd4cfbb06425f2b18de8fa 2023-02-12 03:55:19,124 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/413323817eab6eca83ffbd861a4ef441/family1/10f396331bbd4cfbb06425f2b18de8fa, entries=4, sequenceid=9, filesize=5.4 K 2023-02-12 03:55:19,124 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/7a34b5c93155c75d8e84f8d88f767143/family1/68a6d59ad9364b048a47cfc87a2099a8, entries=4, sequenceid=9, filesize=5.4 K 2023-02-12 03:55:19,125 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/413323817eab6eca83ffbd861a4ef441/.tmp/family2/0a4a526f21ac4440ac3be438652169ca as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/413323817eab6eca83ffbd861a4ef441/family2/0a4a526f21ac4440ac3be438652169ca 2023-02-12 03:55:19,125 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/7a34b5c93155c75d8e84f8d88f767143/.tmp/family2/fd0e0d925d7b4b2585f6227a736b5f62 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/7a34b5c93155c75d8e84f8d88f767143/family2/fd0e0d925d7b4b2585f6227a736b5f62 2023-02-12 03:55:19,132 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/7a34b5c93155c75d8e84f8d88f767143/family2/fd0e0d925d7b4b2585f6227a736b5f62, entries=2, sequenceid=9, filesize=5.1 K 2023-02-12 03:55:19,132 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/413323817eab6eca83ffbd861a4ef441/family2/0a4a526f21ac4440ac3be438652169ca, entries=2, sequenceid=9, filesize=5.1 K 2023-02-12 03:55:19,133 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 7a34b5c93155c75d8e84f8d88f767143 in 1692ms, sequenceid=9, compaction requested=false 2023-02-12 03:55:19,133 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 413323817eab6eca83ffbd861a4ef441 in 1693ms, sequenceid=9, compaction requested=false 2023-02-12 03:55:19,133 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 7a34b5c93155c75d8e84f8d88f767143: 2023-02-12 03:55:19,133 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 413323817eab6eca83ffbd861a4ef441: 2023-02-12 03:55:19,133 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1676174113888.7a34b5c93155c75d8e84f8d88f767143. 2023-02-12 03:55:19,133 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1676174113888.413323817eab6eca83ffbd861a4ef441. 2023-02-12 03:55:19,133 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-12 03:55:19,133 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-12 03:55:19,133 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-12 03:55:19,133 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:19,133 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-02-12 03:55:19,133 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-02-12 03:55:19,135 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:19,135 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-12 03:55:19,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:19,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:55:19,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:55:19,136 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-12 03:55:19,136 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 03:55:19,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:55:19,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:55:19,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-12 03:55:19,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:19,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:55:19,137 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-02-12 03:55:19,137 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@76868067[Count = 0] remaining members to acquire global barrier 2023-02-12 03:55:19,137 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-02-12 03:55:19,137 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-12 03:55:19,138 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-12 03:55:19,138 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-12 03:55:19,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-12 03:55:19,138 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-02-12 03:55:19,138 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-02-12 03:55:19,138 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase20.apache.org,39639,1676173982450' in zk 2023-02-12 03:55:19,138 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:19,138 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-12 03:55:19,138 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:19,138 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-02-12 03:55:19,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:19,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:55:19,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:55:19,138 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:55:19,139 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-02-12 03:55:19,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:55:19,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:55:19,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-12 03:55:19,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:19,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:55:19,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-12 03:55:19,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:19,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase20.apache.org,39639,1676173982450': 2023-02-12 03:55:19,140 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-02-12 03:55:19,140 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-02-12 03:55:19,140 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-12 03:55:19,140 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-12 03:55:19,141 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-02-12 03:55:19,141 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-12 03:55:19,141 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-12 03:55:19,141 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:55:19,142 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-12 03:55:19,142 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-12 03:55:19,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-12 03:55:19,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-12 03:55:19,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:55:19,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:55:19,142 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:55:19,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:55:19,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:55:19,142 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:19,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-12 03:55:19,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-12 03:55:19,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:55:19,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-12 03:55:19,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:19,143 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:19,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:55:19,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-12 03:55:19,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:19,145 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:55:19,145 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:55:19,145 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:55:19,145 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:55:19,145 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:19,145 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40099] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-02-12 03:55:19,145 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40099] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-12 03:55:19,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:55:19,145 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-12 03:55:19,145 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-12 03:55:19,145 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:19,145 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-12 03:55:19,145 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-12 03:55:19,145 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-12 03:55:19,145 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-02-12 03:55:19,145 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-12 03:55:19,145 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:55:19,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:55:19,245 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-12 03:55:19,247 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40099] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-12 03:55:19,249 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39639] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,,1676174113888.7a34b5c93155c75d8e84f8d88f767143. with WAL disabled. Data may be lost in the event of a crash. 2023-02-12 03:55:19,250 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39639] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,1,1676174113888.413323817eab6eca83ffbd861a4ef441. with WAL disabled. Data may be lost in the event of a crash. 2023-02-12 03:55:19,250 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39639] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,2,1676174113888.5de519c4afe22c04111a6724c632530e. with WAL disabled. Data may be lost in the event of a crash. 2023-02-12 03:55:19,257 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40099] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-12 03:55:19,261 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40099] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-02-12 03:55:19,261 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40099] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-02-12 03:55:19,261 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-02-12 03:55:19,261 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:55:19,261 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-02-12 03:55:19,261 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-02-12 03:55:19,262 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-12 03:55:19,263 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-12 03:55:19,264 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:19,264 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:55:19,265 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:55:19,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:55:19,265 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:19,265 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-12 03:55:19,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-12 03:55:19,267 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-12 03:55:19,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-12 03:55:19,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-12 03:55:19,268 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-02-12 03:55:19,269 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-02-12 03:55:19,269 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-02-12 03:55:19,269 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-02-12 03:55:19,269 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:55:19,269 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-02-12 03:55:19,269 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1676174113888.5de519c4afe22c04111a6724c632530e. 2023-02-12 03:55:19,269 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1676174113888.413323817eab6eca83ffbd861a4ef441. 2023-02-12 03:55:19,270 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1676174113888.413323817eab6eca83ffbd861a4ef441. started... 2023-02-12 03:55:19,269 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1676174113888.5de519c4afe22c04111a6724c632530e. started... 2023-02-12 03:55:19,270 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1676174113888.7a34b5c93155c75d8e84f8d88f767143. 2023-02-12 03:55:19,270 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-12 03:55:19,270 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-12 03:55:19,270 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1676174113888.7a34b5c93155c75d8e84f8d88f767143. started... 2023-02-12 03:55:19,270 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 5de519c4afe22c04111a6724c632530e 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-02-12 03:55:19,270 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 7a34b5c93155c75d8e84f8d88f767143 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-02-12 03:55:19,270 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 413323817eab6eca83ffbd861a4ef441 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-02-12 03:55:19,693 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230212e1a670d343134c0b899a8ea3236ec96c to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20230212e1a670d343134c0b899a8ea3236ec96c 2023-02-12 03:55:19,694 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202302122d1d83c867b5454b831cc7d8f187b771 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b202302122d1d83c867b5454b831cc7d8f187b771 2023-02-12 03:55:19,694 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202302122a942eb76a34462d83dd06f79db0c7d8 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e202302122a942eb76a34462d83dd06f79db0c7d8 2023-02-12 03:55:19,701 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/7a34b5c93155c75d8e84f8d88f767143/.tmp/family1/ce6804d638004a29b4648cb9e995b5e6 2023-02-12 03:55:20,101 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/5de519c4afe22c04111a6724c632530e/.tmp/family1/f173a8ce3f934ac59d272b9d99e161ea 2023-02-12 03:55:20,102 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/413323817eab6eca83ffbd861a4ef441/.tmp/family1/5aac6f01463244d1ada07b5ccd637ab2 2023-02-12 03:55:20,114 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230212a87cb9eade3046b295d7131b94d88067 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e20230212a87cb9eade3046b295d7131b94d88067 2023-02-12 03:55:20,527 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/7a34b5c93155c75d8e84f8d88f767143/.tmp/family2/635f0bcf7c344a6cbdc7d06785123fb3 2023-02-12 03:55:20,535 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230212a96750e3377f4d54bbb57cfe937dba65 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b20230212a96750e3377f4d54bbb57cfe937dba65 2023-02-12 03:55:20,536 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023021244a9b05e3bb047c2ad98be2792e8588c to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c2023021244a9b05e3bb047c2ad98be2792e8588c 2023-02-12 03:55:20,536 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/7a34b5c93155c75d8e84f8d88f767143/.tmp/family1/ce6804d638004a29b4648cb9e995b5e6 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/7a34b5c93155c75d8e84f8d88f767143/family1/ce6804d638004a29b4648cb9e995b5e6 2023-02-12 03:55:20,540 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/7a34b5c93155c75d8e84f8d88f767143/family1/ce6804d638004a29b4648cb9e995b5e6, entries=4, sequenceid=13, filesize=5.4 K 2023-02-12 03:55:20,540 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/7a34b5c93155c75d8e84f8d88f767143/.tmp/family2/635f0bcf7c344a6cbdc7d06785123fb3 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/7a34b5c93155c75d8e84f8d88f767143/family2/635f0bcf7c344a6cbdc7d06785123fb3 2023-02-12 03:55:20,543 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/7a34b5c93155c75d8e84f8d88f767143/family2/635f0bcf7c344a6cbdc7d06785123fb3, entries=2, sequenceid=13, filesize=5.1 K 2023-02-12 03:55:20,544 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 7a34b5c93155c75d8e84f8d88f767143 in 1274ms, sequenceid=13, compaction requested=true 2023-02-12 03:55:20,544 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 7a34b5c93155c75d8e84f8d88f767143: 2023-02-12 03:55:20,544 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1676174113888.7a34b5c93155c75d8e84f8d88f767143. 2023-02-12 03:55:20,544 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-12 03:55:20,941 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/413323817eab6eca83ffbd861a4ef441/.tmp/family2/1c62dfb6cf1f4cfa8c192c0defa791d8 2023-02-12 03:55:20,941 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/5de519c4afe22c04111a6724c632530e/.tmp/family2/45536b2878194c79b7f6597cc3506b63 2023-02-12 03:55:20,950 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/413323817eab6eca83ffbd861a4ef441/.tmp/family1/5aac6f01463244d1ada07b5ccd637ab2 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/413323817eab6eca83ffbd861a4ef441/family1/5aac6f01463244d1ada07b5ccd637ab2 2023-02-12 03:55:20,951 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/5de519c4afe22c04111a6724c632530e/.tmp/family1/f173a8ce3f934ac59d272b9d99e161ea as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/5de519c4afe22c04111a6724c632530e/family1/f173a8ce3f934ac59d272b9d99e161ea 2023-02-12 03:55:20,954 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/413323817eab6eca83ffbd861a4ef441/family1/5aac6f01463244d1ada07b5ccd637ab2, entries=4, sequenceid=13, filesize=5.4 K 2023-02-12 03:55:20,954 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/5de519c4afe22c04111a6724c632530e/family1/f173a8ce3f934ac59d272b9d99e161ea, entries=4, sequenceid=13, filesize=5.4 K 2023-02-12 03:55:20,955 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/413323817eab6eca83ffbd861a4ef441/.tmp/family2/1c62dfb6cf1f4cfa8c192c0defa791d8 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/413323817eab6eca83ffbd861a4ef441/family2/1c62dfb6cf1f4cfa8c192c0defa791d8 2023-02-12 03:55:20,955 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/5de519c4afe22c04111a6724c632530e/.tmp/family2/45536b2878194c79b7f6597cc3506b63 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/5de519c4afe22c04111a6724c632530e/family2/45536b2878194c79b7f6597cc3506b63 2023-02-12 03:55:20,959 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/413323817eab6eca83ffbd861a4ef441/family2/1c62dfb6cf1f4cfa8c192c0defa791d8, entries=2, sequenceid=13, filesize=5.1 K 2023-02-12 03:55:20,959 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/5de519c4afe22c04111a6724c632530e/family2/45536b2878194c79b7f6597cc3506b63, entries=2, sequenceid=13, filesize=5.1 K 2023-02-12 03:55:20,960 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 5de519c4afe22c04111a6724c632530e in 1690ms, sequenceid=13, compaction requested=true 2023-02-12 03:55:20,960 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 413323817eab6eca83ffbd861a4ef441 in 1690ms, sequenceid=13, compaction requested=true 2023-02-12 03:55:20,960 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 5de519c4afe22c04111a6724c632530e: 2023-02-12 03:55:20,960 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 413323817eab6eca83ffbd861a4ef441: 2023-02-12 03:55:20,960 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1676174113888.5de519c4afe22c04111a6724c632530e. 2023-02-12 03:55:20,960 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1676174113888.413323817eab6eca83ffbd861a4ef441. 2023-02-12 03:55:20,960 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-12 03:55:20,960 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-12 03:55:20,960 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-12 03:55:20,960 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:20,960 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-02-12 03:55:20,960 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-02-12 03:55:20,961 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-12 03:55:20,961 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:20,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:20,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:55:20,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:55:20,962 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-12 03:55:20,962 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 03:55:20,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:55:20,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:55:20,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-12 03:55:20,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:20,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:55:20,963 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-02-12 03:55:20,963 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3e2ea33[Count = 0] remaining members to acquire global barrier 2023-02-12 03:55:20,963 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-02-12 03:55:20,963 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-12 03:55:20,964 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-12 03:55:20,964 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-12 03:55:20,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-12 03:55:20,964 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-02-12 03:55:20,964 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-02-12 03:55:20,964 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase20.apache.org,39639,1676173982450' in zk 2023-02-12 03:55:20,964 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:20,964 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-12 03:55:20,965 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-02-12 03:55:20,965 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:20,965 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:55:20,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:20,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:55:20,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:55:20,965 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-02-12 03:55:20,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:55:20,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:55:20,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-12 03:55:20,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:20,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:55:20,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-12 03:55:20,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:20,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase20.apache.org,39639,1676173982450': 2023-02-12 03:55:20,967 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-02-12 03:55:20,967 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-02-12 03:55:20,967 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-12 03:55:20,967 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-12 03:55:20,967 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-02-12 03:55:20,967 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-12 03:55:20,968 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-12 03:55:20,968 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-12 03:55:20,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-12 03:55:20,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:55:20,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:55:20,968 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-12 03:55:20,968 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:55:20,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-12 03:55:20,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:55:20,969 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:20,969 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:55:20,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:55:20,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-12 03:55:20,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-12 03:55:20,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:55:20,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-12 03:55:20,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:20,970 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:20,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:55:20,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-12 03:55:20,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:20,971 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:20,972 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:55:20,972 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-12 03:55:20,972 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:55:20,972 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40099] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-02-12 03:55:20,972 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40099] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-12 03:55:20,972 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:55:20,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:55:20,972 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:55:20,972 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-12 03:55:20,972 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-02-12 03:55:20,972 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:55:20,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:55:20,972 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-12 03:55:20,972 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:20,972 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-12 03:55:20,972 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-12 03:55:20,972 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-12 03:55:21,072 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-12 03:55:21,075 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40099] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-12 03:55:21,077 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39639] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,,1676174113888.7a34b5c93155c75d8e84f8d88f767143. with WAL disabled. Data may be lost in the event of a crash. 2023-02-12 03:55:21,078 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39639] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,1,1676174113888.413323817eab6eca83ffbd861a4ef441. with WAL disabled. Data may be lost in the event of a crash. 2023-02-12 03:55:21,078 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39639] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,2,1676174113888.5de519c4afe22c04111a6724c632530e. with WAL disabled. Data may be lost in the event of a crash. 2023-02-12 03:55:21,084 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40099] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-12 03:55:21,087 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40099] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-02-12 03:55:21,088 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40099] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-02-12 03:55:21,088 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-02-12 03:55:21,088 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:55:21,088 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-02-12 03:55:21,088 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-02-12 03:55:21,088 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-12 03:55:21,088 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-12 03:55:21,089 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:21,089 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:55:21,089 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:55:21,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:55:21,090 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:21,090 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-12 03:55:21,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-12 03:55:21,090 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-12 03:55:21,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-12 03:55:21,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-12 03:55:21,091 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-02-12 03:55:21,091 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-02-12 03:55:21,091 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-02-12 03:55:21,091 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-02-12 03:55:21,091 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:55:21,091 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-02-12 03:55:21,091 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1676174113888.5de519c4afe22c04111a6724c632530e. 2023-02-12 03:55:21,091 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1676174113888.5de519c4afe22c04111a6724c632530e. started... 2023-02-12 03:55:21,091 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1676174113888.413323817eab6eca83ffbd861a4ef441. 2023-02-12 03:55:21,091 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-12 03:55:21,091 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 5de519c4afe22c04111a6724c632530e 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-02-12 03:55:21,091 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1676174113888.7a34b5c93155c75d8e84f8d88f767143. 2023-02-12 03:55:21,091 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1676174113888.7a34b5c93155c75d8e84f8d88f767143. started... 2023-02-12 03:55:21,091 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1676174113888.413323817eab6eca83ffbd861a4ef441. started... 2023-02-12 03:55:21,091 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-12 03:55:21,092 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 413323817eab6eca83ffbd861a4ef441 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-02-12 03:55:21,091 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 7a34b5c93155c75d8e84f8d88f767143 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-02-12 03:55:21,507 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230212df0c8480be754f579a8e7206c2f4c183 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20230212df0c8480be754f579a8e7206c2f4c183 2023-02-12 03:55:21,507 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230212d7f55d11165e4fa78ed06bffd3c21c61 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20230212d7f55d11165e4fa78ed06bffd3c21c61 2023-02-12 03:55:21,507 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202302124c5d6edcbdf540e09b653c2a979ae909 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e202302124c5d6edcbdf540e09b653c2a979ae909 2023-02-12 03:55:21,913 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/7a34b5c93155c75d8e84f8d88f767143/.tmp/family1/2be682d12ba743b89501e18c0c31cc68 2023-02-12 03:55:21,913 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/5de519c4afe22c04111a6724c632530e/.tmp/family1/d0d089dc83c743a9b245f062e86b36f4 2023-02-12 03:55:21,913 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/413323817eab6eca83ffbd861a4ef441/.tmp/family1/d7326f0ad5d74704b81fcac46865683a 2023-02-12 03:55:21,938 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230212a512506dd54e437daa51d3cb48b927e4 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c20230212a512506dd54e437daa51d3cb48b927e4 2023-02-12 03:55:22,342 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/5de519c4afe22c04111a6724c632530e/.tmp/family2/d2e26203596a418f9389766a564b09e6 2023-02-12 03:55:22,345 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230212eb87d7c024f84e9e9ef9c97a5fc3794d to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e20230212eb87d7c024f84e9e9ef9c97a5fc3794d 2023-02-12 03:55:22,345 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230212166c75b874644f7fb61bcfcba3eb4888 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b20230212166c75b874644f7fb61bcfcba3eb4888 2023-02-12 03:55:22,348 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/5de519c4afe22c04111a6724c632530e/.tmp/family1/d0d089dc83c743a9b245f062e86b36f4 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/5de519c4afe22c04111a6724c632530e/family1/d0d089dc83c743a9b245f062e86b36f4 2023-02-12 03:55:22,351 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/7a34b5c93155c75d8e84f8d88f767143/.tmp/family2/9336741833c34731866cca9b98ac422b 2023-02-12 03:55:22,353 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/5de519c4afe22c04111a6724c632530e/family1/d0d089dc83c743a9b245f062e86b36f4, entries=4, sequenceid=17, filesize=5.4 K 2023-02-12 03:55:22,354 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/5de519c4afe22c04111a6724c632530e/.tmp/family2/d2e26203596a418f9389766a564b09e6 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/5de519c4afe22c04111a6724c632530e/family2/d2e26203596a418f9389766a564b09e6 2023-02-12 03:55:22,355 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/7a34b5c93155c75d8e84f8d88f767143/.tmp/family1/2be682d12ba743b89501e18c0c31cc68 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/7a34b5c93155c75d8e84f8d88f767143/family1/2be682d12ba743b89501e18c0c31cc68 2023-02-12 03:55:22,358 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/5de519c4afe22c04111a6724c632530e/family2/d2e26203596a418f9389766a564b09e6, entries=2, sequenceid=17, filesize=5.1 K 2023-02-12 03:55:22,358 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/7a34b5c93155c75d8e84f8d88f767143/family1/2be682d12ba743b89501e18c0c31cc68, entries=4, sequenceid=17, filesize=5.4 K 2023-02-12 03:55:22,359 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 5de519c4afe22c04111a6724c632530e in 1268ms, sequenceid=17, compaction requested=true 2023-02-12 03:55:22,359 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 5de519c4afe22c04111a6724c632530e: 2023-02-12 03:55:22,359 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1676174113888.5de519c4afe22c04111a6724c632530e. 2023-02-12 03:55:22,359 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-12 03:55:22,359 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/7a34b5c93155c75d8e84f8d88f767143/.tmp/family2/9336741833c34731866cca9b98ac422b as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/7a34b5c93155c75d8e84f8d88f767143/family2/9336741833c34731866cca9b98ac422b 2023-02-12 03:55:22,362 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/7a34b5c93155c75d8e84f8d88f767143/family2/9336741833c34731866cca9b98ac422b, entries=2, sequenceid=17, filesize=5.1 K 2023-02-12 03:55:22,363 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 7a34b5c93155c75d8e84f8d88f767143 in 1272ms, sequenceid=17, compaction requested=true 2023-02-12 03:55:22,363 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 7a34b5c93155c75d8e84f8d88f767143: 2023-02-12 03:55:22,363 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1676174113888.7a34b5c93155c75d8e84f8d88f767143. 2023-02-12 03:55:22,363 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-12 03:55:22,752 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/413323817eab6eca83ffbd861a4ef441/.tmp/family2/3bd1cd3e3d3f4536b7d70f0e92ef6cc2 2023-02-12 03:55:22,761 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/413323817eab6eca83ffbd861a4ef441/.tmp/family1/d7326f0ad5d74704b81fcac46865683a as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/413323817eab6eca83ffbd861a4ef441/family1/d7326f0ad5d74704b81fcac46865683a 2023-02-12 03:55:22,768 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/413323817eab6eca83ffbd861a4ef441/family1/d7326f0ad5d74704b81fcac46865683a, entries=4, sequenceid=17, filesize=5.4 K 2023-02-12 03:55:22,769 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/413323817eab6eca83ffbd861a4ef441/.tmp/family2/3bd1cd3e3d3f4536b7d70f0e92ef6cc2 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/413323817eab6eca83ffbd861a4ef441/family2/3bd1cd3e3d3f4536b7d70f0e92ef6cc2 2023-02-12 03:55:22,776 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/413323817eab6eca83ffbd861a4ef441/family2/3bd1cd3e3d3f4536b7d70f0e92ef6cc2, entries=2, sequenceid=17, filesize=5.1 K 2023-02-12 03:55:22,777 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 413323817eab6eca83ffbd861a4ef441 in 1685ms, sequenceid=17, compaction requested=true 2023-02-12 03:55:22,777 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 413323817eab6eca83ffbd861a4ef441: 2023-02-12 03:55:22,777 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1676174113888.413323817eab6eca83ffbd861a4ef441. 2023-02-12 03:55:22,777 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-12 03:55:22,777 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-12 03:55:22,777 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:22,777 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-02-12 03:55:22,777 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-02-12 03:55:22,779 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:22,779 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-12 03:55:22,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:22,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:55:22,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:55:22,779 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-12 03:55:22,779 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 03:55:22,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:55:22,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:55:22,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-12 03:55:22,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:22,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:55:22,782 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-02-12 03:55:22,782 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2f28a92a[Count = 0] remaining members to acquire global barrier 2023-02-12 03:55:22,782 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-02-12 03:55:22,782 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-12 03:55:22,783 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-12 03:55:22,783 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-12 03:55:22,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-12 03:55:22,783 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-02-12 03:55:22,783 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-02-12 03:55:22,783 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase20.apache.org,39639,1676173982450' in zk 2023-02-12 03:55:22,783 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:22,783 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-12 03:55:22,784 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:22,784 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-02-12 03:55:22,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:22,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:55:22,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:55:22,784 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:55:22,785 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-02-12 03:55:22,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:55:22,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:55:22,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-12 03:55:22,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:22,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:55:22,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-12 03:55:22,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:22,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase20.apache.org,39639,1676173982450': 2023-02-12 03:55:22,788 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-02-12 03:55:22,788 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-02-12 03:55:22,788 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-12 03:55:22,788 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-12 03:55:22,788 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-02-12 03:55:22,788 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-12 03:55:22,789 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-12 03:55:22,789 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:55:22,789 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-12 03:55:22,789 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-12 03:55:22,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-12 03:55:22,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-12 03:55:22,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:55:22,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:55:22,789 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:55:22,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:55:22,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:55:22,789 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:22,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-12 03:55:22,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-12 03:55:22,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:55:22,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-12 03:55:22,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:22,790 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:22,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:55:22,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-12 03:55:22,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:22,792 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:22,792 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:55:22,792 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-12 03:55:22,792 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:55:22,792 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:55:22,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:55:22,792 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40099] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-02-12 03:55:22,792 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40099] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-12 03:55:22,792 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:55:22,792 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-12 03:55:22,792 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:22,792 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-12 03:55:22,793 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-12 03:55:22,793 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-12 03:55:22,793 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-02-12 03:55:22,793 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:55:22,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:55:22,793 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-12 03:55:22,793 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-02-12 03:55:22,893 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-12 03:55:22,895 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40099] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-12 03:55:22,913 DEBUG [Listener at localhost.localdomain/41049] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-12 03:55:22,925 DEBUG [Listener at localhost.localdomain/41049] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-12 03:55:22,934 DEBUG [Listener at localhost.localdomain/41049] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-12 03:55:22,935 DEBUG [Listener at localhost.localdomain/41049] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-12 03:55:22,967 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40099] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-12 03:55:22,969 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40099] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-02-12 03:55:22,969 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40099] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-02-12 03:55:22,969 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-02-12 03:55:22,969 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:55:22,969 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-02-12 03:55:22,969 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-02-12 03:55:22,970 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-12 03:55:22,970 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-12 03:55:22,970 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:55:22,970 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:22,970 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:55:22,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:55:22,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-12 03:55:22,971 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:22,972 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-12 03:55:22,971 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-12 03:55:22,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-12 03:55:22,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-12 03:55:22,972 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-02-12 03:55:22,972 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-02-12 03:55:22,972 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-02-12 03:55:22,972 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-02-12 03:55:22,973 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:55:22,973 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-02-12 03:55:22,973 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1676174113888.5de519c4afe22c04111a6724c632530e. 2023-02-12 03:55:22,973 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1676174113888.5de519c4afe22c04111a6724c632530e. started... 2023-02-12 03:55:22,973 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-12 03:55:22,973 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-12 03:55:22,973 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 5de519c4afe22c04111a6724c632530e 2/2 column families, dataSize=138 B heapSize=944 B 2023-02-12 03:55:22,973 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1676174113888.413323817eab6eca83ffbd861a4ef441. 2023-02-12 03:55:22,973 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1676174113888.7a34b5c93155c75d8e84f8d88f767143. 2023-02-12 03:55:22,973 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1676174113888.413323817eab6eca83ffbd861a4ef441. started... 2023-02-12 03:55:22,973 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1676174113888.7a34b5c93155c75d8e84f8d88f767143. started... 2023-02-12 03:55:22,973 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 413323817eab6eca83ffbd861a4ef441 2/2 column families, dataSize=138 B heapSize=944 B 2023-02-12 03:55:22,974 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 7a34b5c93155c75d8e84f8d88f767143 2/2 column families, dataSize=138 B heapSize=944 B 2023-02-12 03:55:23,797 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/7a34b5c93155c75d8e84f8d88f767143/.tmp/family1/88bf9789e4f04475948786fcc44851df 2023-02-12 03:55:23,799 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/5de519c4afe22c04111a6724c632530e/.tmp/family1/a192a1b1dfe94ffd8bf52ed8797342d1 2023-02-12 03:55:23,802 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/413323817eab6eca83ffbd861a4ef441/.tmp/family1/29c4b52b977d460ea996bef2935720e9 2023-02-12 03:55:23,803 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 88bf9789e4f04475948786fcc44851df 2023-02-12 03:55:23,804 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a192a1b1dfe94ffd8bf52ed8797342d1 2023-02-12 03:55:23,806 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 29c4b52b977d460ea996bef2935720e9 2023-02-12 03:55:24,220 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/413323817eab6eca83ffbd861a4ef441/.tmp/family2/52069fb5c87745ff89985f8fe081dee0 2023-02-12 03:55:24,225 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 52069fb5c87745ff89985f8fe081dee0 2023-02-12 03:55:24,226 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/413323817eab6eca83ffbd861a4ef441/.tmp/family1/29c4b52b977d460ea996bef2935720e9 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/413323817eab6eca83ffbd861a4ef441/family1/29c4b52b977d460ea996bef2935720e9 2023-02-12 03:55:24,229 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 29c4b52b977d460ea996bef2935720e9 2023-02-12 03:55:24,230 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/413323817eab6eca83ffbd861a4ef441/family1/29c4b52b977d460ea996bef2935720e9, entries=3, sequenceid=23, filesize=5.0 K 2023-02-12 03:55:24,230 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/413323817eab6eca83ffbd861a4ef441/.tmp/family2/52069fb5c87745ff89985f8fe081dee0 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/413323817eab6eca83ffbd861a4ef441/family2/52069fb5c87745ff89985f8fe081dee0 2023-02-12 03:55:24,234 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 52069fb5c87745ff89985f8fe081dee0 2023-02-12 03:55:24,234 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/413323817eab6eca83ffbd861a4ef441/family2/52069fb5c87745ff89985f8fe081dee0, entries=1, sequenceid=23, filesize=5.0 K 2023-02-12 03:55:24,234 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 413323817eab6eca83ffbd861a4ef441 in 1261ms, sequenceid=23, compaction requested=true 2023-02-12 03:55:24,235 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 413323817eab6eca83ffbd861a4ef441: 2023-02-12 03:55:24,235 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1676174113888.413323817eab6eca83ffbd861a4ef441. 2023-02-12 03:55:24,235 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-12 03:55:24,624 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/5de519c4afe22c04111a6724c632530e/.tmp/family2/d188d25574114174a8ae0a7bbfad317e 2023-02-12 03:55:24,624 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/7a34b5c93155c75d8e84f8d88f767143/.tmp/family2/ebab8694cfb848a5957fd56756f2f9b1 2023-02-12 03:55:24,634 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ebab8694cfb848a5957fd56756f2f9b1 2023-02-12 03:55:24,634 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d188d25574114174a8ae0a7bbfad317e 2023-02-12 03:55:24,635 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/7a34b5c93155c75d8e84f8d88f767143/.tmp/family1/88bf9789e4f04475948786fcc44851df as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/7a34b5c93155c75d8e84f8d88f767143/family1/88bf9789e4f04475948786fcc44851df 2023-02-12 03:55:24,635 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/5de519c4afe22c04111a6724c632530e/.tmp/family1/a192a1b1dfe94ffd8bf52ed8797342d1 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/5de519c4afe22c04111a6724c632530e/family1/a192a1b1dfe94ffd8bf52ed8797342d1 2023-02-12 03:55:24,639 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 88bf9789e4f04475948786fcc44851df 2023-02-12 03:55:24,639 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/7a34b5c93155c75d8e84f8d88f767143/family1/88bf9789e4f04475948786fcc44851df, entries=3, sequenceid=23, filesize=5.0 K 2023-02-12 03:55:24,640 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a192a1b1dfe94ffd8bf52ed8797342d1 2023-02-12 03:55:24,640 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/5de519c4afe22c04111a6724c632530e/family1/a192a1b1dfe94ffd8bf52ed8797342d1, entries=3, sequenceid=23, filesize=5.0 K 2023-02-12 03:55:24,640 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/7a34b5c93155c75d8e84f8d88f767143/.tmp/family2/ebab8694cfb848a5957fd56756f2f9b1 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/7a34b5c93155c75d8e84f8d88f767143/family2/ebab8694cfb848a5957fd56756f2f9b1 2023-02-12 03:55:24,641 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/5de519c4afe22c04111a6724c632530e/.tmp/family2/d188d25574114174a8ae0a7bbfad317e as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/5de519c4afe22c04111a6724c632530e/family2/d188d25574114174a8ae0a7bbfad317e 2023-02-12 03:55:24,649 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ebab8694cfb848a5957fd56756f2f9b1 2023-02-12 03:55:24,649 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/7a34b5c93155c75d8e84f8d88f767143/family2/ebab8694cfb848a5957fd56756f2f9b1, entries=1, sequenceid=23, filesize=5.0 K 2023-02-12 03:55:24,650 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d188d25574114174a8ae0a7bbfad317e 2023-02-12 03:55:24,650 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/5de519c4afe22c04111a6724c632530e/family2/d188d25574114174a8ae0a7bbfad317e, entries=1, sequenceid=23, filesize=5.0 K 2023-02-12 03:55:24,650 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 7a34b5c93155c75d8e84f8d88f767143 in 1677ms, sequenceid=23, compaction requested=true 2023-02-12 03:55:24,650 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 5de519c4afe22c04111a6724c632530e in 1677ms, sequenceid=23, compaction requested=true 2023-02-12 03:55:24,651 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 7a34b5c93155c75d8e84f8d88f767143: 2023-02-12 03:55:24,651 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 5de519c4afe22c04111a6724c632530e: 2023-02-12 03:55:24,651 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1676174113888.7a34b5c93155c75d8e84f8d88f767143. 2023-02-12 03:55:24,651 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1676174113888.5de519c4afe22c04111a6724c632530e. 2023-02-12 03:55:24,651 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-12 03:55:24,651 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-12 03:55:24,651 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-12 03:55:24,651 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:24,651 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-02-12 03:55:24,651 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-02-12 03:55:24,652 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:24,652 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-12 03:55:24,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:24,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:55:24,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:55:24,652 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-12 03:55:24,652 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 03:55:24,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:55:24,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:55:24,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-12 03:55:24,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:24,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:55:24,653 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-02-12 03:55:24,653 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-02-12 03:55:24,653 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4dd75b38[Count = 0] remaining members to acquire global barrier 2023-02-12 03:55:24,653 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-12 03:55:24,654 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-12 03:55:24,654 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-12 03:55:24,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-12 03:55:24,655 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-02-12 03:55:24,655 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-02-12 03:55:24,655 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:24,655 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-12 03:55:24,655 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase20.apache.org,39639,1676173982450' in zk 2023-02-12 03:55:24,656 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:24,656 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-02-12 03:55:24,656 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:55:24,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:24,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:55:24,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:55:24,656 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-02-12 03:55:24,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:55:24,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:55:24,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-12 03:55:24,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:24,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:55:24,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-12 03:55:24,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:24,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase20.apache.org,39639,1676173982450': 2023-02-12 03:55:24,658 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-02-12 03:55:24,658 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-02-12 03:55:24,658 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-12 03:55:24,658 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-12 03:55:24,658 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-02-12 03:55:24,658 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-12 03:55:24,659 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-12 03:55:24,659 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-12 03:55:24,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-12 03:55:24,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:55:24,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:55:24,659 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-12 03:55:24,659 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:55:24,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-12 03:55:24,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:55:24,659 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:24,659 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:55:24,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:55:24,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-12 03:55:24,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-12 03:55:24,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:55:24,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-12 03:55:24,660 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:24,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:24,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:55:24,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-12 03:55:24,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:24,661 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:24,661 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:55:24,661 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:55:24,661 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-02-12 03:55:24,661 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-12 03:55:24,661 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40099] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-02-12 03:55:24,662 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40099] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-12 03:55:24,661 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:55:24,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:55:24,661 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:55:24,662 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-12 03:55:24,662 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:24,662 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-12 03:55:24,662 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-02-12 03:55:24,662 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:55:24,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:55:24,662 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-12 03:55:24,662 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-12 03:55:24,662 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-12 03:55:24,762 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-12 03:55:24,763 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40099] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-12 03:55:24,764 DEBUG [Listener at localhost.localdomain/41049] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-12 03:55:24,764 DEBUG [Listener at localhost.localdomain/41049] regionserver.HStore(1912): 5de519c4afe22c04111a6724c632530e/family1 is initiating major compaction (all files) 2023-02-12 03:55:24,764 INFO [Listener at localhost.localdomain/41049] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-12 03:55:24,764 INFO [Listener at localhost.localdomain/41049] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 03:55:24,764 INFO [Listener at localhost.localdomain/41049] regionserver.HRegion(2258): Starting compaction of 5de519c4afe22c04111a6724c632530e/family1 in ns:testMinorCompaction,2,1676174113888.5de519c4afe22c04111a6724c632530e. 2023-02-12 03:55:24,764 INFO [Listener at localhost.localdomain/41049] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/5de519c4afe22c04111a6724c632530e/family1/2396974621db49dbbe7b83f7da4c9173, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/5de519c4afe22c04111a6724c632530e/family1/ea385b501a774fb29cd07747b4f52235, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/5de519c4afe22c04111a6724c632530e/family1/f173a8ce3f934ac59d272b9d99e161ea, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/5de519c4afe22c04111a6724c632530e/family1/d0d089dc83c743a9b245f062e86b36f4, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/5de519c4afe22c04111a6724c632530e/family1/a192a1b1dfe94ffd8bf52ed8797342d1] into tmpdir=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/5de519c4afe22c04111a6724c632530e/.tmp, totalSize=26.6 K 2023-02-12 03:55:24,765 DEBUG [Listener at localhost.localdomain/41049] compactions.Compactor(207): Compacting 2396974621db49dbbe7b83f7da4c9173, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676174116013 2023-02-12 03:55:24,766 DEBUG [Listener at localhost.localdomain/41049] compactions.Compactor(207): Compacting ea385b501a774fb29cd07747b4f52235, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676174117425 2023-02-12 03:55:24,766 DEBUG [Listener at localhost.localdomain/41049] compactions.Compactor(207): Compacting f173a8ce3f934ac59d272b9d99e161ea, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676174119250 2023-02-12 03:55:24,767 DEBUG [Listener at localhost.localdomain/41049] compactions.Compactor(207): Compacting d0d089dc83c743a9b245f062e86b36f4, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676174121078 2023-02-12 03:55:24,768 DEBUG [Listener at localhost.localdomain/41049] compactions.Compactor(207): Compacting a192a1b1dfe94ffd8bf52ed8797342d1, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-12 03:55:24,781 INFO [Listener at localhost.localdomain/41049] throttle.PressureAwareThroughputController(145): 5de519c4afe22c04111a6724c632530e#family1#compaction#150 average throughput is 0.83 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-12 03:55:25,188 INFO [Listener at localhost.localdomain/41049] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20230212d705a19b917c478ca1cb3e7b0c9ea21f_del 2023-02-12 03:55:25,188 INFO [Listener at localhost.localdomain/41049] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230212d705a19b917c478ca1cb3e7b0c9ea21f_del to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20230212d705a19b917c478ca1cb3e7b0c9ea21f_del 2023-02-12 03:55:26,005 INFO [Listener at localhost.localdomain/41049] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5f3e7b55b31a49da8c2a614ec4fd813e 2023-02-12 03:55:26,006 DEBUG [Listener at localhost.localdomain/41049] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/5de519c4afe22c04111a6724c632530e/.tmp/family1/5f3e7b55b31a49da8c2a614ec4fd813e as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/5de519c4afe22c04111a6724c632530e/family1/5f3e7b55b31a49da8c2a614ec4fd813e 2023-02-12 03:55:26,009 INFO [Listener at localhost.localdomain/41049] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5f3e7b55b31a49da8c2a614ec4fd813e 2023-02-12 03:55:26,009 INFO [Listener at localhost.localdomain/41049] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 5de519c4afe22c04111a6724c632530e/family1 of 5de519c4afe22c04111a6724c632530e into 5f3e7b55b31a49da8c2a614ec4fd813e(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-12 03:55:26,010 DEBUG [Listener at localhost.localdomain/41049] regionserver.HRegion(2288): Compaction status journal for 5de519c4afe22c04111a6724c632530e: 2023-02-12 03:55:26,010 DEBUG [Listener at localhost.localdomain/41049] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-12 03:55:26,010 DEBUG [Listener at localhost.localdomain/41049] regionserver.HStore(1912): 5de519c4afe22c04111a6724c632530e/family2 is initiating major compaction (all files) 2023-02-12 03:55:26,010 INFO [Listener at localhost.localdomain/41049] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-12 03:55:26,010 INFO [Listener at localhost.localdomain/41049] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 03:55:26,010 INFO [Listener at localhost.localdomain/41049] regionserver.HRegion(2258): Starting compaction of 5de519c4afe22c04111a6724c632530e/family2 in ns:testMinorCompaction,2,1676174113888.5de519c4afe22c04111a6724c632530e. 2023-02-12 03:55:26,011 INFO [Listener at localhost.localdomain/41049] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/5de519c4afe22c04111a6724c632530e/family2/f58d16e17bd14bf3bbaa45a2a67776c2, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/5de519c4afe22c04111a6724c632530e/family2/a00e3c9ec42d46868119e561ba373f6f, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/5de519c4afe22c04111a6724c632530e/family2/45536b2878194c79b7f6597cc3506b63, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/5de519c4afe22c04111a6724c632530e/family2/d2e26203596a418f9389766a564b09e6, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/5de519c4afe22c04111a6724c632530e/family2/d188d25574114174a8ae0a7bbfad317e] into tmpdir=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/5de519c4afe22c04111a6724c632530e/.tmp, totalSize=25.3 K 2023-02-12 03:55:26,011 DEBUG [Listener at localhost.localdomain/41049] compactions.Compactor(207): Compacting f58d16e17bd14bf3bbaa45a2a67776c2, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676174116013 2023-02-12 03:55:26,011 DEBUG [Listener at localhost.localdomain/41049] compactions.Compactor(207): Compacting a00e3c9ec42d46868119e561ba373f6f, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676174117425 2023-02-12 03:55:26,011 DEBUG [Listener at localhost.localdomain/41049] compactions.Compactor(207): Compacting 45536b2878194c79b7f6597cc3506b63, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676174119250 2023-02-12 03:55:26,012 DEBUG [Listener at localhost.localdomain/41049] compactions.Compactor(207): Compacting d2e26203596a418f9389766a564b09e6, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676174121078 2023-02-12 03:55:26,012 DEBUG [Listener at localhost.localdomain/41049] compactions.Compactor(207): Compacting d188d25574114174a8ae0a7bbfad317e, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-12 03:55:26,018 INFO [Listener at localhost.localdomain/41049] throttle.PressureAwareThroughputController(145): 5de519c4afe22c04111a6724c632530e#family2#compaction#151 average throughput is 0.51 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-12 03:55:26,051 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/5de519c4afe22c04111a6724c632530e/family1/2396974621db49dbbe7b83f7da4c9173, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/5de519c4afe22c04111a6724c632530e/family1/ea385b501a774fb29cd07747b4f52235, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/5de519c4afe22c04111a6724c632530e/family1/f173a8ce3f934ac59d272b9d99e161ea, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/5de519c4afe22c04111a6724c632530e/family1/d0d089dc83c743a9b245f062e86b36f4, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/5de519c4afe22c04111a6724c632530e/family1/a192a1b1dfe94ffd8bf52ed8797342d1] to archive 2023-02-12 03:55:26,053 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-12 03:55:26,056 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/5de519c4afe22c04111a6724c632530e/family1/2396974621db49dbbe7b83f7da4c9173 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/ns/testMinorCompaction/5de519c4afe22c04111a6724c632530e/family1/2396974621db49dbbe7b83f7da4c9173 2023-02-12 03:55:26,058 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/5de519c4afe22c04111a6724c632530e/family1/ea385b501a774fb29cd07747b4f52235 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/ns/testMinorCompaction/5de519c4afe22c04111a6724c632530e/family1/ea385b501a774fb29cd07747b4f52235 2023-02-12 03:55:26,060 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/5de519c4afe22c04111a6724c632530e/family1/f173a8ce3f934ac59d272b9d99e161ea to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/ns/testMinorCompaction/5de519c4afe22c04111a6724c632530e/family1/f173a8ce3f934ac59d272b9d99e161ea 2023-02-12 03:55:26,062 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/5de519c4afe22c04111a6724c632530e/family1/d0d089dc83c743a9b245f062e86b36f4 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/ns/testMinorCompaction/5de519c4afe22c04111a6724c632530e/family1/d0d089dc83c743a9b245f062e86b36f4 2023-02-12 03:55:26,063 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/5de519c4afe22c04111a6724c632530e/family1/a192a1b1dfe94ffd8bf52ed8797342d1 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/ns/testMinorCompaction/5de519c4afe22c04111a6724c632530e/family1/a192a1b1dfe94ffd8bf52ed8797342d1 2023-02-12 03:55:26,432 INFO [Listener at localhost.localdomain/41049] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c2023021295c697c87faf40deae95e3ad74213af8_del 2023-02-12 03:55:26,432 INFO [Listener at localhost.localdomain/41049] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023021295c697c87faf40deae95e3ad74213af8_del to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c2023021295c697c87faf40deae95e3ad74213af8_del 2023-02-12 03:55:27,253 INFO [Listener at localhost.localdomain/41049] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2ae7de54f1d84d2f8803dc65ace2f44d 2023-02-12 03:55:27,254 DEBUG [Listener at localhost.localdomain/41049] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/5de519c4afe22c04111a6724c632530e/.tmp/family2/2ae7de54f1d84d2f8803dc65ace2f44d as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/5de519c4afe22c04111a6724c632530e/family2/2ae7de54f1d84d2f8803dc65ace2f44d 2023-02-12 03:55:27,257 INFO [Listener at localhost.localdomain/41049] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2ae7de54f1d84d2f8803dc65ace2f44d 2023-02-12 03:55:27,258 INFO [Listener at localhost.localdomain/41049] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 5de519c4afe22c04111a6724c632530e/family2 of 5de519c4afe22c04111a6724c632530e into 2ae7de54f1d84d2f8803dc65ace2f44d(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-12 03:55:27,258 DEBUG [Listener at localhost.localdomain/41049] regionserver.HRegion(2288): Compaction status journal for 5de519c4afe22c04111a6724c632530e: 2023-02-12 03:55:27,258 DEBUG [Listener at localhost.localdomain/41049] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-12 03:55:27,258 DEBUG [Listener at localhost.localdomain/41049] regionserver.HStore(1912): 413323817eab6eca83ffbd861a4ef441/family1 is initiating major compaction (all files) 2023-02-12 03:55:27,258 INFO [Listener at localhost.localdomain/41049] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-12 03:55:27,258 INFO [Listener at localhost.localdomain/41049] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 03:55:27,258 INFO [Listener at localhost.localdomain/41049] regionserver.HRegion(2258): Starting compaction of 413323817eab6eca83ffbd861a4ef441/family1 in ns:testMinorCompaction,1,1676174113888.413323817eab6eca83ffbd861a4ef441. 2023-02-12 03:55:27,258 INFO [Listener at localhost.localdomain/41049] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/413323817eab6eca83ffbd861a4ef441/family1/832d59efaf24449d96673e90a22abe07, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/413323817eab6eca83ffbd861a4ef441/family1/10f396331bbd4cfbb06425f2b18de8fa, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/413323817eab6eca83ffbd861a4ef441/family1/5aac6f01463244d1ada07b5ccd637ab2, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/413323817eab6eca83ffbd861a4ef441/family1/d7326f0ad5d74704b81fcac46865683a, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/413323817eab6eca83ffbd861a4ef441/family1/29c4b52b977d460ea996bef2935720e9] into tmpdir=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/413323817eab6eca83ffbd861a4ef441/.tmp, totalSize=26.6 K 2023-02-12 03:55:27,258 DEBUG [Listener at localhost.localdomain/41049] compactions.Compactor(207): Compacting 832d59efaf24449d96673e90a22abe07, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676174116013 2023-02-12 03:55:27,259 DEBUG [Listener at localhost.localdomain/41049] compactions.Compactor(207): Compacting 10f396331bbd4cfbb06425f2b18de8fa, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676174117424 2023-02-12 03:55:27,259 DEBUG [Listener at localhost.localdomain/41049] compactions.Compactor(207): Compacting 5aac6f01463244d1ada07b5ccd637ab2, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676174119250 2023-02-12 03:55:27,259 DEBUG [Listener at localhost.localdomain/41049] compactions.Compactor(207): Compacting d7326f0ad5d74704b81fcac46865683a, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676174121078 2023-02-12 03:55:27,260 DEBUG [Listener at localhost.localdomain/41049] compactions.Compactor(207): Compacting 29c4b52b977d460ea996bef2935720e9, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-12 03:55:27,268 INFO [Listener at localhost.localdomain/41049] throttle.PressureAwareThroughputController(145): 413323817eab6eca83ffbd861a4ef441#family1#compaction#152 average throughput is 0.83 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-12 03:55:27,353 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/5de519c4afe22c04111a6724c632530e/family2/f58d16e17bd14bf3bbaa45a2a67776c2, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/5de519c4afe22c04111a6724c632530e/family2/a00e3c9ec42d46868119e561ba373f6f, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/5de519c4afe22c04111a6724c632530e/family2/45536b2878194c79b7f6597cc3506b63, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/5de519c4afe22c04111a6724c632530e/family2/d2e26203596a418f9389766a564b09e6, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/5de519c4afe22c04111a6724c632530e/family2/d188d25574114174a8ae0a7bbfad317e] to archive 2023-02-12 03:55:27,354 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-12 03:55:27,356 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/5de519c4afe22c04111a6724c632530e/family2/f58d16e17bd14bf3bbaa45a2a67776c2 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/ns/testMinorCompaction/5de519c4afe22c04111a6724c632530e/family2/f58d16e17bd14bf3bbaa45a2a67776c2 2023-02-12 03:55:27,358 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/5de519c4afe22c04111a6724c632530e/family2/a00e3c9ec42d46868119e561ba373f6f to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/ns/testMinorCompaction/5de519c4afe22c04111a6724c632530e/family2/a00e3c9ec42d46868119e561ba373f6f 2023-02-12 03:55:27,360 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/5de519c4afe22c04111a6724c632530e/family2/45536b2878194c79b7f6597cc3506b63 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/ns/testMinorCompaction/5de519c4afe22c04111a6724c632530e/family2/45536b2878194c79b7f6597cc3506b63 2023-02-12 03:55:27,363 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/5de519c4afe22c04111a6724c632530e/family2/d2e26203596a418f9389766a564b09e6 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/ns/testMinorCompaction/5de519c4afe22c04111a6724c632530e/family2/d2e26203596a418f9389766a564b09e6 2023-02-12 03:55:27,365 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/5de519c4afe22c04111a6724c632530e/family2/d188d25574114174a8ae0a7bbfad317e to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/ns/testMinorCompaction/5de519c4afe22c04111a6724c632530e/family2/d188d25574114174a8ae0a7bbfad317e 2023-02-12 03:55:27,681 INFO [Listener at localhost.localdomain/41049] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b2023021268f282faa41b4d8da58da4de2c3bf6ad_del 2023-02-12 03:55:27,681 INFO [Listener at localhost.localdomain/41049] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023021268f282faa41b4d8da58da4de2c3bf6ad_del to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b2023021268f282faa41b4d8da58da4de2c3bf6ad_del 2023-02-12 03:55:28,509 INFO [Listener at localhost.localdomain/41049] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a779502210b94d90a50917484b525044 2023-02-12 03:55:28,510 DEBUG [Listener at localhost.localdomain/41049] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/413323817eab6eca83ffbd861a4ef441/.tmp/family1/a779502210b94d90a50917484b525044 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/413323817eab6eca83ffbd861a4ef441/family1/a779502210b94d90a50917484b525044 2023-02-12 03:55:28,514 INFO [Listener at localhost.localdomain/41049] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a779502210b94d90a50917484b525044 2023-02-12 03:55:28,515 INFO [Listener at localhost.localdomain/41049] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 413323817eab6eca83ffbd861a4ef441/family1 of 413323817eab6eca83ffbd861a4ef441 into a779502210b94d90a50917484b525044(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-12 03:55:28,515 DEBUG [Listener at localhost.localdomain/41049] regionserver.HRegion(2288): Compaction status journal for 413323817eab6eca83ffbd861a4ef441: 2023-02-12 03:55:28,515 DEBUG [Listener at localhost.localdomain/41049] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-12 03:55:28,515 DEBUG [Listener at localhost.localdomain/41049] regionserver.HStore(1912): 413323817eab6eca83ffbd861a4ef441/family2 is initiating major compaction (all files) 2023-02-12 03:55:28,515 INFO [Listener at localhost.localdomain/41049] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-12 03:55:28,516 INFO [Listener at localhost.localdomain/41049] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 03:55:28,516 INFO [Listener at localhost.localdomain/41049] regionserver.HRegion(2258): Starting compaction of 413323817eab6eca83ffbd861a4ef441/family2 in ns:testMinorCompaction,1,1676174113888.413323817eab6eca83ffbd861a4ef441. 2023-02-12 03:55:28,516 INFO [Listener at localhost.localdomain/41049] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/413323817eab6eca83ffbd861a4ef441/family2/f61ca03926be43e9bf36143978458e40, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/413323817eab6eca83ffbd861a4ef441/family2/0a4a526f21ac4440ac3be438652169ca, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/413323817eab6eca83ffbd861a4ef441/family2/1c62dfb6cf1f4cfa8c192c0defa791d8, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/413323817eab6eca83ffbd861a4ef441/family2/3bd1cd3e3d3f4536b7d70f0e92ef6cc2, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/413323817eab6eca83ffbd861a4ef441/family2/52069fb5c87745ff89985f8fe081dee0] into tmpdir=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/413323817eab6eca83ffbd861a4ef441/.tmp, totalSize=25.3 K 2023-02-12 03:55:28,517 DEBUG [Listener at localhost.localdomain/41049] compactions.Compactor(207): Compacting f61ca03926be43e9bf36143978458e40, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676174116013 2023-02-12 03:55:28,517 DEBUG [Listener at localhost.localdomain/41049] compactions.Compactor(207): Compacting 0a4a526f21ac4440ac3be438652169ca, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676174117424 2023-02-12 03:55:28,518 DEBUG [Listener at localhost.localdomain/41049] compactions.Compactor(207): Compacting 1c62dfb6cf1f4cfa8c192c0defa791d8, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676174119250 2023-02-12 03:55:28,518 DEBUG [Listener at localhost.localdomain/41049] compactions.Compactor(207): Compacting 3bd1cd3e3d3f4536b7d70f0e92ef6cc2, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676174121078 2023-02-12 03:55:28,518 DEBUG [Listener at localhost.localdomain/41049] compactions.Compactor(207): Compacting 52069fb5c87745ff89985f8fe081dee0, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-12 03:55:28,525 INFO [Listener at localhost.localdomain/41049] throttle.PressureAwareThroughputController(145): 413323817eab6eca83ffbd861a4ef441#family2#compaction#153 average throughput is 0.51 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-12 03:55:28,550 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/413323817eab6eca83ffbd861a4ef441/family1/832d59efaf24449d96673e90a22abe07, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/413323817eab6eca83ffbd861a4ef441/family1/10f396331bbd4cfbb06425f2b18de8fa, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/413323817eab6eca83ffbd861a4ef441/family1/5aac6f01463244d1ada07b5ccd637ab2, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/413323817eab6eca83ffbd861a4ef441/family1/d7326f0ad5d74704b81fcac46865683a, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/413323817eab6eca83ffbd861a4ef441/family1/29c4b52b977d460ea996bef2935720e9] to archive 2023-02-12 03:55:28,551 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-12 03:55:28,553 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/413323817eab6eca83ffbd861a4ef441/family1/832d59efaf24449d96673e90a22abe07 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/ns/testMinorCompaction/413323817eab6eca83ffbd861a4ef441/family1/832d59efaf24449d96673e90a22abe07 2023-02-12 03:55:28,555 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/413323817eab6eca83ffbd861a4ef441/family1/10f396331bbd4cfbb06425f2b18de8fa to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/ns/testMinorCompaction/413323817eab6eca83ffbd861a4ef441/family1/10f396331bbd4cfbb06425f2b18de8fa 2023-02-12 03:55:28,557 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/413323817eab6eca83ffbd861a4ef441/family1/5aac6f01463244d1ada07b5ccd637ab2 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/ns/testMinorCompaction/413323817eab6eca83ffbd861a4ef441/family1/5aac6f01463244d1ada07b5ccd637ab2 2023-02-12 03:55:28,558 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/413323817eab6eca83ffbd861a4ef441/family1/d7326f0ad5d74704b81fcac46865683a to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/ns/testMinorCompaction/413323817eab6eca83ffbd861a4ef441/family1/d7326f0ad5d74704b81fcac46865683a 2023-02-12 03:55:28,560 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/413323817eab6eca83ffbd861a4ef441/family1/29c4b52b977d460ea996bef2935720e9 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/ns/testMinorCompaction/413323817eab6eca83ffbd861a4ef441/family1/29c4b52b977d460ea996bef2935720e9 2023-02-12 03:55:28,939 INFO [Listener at localhost.localdomain/41049] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20230212dcc48f431fa745fa9cfbf72483677298_del 2023-02-12 03:55:28,939 INFO [Listener at localhost.localdomain/41049] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230212dcc48f431fa745fa9cfbf72483677298_del to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b20230212dcc48f431fa745fa9cfbf72483677298_del 2023-02-12 03:55:29,769 INFO [Listener at localhost.localdomain/41049] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 313f493b457043919ff1ed6ba777f4a8 2023-02-12 03:55:29,770 DEBUG [Listener at localhost.localdomain/41049] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/413323817eab6eca83ffbd861a4ef441/.tmp/family2/313f493b457043919ff1ed6ba777f4a8 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/413323817eab6eca83ffbd861a4ef441/family2/313f493b457043919ff1ed6ba777f4a8 2023-02-12 03:55:29,775 INFO [Listener at localhost.localdomain/41049] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 313f493b457043919ff1ed6ba777f4a8 2023-02-12 03:55:29,776 INFO [Listener at localhost.localdomain/41049] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 413323817eab6eca83ffbd861a4ef441/family2 of 413323817eab6eca83ffbd861a4ef441 into 313f493b457043919ff1ed6ba777f4a8(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-12 03:55:29,777 DEBUG [Listener at localhost.localdomain/41049] regionserver.HRegion(2288): Compaction status journal for 413323817eab6eca83ffbd861a4ef441: 2023-02-12 03:55:29,777 DEBUG [Listener at localhost.localdomain/41049] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-12 03:55:29,777 DEBUG [Listener at localhost.localdomain/41049] regionserver.HStore(1912): 7a34b5c93155c75d8e84f8d88f767143/family1 is initiating major compaction (all files) 2023-02-12 03:55:29,777 INFO [Listener at localhost.localdomain/41049] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-12 03:55:29,777 INFO [Listener at localhost.localdomain/41049] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 03:55:29,778 INFO [Listener at localhost.localdomain/41049] regionserver.HRegion(2258): Starting compaction of 7a34b5c93155c75d8e84f8d88f767143/family1 in ns:testMinorCompaction,,1676174113888.7a34b5c93155c75d8e84f8d88f767143. 2023-02-12 03:55:29,778 INFO [Listener at localhost.localdomain/41049] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/7a34b5c93155c75d8e84f8d88f767143/family1/d5a67bd19dc14108bd19f1fb7c83c99b, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/7a34b5c93155c75d8e84f8d88f767143/family1/68a6d59ad9364b048a47cfc87a2099a8, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/7a34b5c93155c75d8e84f8d88f767143/family1/ce6804d638004a29b4648cb9e995b5e6, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/7a34b5c93155c75d8e84f8d88f767143/family1/2be682d12ba743b89501e18c0c31cc68, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/7a34b5c93155c75d8e84f8d88f767143/family1/88bf9789e4f04475948786fcc44851df] into tmpdir=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/7a34b5c93155c75d8e84f8d88f767143/.tmp, totalSize=26.6 K 2023-02-12 03:55:29,778 DEBUG [Listener at localhost.localdomain/41049] compactions.Compactor(207): Compacting d5a67bd19dc14108bd19f1fb7c83c99b, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676174116012 2023-02-12 03:55:29,779 DEBUG [Listener at localhost.localdomain/41049] compactions.Compactor(207): Compacting 68a6d59ad9364b048a47cfc87a2099a8, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676174117424 2023-02-12 03:55:29,779 DEBUG [Listener at localhost.localdomain/41049] compactions.Compactor(207): Compacting ce6804d638004a29b4648cb9e995b5e6, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676174119249 2023-02-12 03:55:29,780 DEBUG [Listener at localhost.localdomain/41049] compactions.Compactor(207): Compacting 2be682d12ba743b89501e18c0c31cc68, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676174121077 2023-02-12 03:55:29,780 DEBUG [Listener at localhost.localdomain/41049] compactions.Compactor(207): Compacting 88bf9789e4f04475948786fcc44851df, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-12 03:55:29,789 INFO [Listener at localhost.localdomain/41049] throttle.PressureAwareThroughputController(145): 7a34b5c93155c75d8e84f8d88f767143#family1#compaction#154 average throughput is 0.83 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-12 03:55:29,852 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/413323817eab6eca83ffbd861a4ef441/family2/f61ca03926be43e9bf36143978458e40, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/413323817eab6eca83ffbd861a4ef441/family2/0a4a526f21ac4440ac3be438652169ca, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/413323817eab6eca83ffbd861a4ef441/family2/1c62dfb6cf1f4cfa8c192c0defa791d8, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/413323817eab6eca83ffbd861a4ef441/family2/3bd1cd3e3d3f4536b7d70f0e92ef6cc2, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/413323817eab6eca83ffbd861a4ef441/family2/52069fb5c87745ff89985f8fe081dee0] to archive 2023-02-12 03:55:29,853 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-12 03:55:29,855 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/413323817eab6eca83ffbd861a4ef441/family2/f61ca03926be43e9bf36143978458e40 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/ns/testMinorCompaction/413323817eab6eca83ffbd861a4ef441/family2/f61ca03926be43e9bf36143978458e40 2023-02-12 03:55:29,856 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/413323817eab6eca83ffbd861a4ef441/family2/0a4a526f21ac4440ac3be438652169ca to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/ns/testMinorCompaction/413323817eab6eca83ffbd861a4ef441/family2/0a4a526f21ac4440ac3be438652169ca 2023-02-12 03:55:29,857 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/413323817eab6eca83ffbd861a4ef441/family2/1c62dfb6cf1f4cfa8c192c0defa791d8 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/ns/testMinorCompaction/413323817eab6eca83ffbd861a4ef441/family2/1c62dfb6cf1f4cfa8c192c0defa791d8 2023-02-12 03:55:29,858 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/413323817eab6eca83ffbd861a4ef441/family2/3bd1cd3e3d3f4536b7d70f0e92ef6cc2 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/ns/testMinorCompaction/413323817eab6eca83ffbd861a4ef441/family2/3bd1cd3e3d3f4536b7d70f0e92ef6cc2 2023-02-12 03:55:29,859 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/413323817eab6eca83ffbd861a4ef441/family2/52069fb5c87745ff89985f8fe081dee0 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/ns/testMinorCompaction/413323817eab6eca83ffbd861a4ef441/family2/52069fb5c87745ff89985f8fe081dee0 2023-02-12 03:55:30,202 INFO [Listener at localhost.localdomain/41049] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e202302125b9dde68cb5247b5a4adcf5a88edfbc4_del 2023-02-12 03:55:30,202 INFO [Listener at localhost.localdomain/41049] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202302125b9dde68cb5247b5a4adcf5a88edfbc4_del to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e202302125b9dde68cb5247b5a4adcf5a88edfbc4_del 2023-02-12 03:55:31,026 INFO [Listener at localhost.localdomain/41049] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a89f12864d9d4b168f27e3730a3120b5 2023-02-12 03:55:31,026 DEBUG [Listener at localhost.localdomain/41049] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/7a34b5c93155c75d8e84f8d88f767143/.tmp/family1/a89f12864d9d4b168f27e3730a3120b5 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/7a34b5c93155c75d8e84f8d88f767143/family1/a89f12864d9d4b168f27e3730a3120b5 2023-02-12 03:55:31,030 INFO [Listener at localhost.localdomain/41049] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a89f12864d9d4b168f27e3730a3120b5 2023-02-12 03:55:31,031 INFO [Listener at localhost.localdomain/41049] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 7a34b5c93155c75d8e84f8d88f767143/family1 of 7a34b5c93155c75d8e84f8d88f767143 into a89f12864d9d4b168f27e3730a3120b5(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-12 03:55:31,031 DEBUG [Listener at localhost.localdomain/41049] regionserver.HRegion(2288): Compaction status journal for 7a34b5c93155c75d8e84f8d88f767143: 2023-02-12 03:55:31,031 DEBUG [Listener at localhost.localdomain/41049] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-12 03:55:31,031 DEBUG [Listener at localhost.localdomain/41049] regionserver.HStore(1912): 7a34b5c93155c75d8e84f8d88f767143/family2 is initiating major compaction (all files) 2023-02-12 03:55:31,031 INFO [Listener at localhost.localdomain/41049] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-12 03:55:31,031 INFO [Listener at localhost.localdomain/41049] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 03:55:31,031 INFO [Listener at localhost.localdomain/41049] regionserver.HRegion(2258): Starting compaction of 7a34b5c93155c75d8e84f8d88f767143/family2 in ns:testMinorCompaction,,1676174113888.7a34b5c93155c75d8e84f8d88f767143. 2023-02-12 03:55:31,031 INFO [Listener at localhost.localdomain/41049] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/7a34b5c93155c75d8e84f8d88f767143/family2/c65ae910683f419dbde3edb1607290b6, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/7a34b5c93155c75d8e84f8d88f767143/family2/fd0e0d925d7b4b2585f6227a736b5f62, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/7a34b5c93155c75d8e84f8d88f767143/family2/635f0bcf7c344a6cbdc7d06785123fb3, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/7a34b5c93155c75d8e84f8d88f767143/family2/9336741833c34731866cca9b98ac422b, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/7a34b5c93155c75d8e84f8d88f767143/family2/ebab8694cfb848a5957fd56756f2f9b1] into tmpdir=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/7a34b5c93155c75d8e84f8d88f767143/.tmp, totalSize=25.3 K 2023-02-12 03:55:31,032 DEBUG [Listener at localhost.localdomain/41049] compactions.Compactor(207): Compacting c65ae910683f419dbde3edb1607290b6, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676174116012 2023-02-12 03:55:31,032 DEBUG [Listener at localhost.localdomain/41049] compactions.Compactor(207): Compacting fd0e0d925d7b4b2585f6227a736b5f62, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676174117424 2023-02-12 03:55:31,032 DEBUG [Listener at localhost.localdomain/41049] compactions.Compactor(207): Compacting 635f0bcf7c344a6cbdc7d06785123fb3, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676174119249 2023-02-12 03:55:31,033 DEBUG [Listener at localhost.localdomain/41049] compactions.Compactor(207): Compacting 9336741833c34731866cca9b98ac422b, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676174121077 2023-02-12 03:55:31,033 DEBUG [Listener at localhost.localdomain/41049] compactions.Compactor(207): Compacting ebab8694cfb848a5957fd56756f2f9b1, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-12 03:55:31,040 INFO [Listener at localhost.localdomain/41049] throttle.PressureAwareThroughputController(145): 7a34b5c93155c75d8e84f8d88f767143#family2#compaction#155 average throughput is 0.51 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-12 03:55:31,050 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/7a34b5c93155c75d8e84f8d88f767143/family1/d5a67bd19dc14108bd19f1fb7c83c99b, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/7a34b5c93155c75d8e84f8d88f767143/family1/68a6d59ad9364b048a47cfc87a2099a8, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/7a34b5c93155c75d8e84f8d88f767143/family1/ce6804d638004a29b4648cb9e995b5e6, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/7a34b5c93155c75d8e84f8d88f767143/family1/2be682d12ba743b89501e18c0c31cc68, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/7a34b5c93155c75d8e84f8d88f767143/family1/88bf9789e4f04475948786fcc44851df] to archive 2023-02-12 03:55:31,051 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-12 03:55:31,052 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/7a34b5c93155c75d8e84f8d88f767143/family1/d5a67bd19dc14108bd19f1fb7c83c99b to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/ns/testMinorCompaction/7a34b5c93155c75d8e84f8d88f767143/family1/d5a67bd19dc14108bd19f1fb7c83c99b 2023-02-12 03:55:31,053 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/7a34b5c93155c75d8e84f8d88f767143/family1/68a6d59ad9364b048a47cfc87a2099a8 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/ns/testMinorCompaction/7a34b5c93155c75d8e84f8d88f767143/family1/68a6d59ad9364b048a47cfc87a2099a8 2023-02-12 03:55:31,054 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/7a34b5c93155c75d8e84f8d88f767143/family1/ce6804d638004a29b4648cb9e995b5e6 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/ns/testMinorCompaction/7a34b5c93155c75d8e84f8d88f767143/family1/ce6804d638004a29b4648cb9e995b5e6 2023-02-12 03:55:31,055 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/7a34b5c93155c75d8e84f8d88f767143/family1/2be682d12ba743b89501e18c0c31cc68 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/ns/testMinorCompaction/7a34b5c93155c75d8e84f8d88f767143/family1/2be682d12ba743b89501e18c0c31cc68 2023-02-12 03:55:31,056 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/7a34b5c93155c75d8e84f8d88f767143/family1/88bf9789e4f04475948786fcc44851df to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/ns/testMinorCompaction/7a34b5c93155c75d8e84f8d88f767143/family1/88bf9789e4f04475948786fcc44851df 2023-02-12 03:55:31,449 INFO [Listener at localhost.localdomain/41049] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20230212f157e0f2c65f41a884d187e8e1daf860_del 2023-02-12 03:55:31,449 INFO [Listener at localhost.localdomain/41049] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230212f157e0f2c65f41a884d187e8e1daf860_del to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e20230212f157e0f2c65f41a884d187e8e1daf860_del 2023-02-12 03:55:32,279 INFO [Listener at localhost.localdomain/41049] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 38073f0b9e834fa4b699e73b250dc595 2023-02-12 03:55:32,280 DEBUG [Listener at localhost.localdomain/41049] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/7a34b5c93155c75d8e84f8d88f767143/.tmp/family2/38073f0b9e834fa4b699e73b250dc595 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/7a34b5c93155c75d8e84f8d88f767143/family2/38073f0b9e834fa4b699e73b250dc595 2023-02-12 03:55:32,284 INFO [Listener at localhost.localdomain/41049] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 38073f0b9e834fa4b699e73b250dc595 2023-02-12 03:55:32,285 INFO [Listener at localhost.localdomain/41049] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 7a34b5c93155c75d8e84f8d88f767143/family2 of 7a34b5c93155c75d8e84f8d88f767143 into 38073f0b9e834fa4b699e73b250dc595(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-12 03:55:32,285 DEBUG [Listener at localhost.localdomain/41049] regionserver.HRegion(2288): Compaction status journal for 7a34b5c93155c75d8e84f8d88f767143: 2023-02-12 03:55:32,290 DEBUG [Listener at localhost.localdomain/41049] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-12 03:55:32,293 DEBUG [Listener at localhost.localdomain/41049] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-12 03:55:32,297 DEBUG [Listener at localhost.localdomain/41049] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-12 03:55:32,298 DEBUG [Listener at localhost.localdomain/41049] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-12 03:55:32,303 INFO [Listener at localhost.localdomain/41049] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-02-12 03:55:32,319 INFO [Listener at localhost.localdomain/41049] compactions.PartitionedMobCompactor(306): The compaction type is PART_FILES, the request has 3 del files, 3 selected files, and 0 irrelevant files table 'ns:testMinorCompaction' and column 'family1' 2023-02-12 03:55:32,323 INFO [Listener at localhost.localdomain/41049] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e202302125b9dde68cb5247b5a4adcf5a88edfbc4_del 2023-02-12 03:55:32,326 INFO [Listener at localhost.localdomain/41049] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b2023021268f282faa41b4d8da58da4de2c3bf6ad_del 2023-02-12 03:55:32,330 INFO [Listener at localhost.localdomain/41049] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20230212d705a19b917c478ca1cb3e7b0c9ea21f_del 2023-02-12 03:55:32,330 INFO [Listener at localhost.localdomain/41049] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='ns:testMinorCompaction' column='family1' 2023-02-12 03:55:32,331 DEBUG [Listener at localhost.localdomain/41049] zookeeper.ReadOnlyZKClient(139): Connect 0x46429197 to 127.0.0.1:59556 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 03:55:32,335 DEBUG [Listener at localhost.localdomain/41049] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@18fafe50, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 03:55:32,337 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20230212 for table='ns:testMinorCompaction' and column='family1' 2023-02-12 03:55:32,337 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20230212 for table='ns:testMinorCompaction' and column='family1' 2023-02-12 03:55:32,337 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20230212 for table='ns:testMinorCompaction' and column='family1' 2023-02-12 03:55:32,360 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/7a34b5c93155c75d8e84f8d88f767143/family2/c65ae910683f419dbde3edb1607290b6, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/7a34b5c93155c75d8e84f8d88f767143/family2/fd0e0d925d7b4b2585f6227a736b5f62, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/7a34b5c93155c75d8e84f8d88f767143/family2/635f0bcf7c344a6cbdc7d06785123fb3, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/7a34b5c93155c75d8e84f8d88f767143/family2/9336741833c34731866cca9b98ac422b, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/7a34b5c93155c75d8e84f8d88f767143/family2/ebab8694cfb848a5957fd56756f2f9b1] to archive 2023-02-12 03:55:32,360 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-12 03:55:32,362 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/7a34b5c93155c75d8e84f8d88f767143/family2/c65ae910683f419dbde3edb1607290b6 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/ns/testMinorCompaction/7a34b5c93155c75d8e84f8d88f767143/family2/c65ae910683f419dbde3edb1607290b6 2023-02-12 03:55:32,363 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/7a34b5c93155c75d8e84f8d88f767143/family2/fd0e0d925d7b4b2585f6227a736b5f62 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/ns/testMinorCompaction/7a34b5c93155c75d8e84f8d88f767143/family2/fd0e0d925d7b4b2585f6227a736b5f62 2023-02-12 03:55:32,364 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/7a34b5c93155c75d8e84f8d88f767143/family2/635f0bcf7c344a6cbdc7d06785123fb3 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/ns/testMinorCompaction/7a34b5c93155c75d8e84f8d88f767143/family2/635f0bcf7c344a6cbdc7d06785123fb3 2023-02-12 03:55:32,364 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/7a34b5c93155c75d8e84f8d88f767143/family2/9336741833c34731866cca9b98ac422b to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/ns/testMinorCompaction/7a34b5c93155c75d8e84f8d88f767143/family2/9336741833c34731866cca9b98ac422b 2023-02-12 03:55:32,365 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/7a34b5c93155c75d8e84f8d88f767143/family2/ebab8694cfb848a5957fd56756f2f9b1 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/ns/testMinorCompaction/7a34b5c93155c75d8e84f8d88f767143/family2/ebab8694cfb848a5957fd56756f2f9b1 2023-02-12 03:55:32,766 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230212c5932d4ab5a14b96867f4027acc9b4f1 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20230212c5932d4ab5a14b96867f4027acc9b4f1 2023-02-12 03:55:32,767 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230212 table='ns:testMinorCompaction' column='family1' 2023-02-12 03:55:32,768 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230212211d530e6a47406a81d5457792fd62ef to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20230212211d530e6a47406a81d5457792fd62ef 2023-02-12 03:55:32,769 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230212 table='ns:testMinorCompaction' column='family1' 2023-02-12 03:55:32,779 DEBUG [MobFileCompactionChore-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-12 03:55:32,781 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:32774, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-12 03:55:32,786 DEBUG [MobFileCompactionChore-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-12 03:55:32,789 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:50398, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-12 03:55:32,802 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20230212/family1/d366fa8176bc4a7ea5713b107cfe4601 first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x01] 2023-02-12 03:55:32,802 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20230212/family1/15cd214aefd5444f883520757bfe0492 first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x01] 2023-02-12 03:55:32,803 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=ns:testMinorCompaction,1,1676174113888.413323817eab6eca83ffbd861a4ef441., hostname=jenkins-hbase20.apache.org,39639,1676173982450, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20230212/family1/15cd214aefd5444f883520757bfe0492}] 2023-02-12 03:55:32,803 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=ns:testMinorCompaction,,1676174113888.7a34b5c93155c75d8e84f8d88f767143., hostname=jenkins-hbase20.apache.org,39639,1676173982450, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20230212/family1/d366fa8176bc4a7ea5713b107cfe4601}] 2023-02-12 03:55:32,810 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39639] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20230212/family1/d366fa8176bc4a7ea5713b107cfe4601 for inclusion in 7a34b5c93155c75d8e84f8d88f767143/family1 2023-02-12 03:55:32,810 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20230212/family1/15cd214aefd5444f883520757bfe0492 for inclusion in 413323817eab6eca83ffbd861a4ef441/family1 2023-02-12 03:55:32,812 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39639] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x01 2023-02-12 03:55:32,812 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x01 2023-02-12 03:55:32,812 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HStore(777): Region bounds: first=1 last=2 2023-02-12 03:55:32,812 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39639] regionserver.HStore(777): Region bounds: first= last=1 2023-02-12 03:55:32,812 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HRegion(2445): Flush status journal for 413323817eab6eca83ffbd861a4ef441: 2023-02-12 03:55:32,812 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39639] regionserver.HRegion(2445): Flush status journal for 7a34b5c93155c75d8e84f8d88f767143: 2023-02-12 03:55:32,813 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39639] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20230212/family1/d366fa8176bc4a7ea5713b107cfe4601 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/staging/jenkins__ns_testMinorCompaction__bnnvp7aaihnhnmlopg7bjlg9i1e5jh58gock8cknenimm3lghcbtk3qqb02gcd5g/family1/d366fa8176bc4a7ea5713b107cfe4601 2023-02-12 03:55:32,813 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20230212/family1/15cd214aefd5444f883520757bfe0492 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/staging/jenkins__ns_testMinorCompaction__tu9o26vg73hh5sg02i2pg1qqbo7cgl3mnjdngq80u95rdi01mm3joth2d29jgua7/family1/15cd214aefd5444f883520757bfe0492 2023-02-12 03:55:32,814 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39639] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/staging/jenkins__ns_testMinorCompaction__bnnvp7aaihnhnmlopg7bjlg9i1e5jh58gock8cknenimm3lghcbtk3qqb02gcd5g/family1/d366fa8176bc4a7ea5713b107cfe4601 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/7a34b5c93155c75d8e84f8d88f767143/family1/fd579b2b758b4f4186a9cdeaf29916cb_SeqId_28_ 2023-02-12 03:55:32,814 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/staging/jenkins__ns_testMinorCompaction__tu9o26vg73hh5sg02i2pg1qqbo7cgl3mnjdngq80u95rdi01mm3joth2d29jgua7/family1/15cd214aefd5444f883520757bfe0492 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/413323817eab6eca83ffbd861a4ef441/family1/6165843ac8bf43c587e442fdc8658a3f_SeqId_28_ 2023-02-12 03:55:32,814 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39639] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/staging/jenkins__ns_testMinorCompaction__bnnvp7aaihnhnmlopg7bjlg9i1e5jh58gock8cknenimm3lghcbtk3qqb02gcd5g/family1/d366fa8176bc4a7ea5713b107cfe4601 into 7a34b5c93155c75d8e84f8d88f767143/family1 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/7a34b5c93155c75d8e84f8d88f767143/family1/fd579b2b758b4f4186a9cdeaf29916cb_SeqId_28_ - updating store file list. 2023-02-12 03:55:32,814 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/staging/jenkins__ns_testMinorCompaction__tu9o26vg73hh5sg02i2pg1qqbo7cgl3mnjdngq80u95rdi01mm3joth2d29jgua7/family1/15cd214aefd5444f883520757bfe0492 into 413323817eab6eca83ffbd861a4ef441/family1 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/413323817eab6eca83ffbd861a4ef441/family1/6165843ac8bf43c587e442fdc8658a3f_SeqId_28_ - updating store file list. 2023-02-12 03:55:32,817 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/413323817eab6eca83ffbd861a4ef441/family1/6165843ac8bf43c587e442fdc8658a3f_SeqId_28_ into 413323817eab6eca83ffbd861a4ef441/family1 2023-02-12 03:55:32,817 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39639] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/7a34b5c93155c75d8e84f8d88f767143/family1/fd579b2b758b4f4186a9cdeaf29916cb_SeqId_28_ into 7a34b5c93155c75d8e84f8d88f767143/family1 2023-02-12 03:55:32,817 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/staging/jenkins__ns_testMinorCompaction__tu9o26vg73hh5sg02i2pg1qqbo7cgl3mnjdngq80u95rdi01mm3joth2d29jgua7/family1/15cd214aefd5444f883520757bfe0492 into 413323817eab6eca83ffbd861a4ef441/family1 (new location: hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/413323817eab6eca83ffbd861a4ef441/family1/6165843ac8bf43c587e442fdc8658a3f_SeqId_28_) 2023-02-12 03:55:32,817 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39639] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/staging/jenkins__ns_testMinorCompaction__bnnvp7aaihnhnmlopg7bjlg9i1e5jh58gock8cknenimm3lghcbtk3qqb02gcd5g/family1/d366fa8176bc4a7ea5713b107cfe4601 into 7a34b5c93155c75d8e84f8d88f767143/family1 (new location: hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/7a34b5c93155c75d8e84f8d88f767143/family1/fd579b2b758b4f4186a9cdeaf29916cb_SeqId_28_) 2023-02-12 03:55:32,818 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39639] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/staging/jenkins__ns_testMinorCompaction__bnnvp7aaihnhnmlopg7bjlg9i1e5jh58gock8cknenimm3lghcbtk3qqb02gcd5g/family1/d366fa8176bc4a7ea5713b107cfe4601 2023-02-12 03:55:32,818 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39639] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/staging/jenkins__ns_testMinorCompaction__tu9o26vg73hh5sg02i2pg1qqbo7cgl3mnjdngq80u95rdi01mm3joth2d29jgua7/family1/15cd214aefd5444f883520757bfe0492 2023-02-12 03:55:32,819 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230212 table='ns:testMinorCompaction' column='family1' 2023-02-12 03:55:32,820 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230212 table='ns:testMinorCompaction' column='family1' 2023-02-12 03:55:32,820 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-02-12 03:55:32,820 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-12 03:55:32,821 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e202302122ee956260f15416e99abc6f45f5646e1 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e202302122ee956260f15416e99abc6f45f5646e1 2023-02-12 03:55:32,821 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-02-12 03:55:32,821 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20230212' 2023-02-12 03:55:32,821 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b2023021223724521fbfd4ee7b0a6aa102a84e607 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b2023021223724521fbfd4ee7b0a6aa102a84e607 2023-02-12 03:55:32,821 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-02-12 03:55:32,821 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20230212' 2023-02-12 03:55:32,821 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20230212 for table='ns:testMinorCompaction' and column='family1' 2023-02-12 03:55:32,823 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20230212 for table='ns:testMinorCompaction' and column='family1' 2023-02-12 03:55:33,173 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230212a37d893962684b5f90e9455da6a7a6d3 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20230212a37d893962684b5f90e9455da6a7a6d3 2023-02-12 03:55:33,174 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230212 table='ns:testMinorCompaction' column='family1' 2023-02-12 03:55:33,196 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20230212/family1/e90500159bfe4e6ab8ef8418cd2636da first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x01] 2023-02-12 03:55:33,197 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=ns:testMinorCompaction,2,1676174113888.5de519c4afe22c04111a6724c632530e., hostname=jenkins-hbase20.apache.org,39639,1676173982450, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20230212/family1/e90500159bfe4e6ab8ef8418cd2636da}] 2023-02-12 03:55:33,199 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39639] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20230212/family1/e90500159bfe4e6ab8ef8418cd2636da for inclusion in 5de519c4afe22c04111a6724c632530e/family1 2023-02-12 03:55:33,200 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39639] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x01 2023-02-12 03:55:33,200 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39639] regionserver.HStore(777): Region bounds: first=2 last= 2023-02-12 03:55:33,201 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39639] regionserver.HRegion(2445): Flush status journal for 5de519c4afe22c04111a6724c632530e: 2023-02-12 03:55:33,201 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39639] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20230212/family1/e90500159bfe4e6ab8ef8418cd2636da to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/staging/jenkins__ns_testMinorCompaction__hcl5c6kk3rohss946llgbhfnn6cdshmc9f8tborl884etamtv526s997cm7haacl/family1/e90500159bfe4e6ab8ef8418cd2636da 2023-02-12 03:55:33,203 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39639] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/staging/jenkins__ns_testMinorCompaction__hcl5c6kk3rohss946llgbhfnn6cdshmc9f8tborl884etamtv526s997cm7haacl/family1/e90500159bfe4e6ab8ef8418cd2636da as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/5de519c4afe22c04111a6724c632530e/family1/dbb533e65b2945c5861af2b43ee3edad_SeqId_28_ 2023-02-12 03:55:33,203 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39639] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/staging/jenkins__ns_testMinorCompaction__hcl5c6kk3rohss946llgbhfnn6cdshmc9f8tborl884etamtv526s997cm7haacl/family1/e90500159bfe4e6ab8ef8418cd2636da into 5de519c4afe22c04111a6724c632530e/family1 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/5de519c4afe22c04111a6724c632530e/family1/dbb533e65b2945c5861af2b43ee3edad_SeqId_28_ - updating store file list. 2023-02-12 03:55:33,206 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39639] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/5de519c4afe22c04111a6724c632530e/family1/dbb533e65b2945c5861af2b43ee3edad_SeqId_28_ into 5de519c4afe22c04111a6724c632530e/family1 2023-02-12 03:55:33,206 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39639] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/staging/jenkins__ns_testMinorCompaction__hcl5c6kk3rohss946llgbhfnn6cdshmc9f8tborl884etamtv526s997cm7haacl/family1/e90500159bfe4e6ab8ef8418cd2636da into 5de519c4afe22c04111a6724c632530e/family1 (new location: hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/5de519c4afe22c04111a6724c632530e/family1/dbb533e65b2945c5861af2b43ee3edad_SeqId_28_) 2023-02-12 03:55:33,206 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39639] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/staging/jenkins__ns_testMinorCompaction__hcl5c6kk3rohss946llgbhfnn6cdshmc9f8tborl884etamtv526s997cm7haacl/family1/e90500159bfe4e6ab8ef8418cd2636da 2023-02-12 03:55:33,208 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230212 table='ns:testMinorCompaction' column='family1' 2023-02-12 03:55:33,208 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-02-12 03:55:33,209 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20230212a5bd52694a574189afa15be802f39b6e to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20230212a5bd52694a574189afa15be802f39b6e 2023-02-12 03:55:33,209 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-02-12 03:55:33,209 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20230212' 2023-02-12 03:55:33,210 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20230212 for table='ns:testMinorCompaction' and column='family1' 2023-02-12 03:55:33,210 INFO [Listener at localhost.localdomain/41049] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='ns:testMinorCompaction' column='family1' 2023-02-12 03:55:33,212 DEBUG [Listener at localhost.localdomain/41049] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-12 03:55:33,215 DEBUG [Listener at localhost.localdomain/41049] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-12 03:55:33,218 DEBUG [Listener at localhost.localdomain/41049] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-12 03:55:33,219 DEBUG [Listener at localhost.localdomain/41049] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-12 03:55:33,237 INFO [Listener at localhost.localdomain/41049] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompaction Thread=246 (was 283), OpenFileDescriptor=617 (was 752), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=112 (was 130), ProcessCount=164 (was 164), AvailableMemoryMB=3895 (was 3922) 2023-02-12 03:55:33,252 INFO [Listener at localhost.localdomain/41049] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompactionWithMonthlyPolicy Thread=246, OpenFileDescriptor=617, MaxFileDescriptor=60000, SystemLoadAverage=112, ProcessCount=164, AvailableMemoryMB=3894 2023-02-12 03:55:33,255 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40099] master.HMaster$4(2102): Client=jenkins//148.251.75.209 create 'testMinorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-02-12 03:55:33,255 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40099] procedure2.ProcedureExecutor(1029): Stored pid=112, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:33,257 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-02-12 03:55:33,257 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40099] master.MasterRpcServices(697): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testMinorCompactionWithMonthlyPolicy" procId is: 112 2023-02-12 03:55:33,258 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-12 03:55:33,258 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40099] master.MasterRpcServices(1227): Checking to see if procedure is done pid=112 2023-02-12 03:55:33,259 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/a73fcc0290683d7b4b64c0d6b697edf9 2023-02-12 03:55:33,259 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/a73fcc0290683d7b4b64c0d6b697edf9 empty. 2023-02-12 03:55:33,259 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/a73fcc0290683d7b4b64c0d6b697edf9 2023-02-12 03:55:33,260 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testMinorCompactionWithMonthlyPolicy regions 2023-02-12 03:55:33,359 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40099] master.MasterRpcServices(1227): Checking to see if procedure is done pid=112 2023-02-12 03:55:33,560 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40099] master.MasterRpcServices(1227): Checking to see if procedure is done pid=112 2023-02-12 03:55:33,669 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/.tabledesc/.tableinfo.0000000001 2023-02-12 03:55:33,672 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(7671): creating {ENCODED => a73fcc0290683d7b4b64c0d6b697edf9, NAME => 'testMinorCompactionWithMonthlyPolicy,,1676174133254.a73fcc0290683d7b4b64c0d6b697edf9.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMinorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}, regionDir=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/.tmp 2023-02-12 03:55:33,862 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40099] master.MasterRpcServices(1227): Checking to see if procedure is done pid=112 2023-02-12 03:55:34,082 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(865): Instantiated testMinorCompactionWithMonthlyPolicy,,1676174133254.a73fcc0290683d7b4b64c0d6b697edf9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:55:34,083 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1603): Closing a73fcc0290683d7b4b64c0d6b697edf9, disabling compactions & flushes 2023-02-12 03:55:34,083 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1625): Closing region testMinorCompactionWithMonthlyPolicy,,1676174133254.a73fcc0290683d7b4b64c0d6b697edf9. 2023-02-12 03:55:34,083 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMinorCompactionWithMonthlyPolicy,,1676174133254.a73fcc0290683d7b4b64c0d6b697edf9. 2023-02-12 03:55:34,083 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1713): Acquired close lock on testMinorCompactionWithMonthlyPolicy,,1676174133254.a73fcc0290683d7b4b64c0d6b697edf9. after waiting 0 ms 2023-02-12 03:55:34,083 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1723): Updates disabled for region testMinorCompactionWithMonthlyPolicy,,1676174133254.a73fcc0290683d7b4b64c0d6b697edf9. 2023-02-12 03:55:34,083 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1837): Closed testMinorCompactionWithMonthlyPolicy,,1676174133254.a73fcc0290683d7b4b64c0d6b697edf9. 2023-02-12 03:55:34,083 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1557): Region close journal for a73fcc0290683d7b4b64c0d6b697edf9: Waiting for close lock at 1676174134083Disabling compacts and flushes for region at 1676174134083Disabling writes for close at 1676174134083Writing region close event to WAL at 1676174134083Closed at 1676174134083 2023-02-12 03:55:34,087 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-02-12 03:55:34,090 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMinorCompactionWithMonthlyPolicy,,1676174133254.a73fcc0290683d7b4b64c0d6b697edf9.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676174134089"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676174134089"}]},"ts":"1676174134089"} 2023-02-12 03:55:34,092 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-12 03:55:34,093 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-12 03:55:34,093 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676174134093"}]},"ts":"1676174134093"} 2023-02-12 03:55:34,095 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithMonthlyPolicy, state=ENABLING in hbase:meta 2023-02-12 03:55:34,099 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=a73fcc0290683d7b4b64c0d6b697edf9, ASSIGN}] 2023-02-12 03:55:34,101 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=a73fcc0290683d7b4b64c0d6b697edf9, ASSIGN 2023-02-12 03:55:34,102 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=a73fcc0290683d7b4b64c0d6b697edf9, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,39639,1676173982450; forceNewPlan=false, retain=false 2023-02-12 03:55:34,253 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=113 updating hbase:meta row=a73fcc0290683d7b4b64c0d6b697edf9, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:34,254 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMinorCompactionWithMonthlyPolicy,,1676174133254.a73fcc0290683d7b4b64c0d6b697edf9.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676174134253"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676174134253"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676174134253"}]},"ts":"1676174134253"} 2023-02-12 03:55:34,256 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=114, ppid=113, state=RUNNABLE; OpenRegionProcedure a73fcc0290683d7b4b64c0d6b697edf9, server=jenkins-hbase20.apache.org,39639,1676173982450}] 2023-02-12 03:55:34,364 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40099] master.MasterRpcServices(1227): Checking to see if procedure is done pid=112 2023-02-12 03:55:34,414 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testMinorCompactionWithMonthlyPolicy,,1676174133254.a73fcc0290683d7b4b64c0d6b697edf9. 2023-02-12 03:55:34,414 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => a73fcc0290683d7b4b64c0d6b697edf9, NAME => 'testMinorCompactionWithMonthlyPolicy,,1676174133254.a73fcc0290683d7b4b64c0d6b697edf9.', STARTKEY => '', ENDKEY => ''} 2023-02-12 03:55:34,415 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompactionWithMonthlyPolicy a73fcc0290683d7b4b64c0d6b697edf9 2023-02-12 03:55:34,415 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testMinorCompactionWithMonthlyPolicy,,1676174133254.a73fcc0290683d7b4b64c0d6b697edf9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:55:34,415 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for a73fcc0290683d7b4b64c0d6b697edf9 2023-02-12 03:55:34,415 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for a73fcc0290683d7b4b64c0d6b697edf9 2023-02-12 03:55:34,418 INFO [StoreOpener-a73fcc0290683d7b4b64c0d6b697edf9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region a73fcc0290683d7b4b64c0d6b697edf9 2023-02-12 03:55:34,420 DEBUG [StoreOpener-a73fcc0290683d7b4b64c0d6b697edf9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithMonthlyPolicy/a73fcc0290683d7b4b64c0d6b697edf9/family1 2023-02-12 03:55:34,420 DEBUG [StoreOpener-a73fcc0290683d7b4b64c0d6b697edf9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithMonthlyPolicy/a73fcc0290683d7b4b64c0d6b697edf9/family1 2023-02-12 03:55:34,421 INFO [StoreOpener-a73fcc0290683d7b4b64c0d6b697edf9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a73fcc0290683d7b4b64c0d6b697edf9 columnFamilyName family1 2023-02-12 03:55:34,423 INFO [StoreOpener-a73fcc0290683d7b4b64c0d6b697edf9-1] regionserver.HStore(310): Store=a73fcc0290683d7b4b64c0d6b697edf9/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:55:34,425 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithMonthlyPolicy/a73fcc0290683d7b4b64c0d6b697edf9 2023-02-12 03:55:34,426 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithMonthlyPolicy/a73fcc0290683d7b4b64c0d6b697edf9 2023-02-12 03:55:34,430 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for a73fcc0290683d7b4b64c0d6b697edf9 2023-02-12 03:55:34,431 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithMonthlyPolicy/a73fcc0290683d7b4b64c0d6b697edf9/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 03:55:34,431 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened a73fcc0290683d7b4b64c0d6b697edf9; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69564234, jitterRate=0.03658786416053772}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-12 03:55:34,431 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for a73fcc0290683d7b4b64c0d6b697edf9: Running coprocessor pre-open hook at 1676174134416Writing region info on filesystem at 1676174134416Initializing all the Stores at 1676174134417 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} at 1676174134418 (+1 ms)Cleaning up temporary data from old regions at 1676174134426 (+8 ms)Cleaning up detritus from prior splits at 1676174134427 (+1 ms)Running coprocessor post-open hooks at 1676174134431 (+4 ms)Region opened successfully at 1676174134431 2023-02-12 03:55:34,432 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMinorCompactionWithMonthlyPolicy,,1676174133254.a73fcc0290683d7b4b64c0d6b697edf9., pid=114, masterSystemTime=1676174134409 2023-02-12 03:55:34,433 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMinorCompactionWithMonthlyPolicy,,1676174133254.a73fcc0290683d7b4b64c0d6b697edf9. 2023-02-12 03:55:34,433 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testMinorCompactionWithMonthlyPolicy,,1676174133254.a73fcc0290683d7b4b64c0d6b697edf9. 2023-02-12 03:55:34,433 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=113 updating hbase:meta row=a73fcc0290683d7b4b64c0d6b697edf9, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:34,433 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMinorCompactionWithMonthlyPolicy,,1676174133254.a73fcc0290683d7b4b64c0d6b697edf9.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1676174134433"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676174134433"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676174134433"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676174134433"}]},"ts":"1676174134433"} 2023-02-12 03:55:34,435 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=114, resume processing ppid=113 2023-02-12 03:55:34,435 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=114, ppid=113, state=SUCCESS; OpenRegionProcedure a73fcc0290683d7b4b64c0d6b697edf9, server=jenkins-hbase20.apache.org,39639,1676173982450 in 178 msec 2023-02-12 03:55:34,436 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=113, resume processing ppid=112 2023-02-12 03:55:34,436 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=113, ppid=112, state=SUCCESS; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=a73fcc0290683d7b4b64c0d6b697edf9, ASSIGN in 336 msec 2023-02-12 03:55:34,437 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-12 03:55:34,437 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676174134437"}]},"ts":"1676174134437"} 2023-02-12 03:55:34,438 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithMonthlyPolicy, state=ENABLED in hbase:meta 2023-02-12 03:55:34,439 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-02-12 03:55:34,440 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=112, state=SUCCESS; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy in 1.1840 sec 2023-02-12 03:55:35,366 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40099] master.MasterRpcServices(1227): Checking to see if procedure is done pid=112 2023-02-12 03:55:35,367 INFO [Listener at localhost.localdomain/41049] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMinorCompactionWithMonthlyPolicy, procId: 112 completed 2023-02-12 03:55:35,388 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40099] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-12 03:55:35,390 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40099] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:35,390 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-02-12 03:55:35,390 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:55:35,390 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-12 03:55:35,390 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-12 03:55:35,390 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:35,390 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:35,391 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:35,391 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:55:35,391 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:55:35,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:55:35,391 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:35,391 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-12 03:55:35,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:35,392 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:35,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-12 03:55:35,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:35,392 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:35,392 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:35,392 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-12 03:55:35,392 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:55:35,392 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-12 03:55:35,392 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-12 03:55:35,392 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-12 03:55:35,393 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1676174133254.a73fcc0290683d7b4b64c0d6b697edf9. 2023-02-12 03:55:35,393 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1676174133254.a73fcc0290683d7b4b64c0d6b697edf9. started... 2023-02-12 03:55:35,393 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing a73fcc0290683d7b4b64c0d6b697edf9 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-02-12 03:55:35,819 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130ebc27a89ec8e456f994bd22309e6e858 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151130ebc27a89ec8e456f994bd22309e6e858 2023-02-12 03:55:36,224 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithMonthlyPolicy/a73fcc0290683d7b4b64c0d6b697edf9/.tmp/family1/9899ed51a59f45e39c3199dd124f638e 2023-02-12 03:55:36,233 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithMonthlyPolicy/a73fcc0290683d7b4b64c0d6b697edf9/.tmp/family1/9899ed51a59f45e39c3199dd124f638e as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithMonthlyPolicy/a73fcc0290683d7b4b64c0d6b697edf9/family1/9899ed51a59f45e39c3199dd124f638e 2023-02-12 03:55:36,239 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithMonthlyPolicy/a73fcc0290683d7b4b64c0d6b697edf9/family1/9899ed51a59f45e39c3199dd124f638e, entries=1000, sequenceid=5, filesize=166.0 K 2023-02-12 03:55:36,240 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for a73fcc0290683d7b4b64c0d6b697edf9 in 847ms, sequenceid=5, compaction requested=false 2023-02-12 03:55:36,240 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMinorCompactionWithMonthlyPolicy' 2023-02-12 03:55:36,240 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for a73fcc0290683d7b4b64c0d6b697edf9: 2023-02-12 03:55:36,240 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1676174133254.a73fcc0290683d7b4b64c0d6b697edf9. 2023-02-12 03:55:36,240 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-12 03:55:36,241 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-12 03:55:36,241 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:36,241 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-02-12 03:55:36,241 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-02-12 03:55:36,242 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:36,242 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:36,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:36,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:55:36,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:55:36,242 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:36,242 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 03:55:36,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:55:36,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:55:36,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:36,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:36,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:55:36,244 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-02-12 03:55:36,244 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@f906f5d[Count = 0] remaining members to acquire global barrier 2023-02-12 03:55:36,244 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-12 03:55:36,244 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:36,244 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:36,244 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:36,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:36,244 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-12 03:55:36,244 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:36,244 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-12 03:55:36,244 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-02-12 03:55:36,244 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,39639,1676173982450' in zk 2023-02-12 03:55:36,245 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:36,245 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-12 03:55:36,245 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:55:36,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:36,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:55:36,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:55:36,245 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-02-12 03:55:36,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:55:36,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:55:36,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:36,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:36,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:55:36,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:36,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:36,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,39639,1676173982450': 2023-02-12 03:55:36,247 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-12 03:55:36,247 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-02-12 03:55:36,247 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-12 03:55:36,247 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-12 03:55:36,247 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:36,247 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-12 03:55:36,248 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:36,248 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:36,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:36,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:55:36,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:55:36,248 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:36,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:36,248 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:55:36,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:55:36,248 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:55:36,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:55:36,248 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:36,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:36,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:36,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:55:36,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:36,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:36,249 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:36,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:55:36,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:36,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:36,250 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:36,250 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:55:36,250 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:36,251 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:55:36,251 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:36,251 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:36,251 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:55:36,251 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40099] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-02-12 03:55:36,251 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40099] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-12 03:55:36,251 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:55:36,251 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:36,251 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:36,251 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-12 03:55:36,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:55:36,251 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:36,251 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-12 03:55:36,251 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-12 03:55:36,251 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:55:36,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:55:36,351 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-12 03:55:36,352 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40099] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-12 03:55:36,356 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40099] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-12 03:55:36,357 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40099] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-12 03:55:36,357 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40099] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:36,357 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-02-12 03:55:36,357 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:55:36,357 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-12 03:55:36,357 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-12 03:55:36,358 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:36,358 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:36,358 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:36,358 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:55:36,358 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:55:36,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:55:36,358 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:36,359 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-12 03:55:36,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:36,359 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:36,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-12 03:55:36,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:36,359 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:36,359 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-02-12 03:55:36,359 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:36,360 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-12 03:55:36,360 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:55:36,360 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-12 03:55:36,360 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-12 03:55:36,360 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-12 03:55:36,360 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1676174133254.a73fcc0290683d7b4b64c0d6b697edf9. 2023-02-12 03:55:36,360 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1676174133254.a73fcc0290683d7b4b64c0d6b697edf9. started... 2023-02-12 03:55:36,360 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing a73fcc0290683d7b4b64c0d6b697edf9 1/1 column families, dataSize=74 B heapSize=408 B 2023-02-12 03:55:36,778 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511280dbde4ba1f2446d890524950fc405125 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511280dbde4ba1f2446d890524950fc405125 2023-02-12 03:55:37,184 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithMonthlyPolicy/a73fcc0290683d7b4b64c0d6b697edf9/.tmp/family1/4d25a3c9989243858a1fa5df8415f43d 2023-02-12 03:55:37,195 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithMonthlyPolicy/a73fcc0290683d7b4b64c0d6b697edf9/.tmp/family1/4d25a3c9989243858a1fa5df8415f43d as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithMonthlyPolicy/a73fcc0290683d7b4b64c0d6b697edf9/family1/4d25a3c9989243858a1fa5df8415f43d 2023-02-12 03:55:37,201 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithMonthlyPolicy/a73fcc0290683d7b4b64c0d6b697edf9/family1/4d25a3c9989243858a1fa5df8415f43d, entries=1, sequenceid=9, filesize=5.0 K 2023-02-12 03:55:37,202 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for a73fcc0290683d7b4b64c0d6b697edf9 in 842ms, sequenceid=9, compaction requested=false 2023-02-12 03:55:37,202 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for a73fcc0290683d7b4b64c0d6b697edf9: 2023-02-12 03:55:37,203 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1676174133254.a73fcc0290683d7b4b64c0d6b697edf9. 2023-02-12 03:55:37,203 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-12 03:55:37,203 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-12 03:55:37,203 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:37,203 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-02-12 03:55:37,203 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-02-12 03:55:37,204 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:37,205 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:37,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:37,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:55:37,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:55:37,205 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:37,205 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 03:55:37,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:55:37,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:55:37,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:37,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:37,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:55:37,208 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-02-12 03:55:37,208 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1bb7bfee[Count = 0] remaining members to acquire global barrier 2023-02-12 03:55:37,208 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-12 03:55:37,208 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:37,216 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:37,216 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:37,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:37,216 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-12 03:55:37,216 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-02-12 03:55:37,216 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,39639,1676173982450' in zk 2023-02-12 03:55:37,216 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:37,216 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-12 03:55:37,226 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:37,226 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-12 03:55:37,226 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:55:37,226 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-02-12 03:55:37,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:37,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:55:37,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:55:37,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:55:37,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:55:37,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:37,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:37,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:55:37,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:37,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:37,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,39639,1676173982450': 2023-02-12 03:55:37,233 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-12 03:55:37,233 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-02-12 03:55:37,233 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-12 03:55:37,233 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-12 03:55:37,233 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:37,233 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-12 03:55:37,235 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:37,235 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:55:37,235 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:37,236 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:37,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:37,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:55:37,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:55:37,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:37,236 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:37,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:55:37,237 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:55:37,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:55:37,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:37,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:37,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:55:37,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:37,239 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:37,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:37,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:55:37,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:37,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:37,244 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:37,244 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:55:37,244 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:55:37,244 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:37,244 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:37,244 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:37,244 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40099] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-02-12 03:55:37,244 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40099] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-12 03:55:37,244 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:55:37,244 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:55:37,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:55:37,244 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-12 03:55:37,244 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:37,244 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-12 03:55:37,245 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-12 03:55:37,245 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:37,245 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:55:37,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:55:37,245 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:37,345 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-12 03:55:37,347 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40099] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-12 03:55:37,355 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40099] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-12 03:55:37,358 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40099] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-12 03:55:37,358 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40099] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:37,358 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-02-12 03:55:37,358 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:55:37,358 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-12 03:55:37,358 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-12 03:55:37,359 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:37,359 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:37,361 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:55:37,361 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:37,361 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:55:37,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:55:37,361 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:37,362 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-12 03:55:37,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:37,362 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:37,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-12 03:55:37,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:37,363 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:37,363 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-02-12 03:55:37,363 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:37,364 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-12 03:55:37,364 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:55:37,364 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-12 03:55:37,364 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-12 03:55:37,364 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-12 03:55:37,364 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1676174133254.a73fcc0290683d7b4b64c0d6b697edf9. 2023-02-12 03:55:37,364 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1676174133254.a73fcc0290683d7b4b64c0d6b697edf9. started... 2023-02-12 03:55:37,364 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing a73fcc0290683d7b4b64c0d6b697edf9 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-12 03:55:37,785 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512014e3d6ee918c94eeb899399cef96267bc to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512014e3d6ee918c94eeb899399cef96267bc 2023-02-12 03:55:38,193 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithMonthlyPolicy/a73fcc0290683d7b4b64c0d6b697edf9/.tmp/family1/93abe957b56043f2bf400b6515117bc5 2023-02-12 03:55:38,201 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithMonthlyPolicy/a73fcc0290683d7b4b64c0d6b697edf9/.tmp/family1/93abe957b56043f2bf400b6515117bc5 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithMonthlyPolicy/a73fcc0290683d7b4b64c0d6b697edf9/family1/93abe957b56043f2bf400b6515117bc5 2023-02-12 03:55:38,207 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithMonthlyPolicy/a73fcc0290683d7b4b64c0d6b697edf9/family1/93abe957b56043f2bf400b6515117bc5, entries=1, sequenceid=13, filesize=4.9 K 2023-02-12 03:55:38,207 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for a73fcc0290683d7b4b64c0d6b697edf9 in 843ms, sequenceid=13, compaction requested=true 2023-02-12 03:55:38,208 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for a73fcc0290683d7b4b64c0d6b697edf9: 2023-02-12 03:55:38,208 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1676174133254.a73fcc0290683d7b4b64c0d6b697edf9. 2023-02-12 03:55:38,208 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-12 03:55:38,208 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-12 03:55:38,208 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:38,208 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-02-12 03:55:38,208 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-02-12 03:55:38,209 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:38,209 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:38,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:38,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:55:38,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:55:38,209 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:38,209 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 03:55:38,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:55:38,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:55:38,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:38,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:38,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:55:38,210 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-02-12 03:55:38,210 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@71bc244b[Count = 0] remaining members to acquire global barrier 2023-02-12 03:55:38,210 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-12 03:55:38,210 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:38,211 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:38,211 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:38,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:38,211 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-12 03:55:38,211 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-02-12 03:55:38,211 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,39639,1676173982450' in zk 2023-02-12 03:55:38,211 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:38,211 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-12 03:55:38,211 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-12 03:55:38,211 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:38,211 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:55:38,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:38,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:55:38,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:55:38,212 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-02-12 03:55:38,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:55:38,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:55:38,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:38,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:38,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:55:38,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:38,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:38,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,39639,1676173982450': 2023-02-12 03:55:38,213 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-12 03:55:38,213 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-02-12 03:55:38,213 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-12 03:55:38,213 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-12 03:55:38,213 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:38,213 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-12 03:55:38,214 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:38,214 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:38,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:38,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:55:38,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:55:38,214 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:55:38,214 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:38,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:38,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:55:38,214 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:55:38,214 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:38,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:55:38,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:38,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:38,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:55:38,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:38,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:38,215 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:38,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:55:38,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:38,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:38,217 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:38,217 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:55:38,217 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:38,217 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:55:38,217 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40099] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-02-12 03:55:38,217 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40099] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-12 03:55:38,217 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:55:38,217 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:55:38,217 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:38,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:55:38,217 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:38,217 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:38,217 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-12 03:55:38,217 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:38,217 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:55:38,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:55:38,217 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-12 03:55:38,217 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:38,317 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-12 03:55:38,318 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40099] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-12 03:55:38,322 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40099] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-12 03:55:38,324 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40099] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-12 03:55:38,324 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40099] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:38,325 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-02-12 03:55:38,325 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:55:38,325 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-12 03:55:38,325 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-12 03:55:38,325 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:38,325 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:38,326 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:55:38,326 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:38,326 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:55:38,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:55:38,327 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:38,327 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-12 03:55:38,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:38,327 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:38,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-12 03:55:38,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:38,328 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:38,328 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-02-12 03:55:38,328 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:38,328 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-12 03:55:38,328 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:55:38,328 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-12 03:55:38,328 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-12 03:55:38,329 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-12 03:55:38,329 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1676174133254.a73fcc0290683d7b4b64c0d6b697edf9. 2023-02-12 03:55:38,329 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1676174133254.a73fcc0290683d7b4b64c0d6b697edf9. started... 2023-02-12 03:55:38,329 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing a73fcc0290683d7b4b64c0d6b697edf9 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-12 03:55:38,748 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512051f9d340a3a554c06b21eb1cbeb0f4390 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512051f9d340a3a554c06b21eb1cbeb0f4390 2023-02-12 03:55:39,155 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithMonthlyPolicy/a73fcc0290683d7b4b64c0d6b697edf9/.tmp/family1/cf53443beea64579867203d0ba1cf4a1 2023-02-12 03:55:39,160 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithMonthlyPolicy/a73fcc0290683d7b4b64c0d6b697edf9/.tmp/family1/cf53443beea64579867203d0ba1cf4a1 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithMonthlyPolicy/a73fcc0290683d7b4b64c0d6b697edf9/family1/cf53443beea64579867203d0ba1cf4a1 2023-02-12 03:55:39,164 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithMonthlyPolicy/a73fcc0290683d7b4b64c0d6b697edf9/family1/cf53443beea64579867203d0ba1cf4a1, entries=1, sequenceid=17, filesize=4.9 K 2023-02-12 03:55:39,165 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for a73fcc0290683d7b4b64c0d6b697edf9 in 836ms, sequenceid=17, compaction requested=true 2023-02-12 03:55:39,165 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for a73fcc0290683d7b4b64c0d6b697edf9: 2023-02-12 03:55:39,166 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1676174133254.a73fcc0290683d7b4b64c0d6b697edf9. 2023-02-12 03:55:39,166 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-12 03:55:39,166 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-12 03:55:39,166 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:39,166 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-02-12 03:55:39,166 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-02-12 03:55:39,167 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:39,167 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:39,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:39,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:55:39,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:55:39,168 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:39,168 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 03:55:39,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:55:39,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:55:39,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:39,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:39,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:55:39,170 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-02-12 03:55:39,170 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@645bfdf[Count = 0] remaining members to acquire global barrier 2023-02-12 03:55:39,170 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-12 03:55:39,170 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:39,170 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:39,171 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:39,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:39,171 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-12 03:55:39,171 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-02-12 03:55:39,171 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,39639,1676173982450' in zk 2023-02-12 03:55:39,171 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:39,171 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-12 03:55:39,172 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-12 03:55:39,172 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:39,172 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:55:39,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:39,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:55:39,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:55:39,172 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-02-12 03:55:39,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:55:39,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:55:39,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:39,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:39,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:55:39,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:39,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:39,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,39639,1676173982450': 2023-02-12 03:55:39,175 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-12 03:55:39,175 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-02-12 03:55:39,175 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-12 03:55:39,175 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-12 03:55:39,175 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:39,175 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-12 03:55:39,176 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:39,176 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:39,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:39,176 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:39,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:39,176 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:55:39,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:55:39,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:55:39,177 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:55:39,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:55:39,177 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:39,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:55:39,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:39,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:39,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:55:39,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:39,179 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:39,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:39,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:55:39,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:39,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:39,190 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:39,190 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:55:39,190 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:55:39,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:55:39,191 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40099] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-02-12 03:55:39,191 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40099] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-12 03:55:39,190 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:39,191 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:55:39,190 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:55:39,191 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-12 03:55:39,191 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:39,191 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:55:39,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:55:39,191 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-12 03:55:39,191 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:39,192 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-12 03:55:39,192 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:39,192 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:39,192 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:39,292 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-12 03:55:39,293 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40099] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-12 03:55:39,299 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40099] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-12 03:55:39,301 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40099] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-12 03:55:39,301 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40099] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:39,301 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-02-12 03:55:39,301 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:55:39,301 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-12 03:55:39,301 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-12 03:55:39,302 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:39,302 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:39,303 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:55:39,303 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:39,303 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:55:39,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:55:39,303 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:39,304 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-12 03:55:39,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:39,304 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:39,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-12 03:55:39,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:39,305 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:39,305 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-02-12 03:55:39,306 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:39,306 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-12 03:55:39,306 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:55:39,306 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-12 03:55:39,306 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-12 03:55:39,306 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-12 03:55:39,306 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1676174133254.a73fcc0290683d7b4b64c0d6b697edf9. 2023-02-12 03:55:39,306 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1676174133254.a73fcc0290683d7b4b64c0d6b697edf9. started... 2023-02-12 03:55:39,306 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing a73fcc0290683d7b4b64c0d6b697edf9 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-12 03:55:39,722 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015122829a076d6d1144a2c9854241b319283de to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015122829a076d6d1144a2c9854241b319283de 2023-02-12 03:55:39,965 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-12 03:55:40,127 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithMonthlyPolicy/a73fcc0290683d7b4b64c0d6b697edf9/.tmp/family1/7ee8a034f26f48f7a8ac1d0807db3336 2023-02-12 03:55:40,135 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithMonthlyPolicy/a73fcc0290683d7b4b64c0d6b697edf9/.tmp/family1/7ee8a034f26f48f7a8ac1d0807db3336 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithMonthlyPolicy/a73fcc0290683d7b4b64c0d6b697edf9/family1/7ee8a034f26f48f7a8ac1d0807db3336 2023-02-12 03:55:40,142 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithMonthlyPolicy/a73fcc0290683d7b4b64c0d6b697edf9/family1/7ee8a034f26f48f7a8ac1d0807db3336, entries=1, sequenceid=21, filesize=4.9 K 2023-02-12 03:55:40,143 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for a73fcc0290683d7b4b64c0d6b697edf9 in 837ms, sequenceid=21, compaction requested=true 2023-02-12 03:55:40,143 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for a73fcc0290683d7b4b64c0d6b697edf9: 2023-02-12 03:55:40,143 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1676174133254.a73fcc0290683d7b4b64c0d6b697edf9. 2023-02-12 03:55:40,143 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-12 03:55:40,143 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-12 03:55:40,143 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:40,143 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-02-12 03:55:40,143 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-02-12 03:55:40,145 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:40,145 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:40,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:40,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:55:40,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:55:40,146 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:40,146 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 03:55:40,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:55:40,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:55:40,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:40,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:40,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:55:40,148 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-02-12 03:55:40,148 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@aa3c2cd[Count = 0] remaining members to acquire global barrier 2023-02-12 03:55:40,148 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-12 03:55:40,148 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:40,149 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:40,149 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:40,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:40,149 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-12 03:55:40,149 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-02-12 03:55:40,149 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,39639,1676173982450' in zk 2023-02-12 03:55:40,149 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:40,150 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-12 03:55:40,150 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-12 03:55:40,150 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:40,150 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:55:40,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:40,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:55:40,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:55:40,151 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-02-12 03:55:40,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:55:40,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:55:40,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:40,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:40,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:55:40,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:40,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:40,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,39639,1676173982450': 2023-02-12 03:55:40,154 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-12 03:55:40,154 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-02-12 03:55:40,154 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-12 03:55:40,154 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-12 03:55:40,154 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:40,154 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-12 03:55:40,166 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:40,166 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:55:40,166 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:40,166 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:40,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:40,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:55:40,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:55:40,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:40,167 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:40,167 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:55:40,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:55:40,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:55:40,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:40,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:40,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:55:40,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:40,170 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:40,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:40,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:55:40,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:40,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:40,173 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:55:40,173 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:40,174 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:40,174 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:40,174 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:55:40,174 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-12 03:55:40,174 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:55:40,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:55:40,174 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:55:40,174 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:40,174 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40099] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-02-12 03:55:40,174 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40099] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-12 03:55:40,174 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:40,175 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:55:40,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:55:40,175 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:40,175 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:40,175 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-12 03:55:40,175 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-12 03:55:40,275 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-12 03:55:40,277 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40099] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-12 03:55:40,285 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40099] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-12 03:55:40,288 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40099] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-12 03:55:40,288 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40099] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:40,288 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-02-12 03:55:40,288 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:55:40,289 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-12 03:55:40,289 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-12 03:55:40,289 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:40,290 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:40,290 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:55:40,290 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:40,291 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:55:40,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:55:40,291 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:40,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:40,291 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-12 03:55:40,292 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:40,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-12 03:55:40,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:40,292 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:40,293 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-02-12 03:55:40,293 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:40,293 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-12 03:55:40,293 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:55:40,293 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-12 03:55:40,293 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-12 03:55:40,293 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-12 03:55:40,293 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1676174133254.a73fcc0290683d7b4b64c0d6b697edf9. 2023-02-12 03:55:40,293 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1676174133254.a73fcc0290683d7b4b64c0d6b697edf9. started... 2023-02-12 03:55:40,293 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing a73fcc0290683d7b4b64c0d6b697edf9 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-12 03:55:40,308 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512319bb5115b24574d4f875284d183ed6f41 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512319bb5115b24574d4f875284d183ed6f41 2023-02-12 03:55:40,714 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithMonthlyPolicy/a73fcc0290683d7b4b64c0d6b697edf9/.tmp/family1/7931396310d64fbe9eb208b9733c24c2 2023-02-12 03:55:40,720 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithMonthlyPolicy/a73fcc0290683d7b4b64c0d6b697edf9/.tmp/family1/7931396310d64fbe9eb208b9733c24c2 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithMonthlyPolicy/a73fcc0290683d7b4b64c0d6b697edf9/family1/7931396310d64fbe9eb208b9733c24c2 2023-02-12 03:55:40,723 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithMonthlyPolicy/a73fcc0290683d7b4b64c0d6b697edf9/family1/7931396310d64fbe9eb208b9733c24c2, entries=1, sequenceid=25, filesize=4.9 K 2023-02-12 03:55:40,723 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for a73fcc0290683d7b4b64c0d6b697edf9 in 430ms, sequenceid=25, compaction requested=true 2023-02-12 03:55:40,723 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for a73fcc0290683d7b4b64c0d6b697edf9: 2023-02-12 03:55:40,723 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1676174133254.a73fcc0290683d7b4b64c0d6b697edf9. 2023-02-12 03:55:40,723 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-12 03:55:40,723 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-12 03:55:40,723 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:40,723 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-02-12 03:55:40,724 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-02-12 03:55:40,725 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:40,725 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:40,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:40,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:55:40,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:55:40,725 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:40,725 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 03:55:40,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:55:40,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:55:40,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:40,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:40,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:55:40,727 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-02-12 03:55:40,727 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2c4d54b8[Count = 0] remaining members to acquire global barrier 2023-02-12 03:55:40,727 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-12 03:55:40,727 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:40,727 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:40,727 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:40,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:40,727 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-12 03:55:40,727 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-02-12 03:55:40,727 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,39639,1676173982450' in zk 2023-02-12 03:55:40,727 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:40,727 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-12 03:55:40,728 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-12 03:55:40,728 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:40,728 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:55:40,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:40,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:55:40,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:55:40,728 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-02-12 03:55:40,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:55:40,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:55:40,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:40,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:40,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:55:40,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:40,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:40,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,39639,1676173982450': 2023-02-12 03:55:40,730 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-12 03:55:40,730 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-02-12 03:55:40,730 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-12 03:55:40,730 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-12 03:55:40,730 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:40,730 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-12 03:55:40,731 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:40,731 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:40,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:40,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:55:40,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:55:40,731 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:40,731 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:55:40,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:40,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:55:40,732 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:40,732 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:55:40,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:55:40,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:40,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:40,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:55:40,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:40,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:40,733 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:40,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:55:40,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:40,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:40,735 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:40,735 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:55:40,735 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:40,735 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:55:40,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:55:40,735 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:55:40,735 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-12 03:55:40,735 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:40,735 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:40,735 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:40,735 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40099] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-02-12 03:55:40,736 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40099] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-12 03:55:40,735 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:55:40,735 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:55:40,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:55:40,735 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:40,736 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:40,736 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-12 03:55:40,736 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-12 03:55:40,836 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-12 03:55:40,838 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40099] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-12 03:55:40,848 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40099] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-12 03:55:40,849 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40099] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-12 03:55:40,849 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40099] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:40,849 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-02-12 03:55:40,850 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:55:40,850 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-12 03:55:40,850 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-12 03:55:40,850 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:40,850 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:40,851 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:55:40,851 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:40,851 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:55:40,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:55:40,851 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:40,852 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-12 03:55:40,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:40,852 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:40,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-12 03:55:40,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:40,852 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:40,853 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-02-12 03:55:40,853 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:40,853 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-12 03:55:40,853 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:55:40,853 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-12 03:55:40,853 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-12 03:55:40,853 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-12 03:55:40,853 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1676174133254.a73fcc0290683d7b4b64c0d6b697edf9. 2023-02-12 03:55:40,853 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1676174133254.a73fcc0290683d7b4b64c0d6b697edf9. started... 2023-02-12 03:55:40,853 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing a73fcc0290683d7b4b64c0d6b697edf9 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-12 03:55:41,272 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101c99a64b122e1499e92b25c027e0d80b1 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160101c99a64b122e1499e92b25c027e0d80b1 2023-02-12 03:55:41,680 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithMonthlyPolicy/a73fcc0290683d7b4b64c0d6b697edf9/.tmp/family1/c1346aa5e1444821ab55b00506924897 2023-02-12 03:55:41,684 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithMonthlyPolicy/a73fcc0290683d7b4b64c0d6b697edf9/.tmp/family1/c1346aa5e1444821ab55b00506924897 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithMonthlyPolicy/a73fcc0290683d7b4b64c0d6b697edf9/family1/c1346aa5e1444821ab55b00506924897 2023-02-12 03:55:41,687 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithMonthlyPolicy/a73fcc0290683d7b4b64c0d6b697edf9/family1/c1346aa5e1444821ab55b00506924897, entries=1, sequenceid=29, filesize=4.9 K 2023-02-12 03:55:41,688 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for a73fcc0290683d7b4b64c0d6b697edf9 in 835ms, sequenceid=29, compaction requested=true 2023-02-12 03:55:41,688 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for a73fcc0290683d7b4b64c0d6b697edf9: 2023-02-12 03:55:41,688 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1676174133254.a73fcc0290683d7b4b64c0d6b697edf9. 2023-02-12 03:55:41,688 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-12 03:55:41,688 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-12 03:55:41,688 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:41,688 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-02-12 03:55:41,688 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-02-12 03:55:41,689 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:41,689 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:41,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:41,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:55:41,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:55:41,689 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:41,689 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 03:55:41,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:55:41,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:55:41,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:41,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:41,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:55:41,690 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-02-12 03:55:41,690 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3c43b306[Count = 0] remaining members to acquire global barrier 2023-02-12 03:55:41,690 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-12 03:55:41,690 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:41,691 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:41,691 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:41,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:41,691 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-12 03:55:41,691 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:41,691 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-12 03:55:41,691 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-02-12 03:55:41,691 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,39639,1676173982450' in zk 2023-02-12 03:55:41,692 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-12 03:55:41,692 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:41,692 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:55:41,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:41,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:55:41,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:55:41,692 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-02-12 03:55:41,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:55:41,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:55:41,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:41,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:41,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:55:41,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:41,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:41,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,39639,1676173982450': 2023-02-12 03:55:41,693 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-12 03:55:41,693 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-02-12 03:55:41,693 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-12 03:55:41,693 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-12 03:55:41,694 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:41,694 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-12 03:55:41,694 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:41,694 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:41,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:41,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:55:41,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:55:41,694 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:41,694 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:55:41,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:41,695 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:41,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:55:41,695 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:55:41,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:55:41,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:41,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:41,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:55:41,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:41,696 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:41,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:41,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:55:41,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:41,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:41,697 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:41,697 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:41,697 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:41,697 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:41,697 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:55:41,697 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-12 03:55:41,697 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:55:41,697 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40099] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-02-12 03:55:41,697 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40099] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-12 03:55:41,697 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:41,697 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:55:41,697 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:55:41,697 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:41,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:55:41,697 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:41,697 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-12 03:55:41,697 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-12 03:55:41,697 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:55:41,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:55:41,798 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-12 03:55:41,798 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40099] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-12 03:55:41,802 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40099] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-12 03:55:41,804 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40099] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-12 03:55:41,804 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40099] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:41,804 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-02-12 03:55:41,804 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:55:41,804 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-12 03:55:41,804 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-12 03:55:41,804 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:41,804 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:41,805 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:41,805 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:55:41,805 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:55:41,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:55:41,805 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:41,805 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-12 03:55:41,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:41,806 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:41,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-12 03:55:41,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:41,806 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:41,807 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-02-12 03:55:41,807 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:41,807 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-12 03:55:41,807 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:55:41,807 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-12 03:55:41,807 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-12 03:55:41,807 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-12 03:55:41,807 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1676174133254.a73fcc0290683d7b4b64c0d6b697edf9. 2023-02-12 03:55:41,807 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1676174133254.a73fcc0290683d7b4b64c0d6b697edf9. started... 2023-02-12 03:55:41,807 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing a73fcc0290683d7b4b64c0d6b697edf9 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-12 03:55:42,226 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103ad0d280ae1ef4d3bb923b0e71214ad8d to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160103ad0d280ae1ef4d3bb923b0e71214ad8d 2023-02-12 03:55:42,634 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithMonthlyPolicy/a73fcc0290683d7b4b64c0d6b697edf9/.tmp/family1/e84b12c6310a4ae18286ab1dc7488227 2023-02-12 03:55:42,644 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithMonthlyPolicy/a73fcc0290683d7b4b64c0d6b697edf9/.tmp/family1/e84b12c6310a4ae18286ab1dc7488227 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithMonthlyPolicy/a73fcc0290683d7b4b64c0d6b697edf9/family1/e84b12c6310a4ae18286ab1dc7488227 2023-02-12 03:55:42,648 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithMonthlyPolicy/a73fcc0290683d7b4b64c0d6b697edf9/family1/e84b12c6310a4ae18286ab1dc7488227, entries=1, sequenceid=33, filesize=4.9 K 2023-02-12 03:55:42,649 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for a73fcc0290683d7b4b64c0d6b697edf9 in 842ms, sequenceid=33, compaction requested=true 2023-02-12 03:55:42,649 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for a73fcc0290683d7b4b64c0d6b697edf9: 2023-02-12 03:55:42,649 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1676174133254.a73fcc0290683d7b4b64c0d6b697edf9. 2023-02-12 03:55:42,649 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-12 03:55:42,649 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-12 03:55:42,649 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:42,649 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-02-12 03:55:42,649 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-02-12 03:55:42,650 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:42,650 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:42,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:42,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:55:42,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:55:42,650 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:42,650 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 03:55:42,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:55:42,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:55:42,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:42,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:42,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:55:42,652 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-02-12 03:55:42,652 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@17535816[Count = 0] remaining members to acquire global barrier 2023-02-12 03:55:42,652 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-12 03:55:42,652 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:42,652 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:42,652 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:42,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:42,652 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-12 03:55:42,653 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-02-12 03:55:42,653 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,39639,1676173982450' in zk 2023-02-12 03:55:42,653 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:42,653 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-12 03:55:42,654 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-12 03:55:42,654 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:55:42,654 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:42,654 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-02-12 03:55:42,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:42,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:55:42,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:55:42,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:55:42,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:55:42,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:42,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:42,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:55:42,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:42,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:42,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,39639,1676173982450': 2023-02-12 03:55:42,656 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-12 03:55:42,656 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-02-12 03:55:42,656 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-12 03:55:42,656 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-12 03:55:42,656 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:42,656 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-12 03:55:42,657 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:42,657 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:55:42,657 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:42,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:42,657 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:42,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:42,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:55:42,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:55:42,657 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:55:42,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:55:42,657 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:42,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:55:42,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:42,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:42,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:55:42,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:42,658 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:42,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:42,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:55:42,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:42,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:42,660 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:42,660 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:55:42,660 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:42,660 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:55:42,660 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:55:42,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:55:42,660 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40099] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-02-12 03:55:42,660 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40099] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-12 03:55:42,660 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-12 03:55:42,660 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:55:42,660 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:55:42,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:55:42,660 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:42,660 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-12 03:55:42,660 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:42,660 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-12 03:55:42,660 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:42,660 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:42,660 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:42,760 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-12 03:55:42,762 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40099] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-12 03:55:42,770 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40099] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-12 03:55:42,772 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40099] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-12 03:55:42,772 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40099] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:42,772 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-02-12 03:55:42,772 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:55:42,772 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-12 03:55:42,772 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-12 03:55:42,773 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:42,773 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:42,774 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:42,774 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:55:42,774 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:55:42,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:55:42,774 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:42,774 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-12 03:55:42,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:42,775 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:42,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-12 03:55:42,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:42,775 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:42,775 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-02-12 03:55:42,775 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:42,775 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-12 03:55:42,776 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:55:42,776 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-12 03:55:42,776 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-12 03:55:42,776 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-12 03:55:42,776 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1676174133254.a73fcc0290683d7b4b64c0d6b697edf9. 2023-02-12 03:55:42,776 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1676174133254.a73fcc0290683d7b4b64c0d6b697edf9. started... 2023-02-12 03:55:42,776 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing a73fcc0290683d7b4b64c0d6b697edf9 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-12 03:55:43,196 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201509077e9a3e1a6d714b17928f4a267e8ecf2e to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201509077e9a3e1a6d714b17928f4a267e8ecf2e 2023-02-12 03:55:43,604 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithMonthlyPolicy/a73fcc0290683d7b4b64c0d6b697edf9/.tmp/family1/8cea55b4a2564a21b8d3b2603a46c252 2023-02-12 03:55:43,608 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithMonthlyPolicy/a73fcc0290683d7b4b64c0d6b697edf9/.tmp/family1/8cea55b4a2564a21b8d3b2603a46c252 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithMonthlyPolicy/a73fcc0290683d7b4b64c0d6b697edf9/family1/8cea55b4a2564a21b8d3b2603a46c252 2023-02-12 03:55:43,611 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithMonthlyPolicy/a73fcc0290683d7b4b64c0d6b697edf9/family1/8cea55b4a2564a21b8d3b2603a46c252, entries=1, sequenceid=37, filesize=4.9 K 2023-02-12 03:55:43,611 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for a73fcc0290683d7b4b64c0d6b697edf9 in 835ms, sequenceid=37, compaction requested=true 2023-02-12 03:55:43,612 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for a73fcc0290683d7b4b64c0d6b697edf9: 2023-02-12 03:55:43,612 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1676174133254.a73fcc0290683d7b4b64c0d6b697edf9. 2023-02-12 03:55:43,612 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-12 03:55:43,612 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-12 03:55:43,612 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:43,612 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-02-12 03:55:43,612 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-02-12 03:55:43,613 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:43,613 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:43,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:43,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:55:43,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:55:43,613 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:43,613 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 03:55:43,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:55:43,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:55:43,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:43,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:43,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:55:43,615 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-02-12 03:55:43,615 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@372459b[Count = 0] remaining members to acquire global barrier 2023-02-12 03:55:43,615 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-12 03:55:43,615 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:43,615 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:43,615 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:43,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:43,615 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-12 03:55:43,615 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:43,615 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-12 03:55:43,615 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-02-12 03:55:43,616 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,39639,1676173982450' in zk 2023-02-12 03:55:43,616 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-12 03:55:43,616 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:43,616 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:55:43,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:43,616 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-02-12 03:55:43,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:55:43,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:55:43,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:55:43,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:55:43,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:43,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:43,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:55:43,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:43,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:43,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,39639,1676173982450': 2023-02-12 03:55:43,618 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-12 03:55:43,618 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-02-12 03:55:43,618 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-12 03:55:43,618 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-12 03:55:43,618 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:43,618 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-12 03:55:43,619 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:43,619 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:43,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:43,619 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:43,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:55:43,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:55:43,619 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:55:43,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:43,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:55:43,619 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:43,619 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:55:43,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:55:43,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:43,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:43,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:55:43,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:43,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:43,620 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:43,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:55:43,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:43,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:43,621 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:55:43,621 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:43,621 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:55:43,621 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:55:43,621 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:55:43,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:55:43,621 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40099] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-02-12 03:55:43,622 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40099] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-12 03:55:43,621 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:43,622 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:43,622 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:43,622 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:43,622 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:43,622 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:55:43,622 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:43,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:55:43,622 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-12 03:55:43,622 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-12 03:55:43,722 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-12 03:55:43,723 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40099] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-12 03:55:43,726 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40099] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-12 03:55:43,727 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40099] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-12 03:55:43,727 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40099] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:43,727 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-02-12 03:55:43,727 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:55:43,727 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-12 03:55:43,727 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-12 03:55:43,728 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:43,728 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:43,728 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:55:43,728 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:43,729 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:55:43,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:55:43,729 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:43,729 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-12 03:55:43,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:43,729 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:43,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-12 03:55:43,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:43,730 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:43,730 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-02-12 03:55:43,730 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:43,730 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-12 03:55:43,730 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:55:43,730 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-12 03:55:43,730 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-12 03:55:43,730 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-12 03:55:43,730 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1676174133254.a73fcc0290683d7b4b64c0d6b697edf9. 2023-02-12 03:55:43,730 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1676174133254.a73fcc0290683d7b4b64c0d6b697edf9. started... 2023-02-12 03:55:43,730 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing a73fcc0290683d7b4b64c0d6b697edf9 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-12 03:55:44,148 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511206d4509156e16457891613552f130dca9 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511206d4509156e16457891613552f130dca9 2023-02-12 03:55:44,154 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithMonthlyPolicy/a73fcc0290683d7b4b64c0d6b697edf9/.tmp/family1/9936632bf8334f8a9009ad74da27923d 2023-02-12 03:55:44,158 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithMonthlyPolicy/a73fcc0290683d7b4b64c0d6b697edf9/.tmp/family1/9936632bf8334f8a9009ad74da27923d as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithMonthlyPolicy/a73fcc0290683d7b4b64c0d6b697edf9/family1/9936632bf8334f8a9009ad74da27923d 2023-02-12 03:55:44,162 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithMonthlyPolicy/a73fcc0290683d7b4b64c0d6b697edf9/family1/9936632bf8334f8a9009ad74da27923d, entries=1, sequenceid=41, filesize=4.9 K 2023-02-12 03:55:44,163 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for a73fcc0290683d7b4b64c0d6b697edf9 in 433ms, sequenceid=41, compaction requested=true 2023-02-12 03:55:44,163 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for a73fcc0290683d7b4b64c0d6b697edf9: 2023-02-12 03:55:44,163 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1676174133254.a73fcc0290683d7b4b64c0d6b697edf9. 2023-02-12 03:55:44,163 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-12 03:55:44,163 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-12 03:55:44,163 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:44,163 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-02-12 03:55:44,163 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-02-12 03:55:44,164 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:44,164 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:44,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:44,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:55:44,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:55:44,165 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:44,165 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 03:55:44,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:55:44,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:55:44,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:44,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:44,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:55:44,166 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-02-12 03:55:44,166 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@45dc29d9[Count = 0] remaining members to acquire global barrier 2023-02-12 03:55:44,166 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-12 03:55:44,166 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:44,167 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:44,167 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:44,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:44,167 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-12 03:55:44,167 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-02-12 03:55:44,167 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,39639,1676173982450' in zk 2023-02-12 03:55:44,167 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:44,167 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-12 03:55:44,168 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-12 03:55:44,168 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:55:44,168 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:44,168 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-02-12 03:55:44,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:44,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:55:44,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:55:44,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:55:44,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:55:44,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:44,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:44,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:55:44,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:44,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:44,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,39639,1676173982450': 2023-02-12 03:55:44,171 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-12 03:55:44,171 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-02-12 03:55:44,171 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-12 03:55:44,171 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-12 03:55:44,171 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:44,171 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-12 03:55:44,172 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:44,172 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:44,172 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:55:44,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:44,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:55:44,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:55:44,172 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:44,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:44,172 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:44,172 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:55:44,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:55:44,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:55:44,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:44,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:44,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:55:44,174 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:44,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:44,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:44,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:55:44,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:44,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:44,176 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:44,176 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:44,176 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:55:44,176 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:44,176 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:55:44,176 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40099] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-02-12 03:55:44,177 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40099] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-12 03:55:44,176 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:44,176 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:55:44,176 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:55:44,177 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-12 03:55:44,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:55:44,177 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:44,177 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-12 03:55:44,177 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:44,177 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-12 03:55:44,177 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:55:44,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:55:44,177 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:44,277 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-12 03:55:44,279 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40099] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-12 03:55:44,285 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=40099] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMinorCompactionWithMonthlyPolicy 2023-02-12 03:55:44,287 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676173985818] procedure2.ProcedureExecutor(1029): Stored pid=115, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-02-12 03:55:44,288 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=115, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-02-12 03:55:44,289 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676173985818] mob.MobUtils(833): start MOB compaction of files for table='testMinorCompactionWithMonthlyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-12 03:55:44,289 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=115, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1676174744289 2023-02-12 03:55:44,292 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676173985818] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-02-12 03:55:44,293 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676173985818] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMinorCompactionWithMonthlyPolicy' and column 'family1' 2023-02-12 03:55:44,293 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676173985818] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-02-12 03:55:44,294 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676173985818] zookeeper.ReadOnlyZKClient(139): Connect 0x34dba85f to 127.0.0.1:59556 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 03:55:44,302 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676173985818] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7ef0526a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 03:55:44,302 INFO [MobCompactor-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-02-12 03:55:45,133 INFO [MobCompactor-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601036d459b2dbc4641a585d7f298b040456f to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201601036d459b2dbc4641a585d7f298b040456f 2023-02-12 03:55:45,134 INFO [MobCompactor-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-02-12 03:55:45,145 DEBUG [MobCompactor-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-12 03:55:45,148 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:38170, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-12 03:55:45,154 DEBUG [MobCompactor-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-12 03:55:45,155 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:49802, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-12 03:55:45,162 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/cd73cfc065564fcdba4e7761cb7fbd89 first=Optional[r5] last=Optional[r6] 2023-02-12 03:55:45,163 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1676174133254.a73fcc0290683d7b4b64c0d6b697edf9., hostname=jenkins-hbase20.apache.org,39639,1676173982450, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/cd73cfc065564fcdba4e7761cb7fbd89}] 2023-02-12 03:55:45,169 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39639] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/cd73cfc065564fcdba4e7761cb7fbd89 for inclusion in a73fcc0290683d7b4b64c0d6b697edf9/family1 2023-02-12 03:55:45,171 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39639] regionserver.HStore(775): HFile bounds: first=r5 last=r6 2023-02-12 03:55:45,171 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39639] regionserver.HStore(777): Region bounds: first= last= 2023-02-12 03:55:45,171 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39639] regionserver.HRegion(2445): Flush status journal for a73fcc0290683d7b4b64c0d6b697edf9: 2023-02-12 03:55:45,172 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39639] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/cd73cfc065564fcdba4e7761cb7fbd89 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/staging/jenkins__testMinorCompactionWithMonthlyPolicy__klu8k891kf468g11u1227ebedbf3otbhlskcb1i0ep2rolbj976pi9i31eiki2fd/family1/cd73cfc065564fcdba4e7761cb7fbd89 2023-02-12 03:55:45,174 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39639] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/staging/jenkins__testMinorCompactionWithMonthlyPolicy__klu8k891kf468g11u1227ebedbf3otbhlskcb1i0ep2rolbj976pi9i31eiki2fd/family1/cd73cfc065564fcdba4e7761cb7fbd89 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithMonthlyPolicy/a73fcc0290683d7b4b64c0d6b697edf9/family1/6e7fa0d880b4487cbf2d5b76a331d249_SeqId_44_ 2023-02-12 03:55:45,174 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39639] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/staging/jenkins__testMinorCompactionWithMonthlyPolicy__klu8k891kf468g11u1227ebedbf3otbhlskcb1i0ep2rolbj976pi9i31eiki2fd/family1/cd73cfc065564fcdba4e7761cb7fbd89 into a73fcc0290683d7b4b64c0d6b697edf9/family1 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithMonthlyPolicy/a73fcc0290683d7b4b64c0d6b697edf9/family1/6e7fa0d880b4487cbf2d5b76a331d249_SeqId_44_ - updating store file list. 2023-02-12 03:55:45,177 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39639] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithMonthlyPolicy/a73fcc0290683d7b4b64c0d6b697edf9/family1/6e7fa0d880b4487cbf2d5b76a331d249_SeqId_44_ into a73fcc0290683d7b4b64c0d6b697edf9/family1 2023-02-12 03:55:45,177 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39639] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/staging/jenkins__testMinorCompactionWithMonthlyPolicy__klu8k891kf468g11u1227ebedbf3otbhlskcb1i0ep2rolbj976pi9i31eiki2fd/family1/cd73cfc065564fcdba4e7761cb7fbd89 into a73fcc0290683d7b4b64c0d6b697edf9/family1 (new location: hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithMonthlyPolicy/a73fcc0290683d7b4b64c0d6b697edf9/family1/6e7fa0d880b4487cbf2d5b76a331d249_SeqId_44_) 2023-02-12 03:55:45,177 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39639] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/staging/jenkins__testMinorCompactionWithMonthlyPolicy__klu8k891kf468g11u1227ebedbf3otbhlskcb1i0ep2rolbj976pi9i31eiki2fd/family1/cd73cfc065564fcdba4e7761cb7fbd89 2023-02-12 03:55:45,177 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39639] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-02-12 03:55:45,179 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39639] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 50903 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-02-12 03:55:45,179 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39639] regionserver.HStore(1912): a73fcc0290683d7b4b64c0d6b697edf9/family1 is initiating minor compaction 2023-02-12 03:55:45,179 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39639] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@dd9a7f8; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-02-12 03:55:45,179 INFO [RS:0;jenkins-hbase20:39639-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of a73fcc0290683d7b4b64c0d6b697edf9/family1 in testMinorCompactionWithMonthlyPolicy,,1676174133254.a73fcc0290683d7b4b64c0d6b697edf9. 2023-02-12 03:55:45,179 INFO [RS:0;jenkins-hbase20:39639-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithMonthlyPolicy/a73fcc0290683d7b4b64c0d6b697edf9/family1/4d25a3c9989243858a1fa5df8415f43d, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithMonthlyPolicy/a73fcc0290683d7b4b64c0d6b697edf9/family1/93abe957b56043f2bf400b6515117bc5, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithMonthlyPolicy/a73fcc0290683d7b4b64c0d6b697edf9/family1/cf53443beea64579867203d0ba1cf4a1, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithMonthlyPolicy/a73fcc0290683d7b4b64c0d6b697edf9/family1/7ee8a034f26f48f7a8ac1d0807db3336, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithMonthlyPolicy/a73fcc0290683d7b4b64c0d6b697edf9/family1/7931396310d64fbe9eb208b9733c24c2, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithMonthlyPolicy/a73fcc0290683d7b4b64c0d6b697edf9/family1/c1346aa5e1444821ab55b00506924897, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithMonthlyPolicy/a73fcc0290683d7b4b64c0d6b697edf9/family1/e84b12c6310a4ae18286ab1dc7488227, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithMonthlyPolicy/a73fcc0290683d7b4b64c0d6b697edf9/family1/8cea55b4a2564a21b8d3b2603a46c252, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithMonthlyPolicy/a73fcc0290683d7b4b64c0d6b697edf9/family1/9936632bf8334f8a9009ad74da27923d, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithMonthlyPolicy/a73fcc0290683d7b4b64c0d6b697edf9/family1/6e7fa0d880b4487cbf2d5b76a331d249_SeqId_44_] into tmpdir=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithMonthlyPolicy/a73fcc0290683d7b4b64c0d6b697edf9/.tmp, totalSize=49.7 K 2023-02-12 03:55:45,179 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] compactions.Compactor(207): Compacting 4d25a3c9989243858a1fa5df8415f43d, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-02-12 03:55:45,179 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] compactions.Compactor(207): Compacting 93abe957b56043f2bf400b6515117bc5, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-02-12 03:55:45,180 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] compactions.Compactor(207): Compacting cf53443beea64579867203d0ba1cf4a1, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-02-12 03:55:45,180 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] compactions.Compactor(207): Compacting 7ee8a034f26f48f7a8ac1d0807db3336, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-02-12 03:55:45,180 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] compactions.Compactor(207): Compacting 7931396310d64fbe9eb208b9733c24c2, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-02-12 03:55:45,180 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] compactions.Compactor(207): Compacting c1346aa5e1444821ab55b00506924897, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-02-12 03:55:45,180 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] compactions.Compactor(207): Compacting e84b12c6310a4ae18286ab1dc7488227, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-02-12 03:55:45,180 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] compactions.Compactor(207): Compacting 8cea55b4a2564a21b8d3b2603a46c252, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-02-12 03:55:45,180 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] compactions.Compactor(207): Compacting 9936632bf8334f8a9009ad74da27923d, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-02-12 03:55:45,180 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] compactions.Compactor(207): Compacting 6e7fa0d880b4487cbf2d5b76a331d249_SeqId_44_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=45 2023-02-12 03:55:45,181 INFO [MobCompactor-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-02-12 03:55:45,181 DEBUG [MobCompactor-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-02-12 03:55:45,182 DEBUG [MobCompactor-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160101c99a64b122e1499e92b25c027e0d80b1 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160101c99a64b122e1499e92b25c027e0d80b1 2023-02-12 03:55:45,183 DEBUG [MobCompactor-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160103ad0d280ae1ef4d3bb923b0e71214ad8d to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160103ad0d280ae1ef4d3bb923b0e71214ad8d 2023-02-12 03:55:45,183 INFO [MobCompactor-pool-1] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 2 expired mob files are deleted 2023-02-12 03:55:45,183 DEBUG [MobCompactor-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101' 2023-02-12 03:55:45,184 INFO [MobCompactor-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-02-12 03:55:45,184 INFO [MobCompactor-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-02-12 03:55:45,205 INFO [RS:0;jenkins-hbase20:39639-shortCompactions-0] throttle.PressureAwareThroughputController(145): a73fcc0290683d7b4b64c0d6b697edf9#family1#compaction#166 average throughput is 0.46 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 57.69 MB/second 2023-02-12 03:55:46,025 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithMonthlyPolicy/a73fcc0290683d7b4b64c0d6b697edf9/.tmp/family1/3dc934a92477465196f67d427b64bbb0 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithMonthlyPolicy/a73fcc0290683d7b4b64c0d6b697edf9/family1/3dc934a92477465196f67d427b64bbb0 2023-02-12 03:55:46,031 INFO [MobCompactor-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512318a2e44595ead4a658d2590f234530112 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512318a2e44595ead4a658d2590f234530112 2023-02-12 03:55:46,032 INFO [RS:0;jenkins-hbase20:39639-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in a73fcc0290683d7b4b64c0d6b697edf9/family1 of a73fcc0290683d7b4b64c0d6b697edf9 into 3dc934a92477465196f67d427b64bbb0(size=6.6 K), total size for store is 172.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-12 03:55:46,032 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for a73fcc0290683d7b4b64c0d6b697edf9: 2023-02-12 03:55:46,032 INFO [MobCompactor-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-02-12 03:55:46,032 INFO [RS:0;jenkins-hbase20:39639-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithMonthlyPolicy,,1676174133254.a73fcc0290683d7b4b64c0d6b697edf9., storeName=family1, fileCount=10, fileSize=49.7 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.2 K), priority=2, time=1676174145179; duration=0sec 2023-02-12 03:55:46,032 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-12 03:55:46,052 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithMonthlyPolicy/a73fcc0290683d7b4b64c0d6b697edf9/family1/4d25a3c9989243858a1fa5df8415f43d, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithMonthlyPolicy/a73fcc0290683d7b4b64c0d6b697edf9/family1/93abe957b56043f2bf400b6515117bc5, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithMonthlyPolicy/a73fcc0290683d7b4b64c0d6b697edf9/family1/cf53443beea64579867203d0ba1cf4a1, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithMonthlyPolicy/a73fcc0290683d7b4b64c0d6b697edf9/family1/7ee8a034f26f48f7a8ac1d0807db3336, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithMonthlyPolicy/a73fcc0290683d7b4b64c0d6b697edf9/family1/7931396310d64fbe9eb208b9733c24c2, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithMonthlyPolicy/a73fcc0290683d7b4b64c0d6b697edf9/family1/c1346aa5e1444821ab55b00506924897, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithMonthlyPolicy/a73fcc0290683d7b4b64c0d6b697edf9/family1/e84b12c6310a4ae18286ab1dc7488227, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithMonthlyPolicy/a73fcc0290683d7b4b64c0d6b697edf9/family1/8cea55b4a2564a21b8d3b2603a46c252, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithMonthlyPolicy/a73fcc0290683d7b4b64c0d6b697edf9/family1/9936632bf8334f8a9009ad74da27923d, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithMonthlyPolicy/a73fcc0290683d7b4b64c0d6b697edf9/family1/6e7fa0d880b4487cbf2d5b76a331d249_SeqId_44_] to archive 2023-02-12 03:55:46,053 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/d27028d5309e49f883cb3aa3cf3c46f7 first=Optional[r1] last=Optional[r4] 2023-02-12 03:55:46,053 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-12 03:55:46,054 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1676174133254.a73fcc0290683d7b4b64c0d6b697edf9., hostname=jenkins-hbase20.apache.org,39639,1676173982450, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/d27028d5309e49f883cb3aa3cf3c46f7}] 2023-02-12 03:55:46,055 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithMonthlyPolicy/a73fcc0290683d7b4b64c0d6b697edf9/family1/4d25a3c9989243858a1fa5df8415f43d to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMinorCompactionWithMonthlyPolicy/a73fcc0290683d7b4b64c0d6b697edf9/family1/4d25a3c9989243858a1fa5df8415f43d 2023-02-12 03:55:46,055 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39639] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/d27028d5309e49f883cb3aa3cf3c46f7 for inclusion in a73fcc0290683d7b4b64c0d6b697edf9/family1 2023-02-12 03:55:46,056 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithMonthlyPolicy/a73fcc0290683d7b4b64c0d6b697edf9/family1/93abe957b56043f2bf400b6515117bc5 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMinorCompactionWithMonthlyPolicy/a73fcc0290683d7b4b64c0d6b697edf9/family1/93abe957b56043f2bf400b6515117bc5 2023-02-12 03:55:46,057 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithMonthlyPolicy/a73fcc0290683d7b4b64c0d6b697edf9/family1/cf53443beea64579867203d0ba1cf4a1 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMinorCompactionWithMonthlyPolicy/a73fcc0290683d7b4b64c0d6b697edf9/family1/cf53443beea64579867203d0ba1cf4a1 2023-02-12 03:55:46,058 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39639] regionserver.HStore(775): HFile bounds: first=r1 last=r4 2023-02-12 03:55:46,058 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39639] regionserver.HStore(777): Region bounds: first= last= 2023-02-12 03:55:46,058 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39639] regionserver.HRegion(2445): Flush status journal for a73fcc0290683d7b4b64c0d6b697edf9: 2023-02-12 03:55:46,058 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithMonthlyPolicy/a73fcc0290683d7b4b64c0d6b697edf9/family1/7ee8a034f26f48f7a8ac1d0807db3336 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMinorCompactionWithMonthlyPolicy/a73fcc0290683d7b4b64c0d6b697edf9/family1/7ee8a034f26f48f7a8ac1d0807db3336 2023-02-12 03:55:46,058 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39639] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/d27028d5309e49f883cb3aa3cf3c46f7 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/staging/jenkins__testMinorCompactionWithMonthlyPolicy__7hgb0ho8dtsbg6ibqgac4aqp74imh7epqe7e34edf5rrsttniv0afk1chahgcf8p/family1/d27028d5309e49f883cb3aa3cf3c46f7 2023-02-12 03:55:46,059 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithMonthlyPolicy/a73fcc0290683d7b4b64c0d6b697edf9/family1/7931396310d64fbe9eb208b9733c24c2 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMinorCompactionWithMonthlyPolicy/a73fcc0290683d7b4b64c0d6b697edf9/family1/7931396310d64fbe9eb208b9733c24c2 2023-02-12 03:55:46,060 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithMonthlyPolicy/a73fcc0290683d7b4b64c0d6b697edf9/family1/c1346aa5e1444821ab55b00506924897 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMinorCompactionWithMonthlyPolicy/a73fcc0290683d7b4b64c0d6b697edf9/family1/c1346aa5e1444821ab55b00506924897 2023-02-12 03:55:46,060 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39639] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/staging/jenkins__testMinorCompactionWithMonthlyPolicy__7hgb0ho8dtsbg6ibqgac4aqp74imh7epqe7e34edf5rrsttniv0afk1chahgcf8p/family1/d27028d5309e49f883cb3aa3cf3c46f7 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithMonthlyPolicy/a73fcc0290683d7b4b64c0d6b697edf9/family1/31a5c374a98a40129503762eba383bd5_SeqId_47_ 2023-02-12 03:55:46,060 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39639] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/staging/jenkins__testMinorCompactionWithMonthlyPolicy__7hgb0ho8dtsbg6ibqgac4aqp74imh7epqe7e34edf5rrsttniv0afk1chahgcf8p/family1/d27028d5309e49f883cb3aa3cf3c46f7 into a73fcc0290683d7b4b64c0d6b697edf9/family1 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithMonthlyPolicy/a73fcc0290683d7b4b64c0d6b697edf9/family1/31a5c374a98a40129503762eba383bd5_SeqId_47_ - updating store file list. 2023-02-12 03:55:46,061 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithMonthlyPolicy/a73fcc0290683d7b4b64c0d6b697edf9/family1/e84b12c6310a4ae18286ab1dc7488227 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMinorCompactionWithMonthlyPolicy/a73fcc0290683d7b4b64c0d6b697edf9/family1/e84b12c6310a4ae18286ab1dc7488227 2023-02-12 03:55:46,062 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithMonthlyPolicy/a73fcc0290683d7b4b64c0d6b697edf9/family1/8cea55b4a2564a21b8d3b2603a46c252 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMinorCompactionWithMonthlyPolicy/a73fcc0290683d7b4b64c0d6b697edf9/family1/8cea55b4a2564a21b8d3b2603a46c252 2023-02-12 03:55:46,063 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithMonthlyPolicy/a73fcc0290683d7b4b64c0d6b697edf9/family1/9936632bf8334f8a9009ad74da27923d to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMinorCompactionWithMonthlyPolicy/a73fcc0290683d7b4b64c0d6b697edf9/family1/9936632bf8334f8a9009ad74da27923d 2023-02-12 03:55:46,064 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39639] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithMonthlyPolicy/a73fcc0290683d7b4b64c0d6b697edf9/family1/31a5c374a98a40129503762eba383bd5_SeqId_47_ into a73fcc0290683d7b4b64c0d6b697edf9/family1 2023-02-12 03:55:46,064 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39639] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/staging/jenkins__testMinorCompactionWithMonthlyPolicy__7hgb0ho8dtsbg6ibqgac4aqp74imh7epqe7e34edf5rrsttniv0afk1chahgcf8p/family1/d27028d5309e49f883cb3aa3cf3c46f7 into a73fcc0290683d7b4b64c0d6b697edf9/family1 (new location: hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithMonthlyPolicy/a73fcc0290683d7b4b64c0d6b697edf9/family1/31a5c374a98a40129503762eba383bd5_SeqId_47_) 2023-02-12 03:55:46,064 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithMonthlyPolicy/a73fcc0290683d7b4b64c0d6b697edf9/family1/6e7fa0d880b4487cbf2d5b76a331d249_SeqId_44_ to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMinorCompactionWithMonthlyPolicy/a73fcc0290683d7b4b64c0d6b697edf9/family1/6e7fa0d880b4487cbf2d5b76a331d249_SeqId_44_ 2023-02-12 03:55:46,064 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39639] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/staging/jenkins__testMinorCompactionWithMonthlyPolicy__7hgb0ho8dtsbg6ibqgac4aqp74imh7epqe7e34edf5rrsttniv0afk1chahgcf8p/family1/d27028d5309e49f883cb3aa3cf3c46f7 2023-02-12 03:55:46,065 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39639] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-02-12 03:55:46,065 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39639] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 182349 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-02-12 03:55:46,065 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39639] regionserver.HStore(1912): a73fcc0290683d7b4b64c0d6b697edf9/family1 is initiating minor compaction (all files) 2023-02-12 03:55:46,066 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39639] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@4319adee; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-12 03:55:46,066 INFO [RS:0;jenkins-hbase20:39639-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of a73fcc0290683d7b4b64c0d6b697edf9/family1 in testMinorCompactionWithMonthlyPolicy,,1676174133254.a73fcc0290683d7b4b64c0d6b697edf9. 2023-02-12 03:55:46,066 INFO [RS:0;jenkins-hbase20:39639-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithMonthlyPolicy/a73fcc0290683d7b4b64c0d6b697edf9/family1/9899ed51a59f45e39c3199dd124f638e, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithMonthlyPolicy/a73fcc0290683d7b4b64c0d6b697edf9/family1/3dc934a92477465196f67d427b64bbb0, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithMonthlyPolicy/a73fcc0290683d7b4b64c0d6b697edf9/family1/31a5c374a98a40129503762eba383bd5_SeqId_47_] into tmpdir=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithMonthlyPolicy/a73fcc0290683d7b4b64c0d6b697edf9/.tmp, totalSize=178.1 K 2023-02-12 03:55:46,066 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] compactions.Compactor(207): Compacting 9899ed51a59f45e39c3199dd124f638e, keycount=1000, bloomtype=ROW, size=166.0 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878805947 2023-02-12 03:55:46,066 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] compactions.Compactor(207): Compacting 3dc934a92477465196f67d427b64bbb0, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621205947 2023-02-12 03:55:46,067 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] compactions.Compactor(207): Compacting 31a5c374a98a40129503762eba383bd5_SeqId_47_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448965205947 2023-02-12 03:55:46,067 INFO [MobCompactor-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-02-12 03:55:46,068 DEBUG [MobCompactor-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-02-12 03:55:46,069 DEBUG [MobCompactor-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512014e3d6ee918c94eeb899399cef96267bc to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512014e3d6ee918c94eeb899399cef96267bc 2023-02-12 03:55:46,070 DEBUG [MobCompactor-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512051f9d340a3a554c06b21eb1cbeb0f4390 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512051f9d340a3a554c06b21eb1cbeb0f4390 2023-02-12 03:55:46,071 DEBUG [MobCompactor-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015122829a076d6d1144a2c9854241b319283de to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015122829a076d6d1144a2c9854241b319283de 2023-02-12 03:55:46,072 DEBUG [MobCompactor-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512319bb5115b24574d4f875284d183ed6f41 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512319bb5115b24574d4f875284d183ed6f41 2023-02-12 03:55:46,072 INFO [MobCompactor-pool-1] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 4 expired mob files are deleted 2023-02-12 03:55:46,072 DEBUG [MobCompactor-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201' 2023-02-12 03:55:46,072 INFO [MobCompactor-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-02-12 03:55:46,072 INFO [MobCompactor-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-02-12 03:55:46,080 INFO [RS:0;jenkins-hbase20:39639-shortCompactions-0] throttle.PressureAwareThroughputController(145): a73fcc0290683d7b4b64c0d6b697edf9#family1#compaction#167 average throughput is 22.23 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 57.69 MB/second 2023-02-12 03:55:46,521 INFO [MobCompactor-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511307a5950898c7046c98416a76aa478526a to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511307a5950898c7046c98416a76aa478526a 2023-02-12 03:55:46,522 INFO [MobCompactor-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-02-12 03:55:46,522 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithMonthlyPolicy/a73fcc0290683d7b4b64c0d6b697edf9/.tmp/family1/dd4e0b04144947b8a9f1f3cbaf503328 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithMonthlyPolicy/a73fcc0290683d7b4b64c0d6b697edf9/family1/dd4e0b04144947b8a9f1f3cbaf503328 2023-02-12 03:55:46,527 INFO [RS:0;jenkins-hbase20:39639-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in a73fcc0290683d7b4b64c0d6b697edf9/family1 of a73fcc0290683d7b4b64c0d6b697edf9 into dd4e0b04144947b8a9f1f3cbaf503328(size=167.4 K), total size for store is 167.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-12 03:55:46,527 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for a73fcc0290683d7b4b64c0d6b697edf9: 2023-02-12 03:55:46,527 INFO [RS:0;jenkins-hbase20:39639-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithMonthlyPolicy,,1676174133254.a73fcc0290683d7b4b64c0d6b697edf9., storeName=family1, fileCount=3, fileSize=178.1 K (166.0 K, 6.6 K, 5.5 K), priority=2, time=1676174146065; duration=0sec 2023-02-12 03:55:46,527 DEBUG [RS:0;jenkins-hbase20:39639-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-12 03:55:46,543 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/b8f595b299fc404e8a2b567e910dd0c3 first=Optional[r00] last=Optional[r8] 2023-02-12 03:55:46,543 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1676174133254.a73fcc0290683d7b4b64c0d6b697edf9., hostname=jenkins-hbase20.apache.org,39639,1676173982450, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/b8f595b299fc404e8a2b567e910dd0c3}] 2023-02-12 03:55:46,545 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39639] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/b8f595b299fc404e8a2b567e910dd0c3 for inclusion in a73fcc0290683d7b4b64c0d6b697edf9/family1 2023-02-12 03:55:46,547 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39639] regionserver.HStore(775): HFile bounds: first=r00 last=r8 2023-02-12 03:55:46,547 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39639] regionserver.HStore(777): Region bounds: first= last= 2023-02-12 03:55:46,547 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39639] regionserver.HRegion(2445): Flush status journal for a73fcc0290683d7b4b64c0d6b697edf9: 2023-02-12 03:55:46,548 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39639] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/b8f595b299fc404e8a2b567e910dd0c3 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/staging/jenkins__testMinorCompactionWithMonthlyPolicy__tgm4fvs7h3k8obirdivk3tkbalu01ruo43alig1tv1ev1docs6v7jbd3qvo6tndq/family1/b8f595b299fc404e8a2b567e910dd0c3 2023-02-12 03:55:46,550 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39639] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/staging/jenkins__testMinorCompactionWithMonthlyPolicy__tgm4fvs7h3k8obirdivk3tkbalu01ruo43alig1tv1ev1docs6v7jbd3qvo6tndq/family1/b8f595b299fc404e8a2b567e910dd0c3 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithMonthlyPolicy/a73fcc0290683d7b4b64c0d6b697edf9/family1/7642b9f901df40f09869064f606f303c_SeqId_50_ 2023-02-12 03:55:46,550 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39639] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/staging/jenkins__testMinorCompactionWithMonthlyPolicy__tgm4fvs7h3k8obirdivk3tkbalu01ruo43alig1tv1ev1docs6v7jbd3qvo6tndq/family1/b8f595b299fc404e8a2b567e910dd0c3 into a73fcc0290683d7b4b64c0d6b697edf9/family1 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithMonthlyPolicy/a73fcc0290683d7b4b64c0d6b697edf9/family1/7642b9f901df40f09869064f606f303c_SeqId_50_ - updating store file list. 2023-02-12 03:55:46,552 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithMonthlyPolicy/a73fcc0290683d7b4b64c0d6b697edf9/family1/9899ed51a59f45e39c3199dd124f638e, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithMonthlyPolicy/a73fcc0290683d7b4b64c0d6b697edf9/family1/3dc934a92477465196f67d427b64bbb0, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithMonthlyPolicy/a73fcc0290683d7b4b64c0d6b697edf9/family1/31a5c374a98a40129503762eba383bd5_SeqId_47_] to archive 2023-02-12 03:55:46,553 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-12 03:55:46,554 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39639] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithMonthlyPolicy/a73fcc0290683d7b4b64c0d6b697edf9/family1/7642b9f901df40f09869064f606f303c_SeqId_50_ into a73fcc0290683d7b4b64c0d6b697edf9/family1 2023-02-12 03:55:46,554 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39639] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/staging/jenkins__testMinorCompactionWithMonthlyPolicy__tgm4fvs7h3k8obirdivk3tkbalu01ruo43alig1tv1ev1docs6v7jbd3qvo6tndq/family1/b8f595b299fc404e8a2b567e910dd0c3 into a73fcc0290683d7b4b64c0d6b697edf9/family1 (new location: hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithMonthlyPolicy/a73fcc0290683d7b4b64c0d6b697edf9/family1/7642b9f901df40f09869064f606f303c_SeqId_50_) 2023-02-12 03:55:46,554 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39639] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/staging/jenkins__testMinorCompactionWithMonthlyPolicy__tgm4fvs7h3k8obirdivk3tkbalu01ruo43alig1tv1ev1docs6v7jbd3qvo6tndq/family1/b8f595b299fc404e8a2b567e910dd0c3 2023-02-12 03:55:46,554 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithMonthlyPolicy/a73fcc0290683d7b4b64c0d6b697edf9/family1/9899ed51a59f45e39c3199dd124f638e to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMinorCompactionWithMonthlyPolicy/a73fcc0290683d7b4b64c0d6b697edf9/family1/9899ed51a59f45e39c3199dd124f638e 2023-02-12 03:55:46,556 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithMonthlyPolicy/a73fcc0290683d7b4b64c0d6b697edf9/family1/3dc934a92477465196f67d427b64bbb0 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMinorCompactionWithMonthlyPolicy/a73fcc0290683d7b4b64c0d6b697edf9/family1/3dc934a92477465196f67d427b64bbb0 2023-02-12 03:55:46,556 INFO [MobCompactor-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-02-12 03:55:46,557 DEBUG [MobCompactor-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-02-12 03:55:46,557 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithMonthlyPolicy/a73fcc0290683d7b4b64c0d6b697edf9/family1/31a5c374a98a40129503762eba383bd5_SeqId_47_ to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMinorCompactionWithMonthlyPolicy/a73fcc0290683d7b4b64c0d6b697edf9/family1/31a5c374a98a40129503762eba383bd5_SeqId_47_ 2023-02-12 03:55:46,558 DEBUG [MobCompactor-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511206d4509156e16457891613552f130dca9 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511206d4509156e16457891613552f130dca9 2023-02-12 03:55:46,559 DEBUG [MobCompactor-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511280dbde4ba1f2446d890524950fc405125 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511280dbde4ba1f2446d890524950fc405125 2023-02-12 03:55:46,560 DEBUG [MobCompactor-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151130ebc27a89ec8e456f994bd22309e6e858 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151130ebc27a89ec8e456f994bd22309e6e858 2023-02-12 03:55:46,560 INFO [MobCompactor-pool-1] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 3 expired mob files are deleted 2023-02-12 03:55:46,560 DEBUG [MobCompactor-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-02-12 03:55:46,561 INFO [MobCompactor-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-02-12 03:55:46,561 INFO [MobCompactor-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-02-12 03:55:46,561 INFO [MobCompactor-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-02-12 03:55:46,561 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676173985818] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-02-12 03:55:46,561 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676173985818] mob.MobUtils(840): end MOB compaction of files for table='testMinorCompactionWithMonthlyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-12 03:55:46,563 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=115, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-02-12 03:55:46,564 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=115, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE in 2.2770 sec 2023-02-12 03:55:46,672 INFO [Listener at localhost.localdomain/41049] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompactionWithMonthlyPolicy Thread=252 (was 246) - Thread LEAK? -, OpenFileDescriptor=644 (was 617) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=87 (was 112), ProcessCount=164 (was 164), AvailableMemoryMB=3877 (was 3894) 2023-02-12 03:55:46,683 INFO [Listener at localhost.localdomain/41049] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionFromAdmin Thread=252, OpenFileDescriptor=644, MaxFileDescriptor=60000, SystemLoadAverage=87, ProcessCount=164, AvailableMemoryMB=3877 2023-02-12 03:55:46,698 DEBUG [Listener at localhost.localdomain/41049] crypto.Encryption(565): Installed org.apache.hadoop.hbase.io.crypto.KeyProviderForTesting into key provider cache 2023-02-12 03:55:46,739 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40099] master.HMaster$4(2102): Client=jenkins//148.251.75.209 create 'testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\xA8\xA6\x19l"\x88[s\xA3\xFA7\xA1YIH\xBC"\x10\x09\xC8\xD6\xABH\xDA\xA1\xA4\x1B\xF7m\x82\xB6\xF3\x87\x15*\x10z.\x03\xCA\x95\x81\x023\x13\xB5h\xDD\xD6\xFF\xB8\x9F2\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-02-12 03:55:46,740 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40099] procedure2.ProcedureExecutor(1029): Stored pid=116, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionFromAdmin 2023-02-12 03:55:46,742 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_PRE_OPERATION 2023-02-12 03:55:46,742 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40099] master.MasterRpcServices(697): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionFromAdmin" procId is: 116 2023-02-12 03:55:46,742 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-12 03:55:46,742 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40099] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-02-12 03:55:46,744 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/.tmp/data/default/testMajorCompactionFromAdmin/61a9ec6d1e76a983beaae795490c1da9 2023-02-12 03:55:46,744 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/.tmp/data/default/testMajorCompactionFromAdmin/bef88e13eab120ca8c7f6a50c6b022e5 2023-02-12 03:55:46,744 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/.tmp/data/default/testMajorCompactionFromAdmin/d65656cfa2fa6fbc9b16f832db0fdeca 2023-02-12 03:55:46,745 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/.tmp/data/default/testMajorCompactionFromAdmin/61a9ec6d1e76a983beaae795490c1da9 empty. 2023-02-12 03:55:46,745 DEBUG [HFileArchiver-21] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/.tmp/data/default/testMajorCompactionFromAdmin/bef88e13eab120ca8c7f6a50c6b022e5 empty. 2023-02-12 03:55:46,745 DEBUG [HFileArchiver-22] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/.tmp/data/default/testMajorCompactionFromAdmin/d65656cfa2fa6fbc9b16f832db0fdeca empty. 2023-02-12 03:55:46,745 DEBUG [HFileArchiver-22] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/.tmp/data/default/testMajorCompactionFromAdmin/d65656cfa2fa6fbc9b16f832db0fdeca 2023-02-12 03:55:46,745 DEBUG [HFileArchiver-21] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/.tmp/data/default/testMajorCompactionFromAdmin/bef88e13eab120ca8c7f6a50c6b022e5 2023-02-12 03:55:46,745 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/.tmp/data/default/testMajorCompactionFromAdmin/61a9ec6d1e76a983beaae795490c1da9 2023-02-12 03:55:46,745 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testMajorCompactionFromAdmin regions 2023-02-12 03:55:46,844 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40099] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-02-12 03:55:47,046 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40099] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-02-12 03:55:47,155 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/.tmp/data/default/testMajorCompactionFromAdmin/.tabledesc/.tableinfo.0000000001 2023-02-12 03:55:47,159 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(7671): creating {ENCODED => 61a9ec6d1e76a983beaae795490c1da9, NAME => 'testMajorCompactionFromAdmin,,1676174146717.61a9ec6d1e76a983beaae795490c1da9.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\xA8\xA6\x19l"\x88[s\xA3\xFA7\xA1YIH\xBC"\x10\x09\xC8\xD6\xABH\xDA\xA1\xA4\x1B\xF7m\x82\xB6\xF3\x87\x15*\x10z.\x03\xCA\x95\x81\x023\x13\xB5h\xDD\xD6\xFF\xB8\x9F2\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/.tmp 2023-02-12 03:55:47,159 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(7671): creating {ENCODED => d65656cfa2fa6fbc9b16f832db0fdeca, NAME => 'testMajorCompactionFromAdmin,2,1676174146717.d65656cfa2fa6fbc9b16f832db0fdeca.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\xA8\xA6\x19l"\x88[s\xA3\xFA7\xA1YIH\xBC"\x10\x09\xC8\xD6\xABH\xDA\xA1\xA4\x1B\xF7m\x82\xB6\xF3\x87\x15*\x10z.\x03\xCA\x95\x81\x023\x13\xB5h\xDD\xD6\xFF\xB8\x9F2\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/.tmp 2023-02-12 03:55:47,161 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(7671): creating {ENCODED => bef88e13eab120ca8c7f6a50c6b022e5, NAME => 'testMajorCompactionFromAdmin,1,1676174146717.bef88e13eab120ca8c7f6a50c6b022e5.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\xA8\xA6\x19l"\x88[s\xA3\xFA7\xA1YIH\xBC"\x10\x09\xC8\xD6\xABH\xDA\xA1\xA4\x1B\xF7m\x82\xB6\xF3\x87\x15*\x10z.\x03\xCA\x95\x81\x023\x13\xB5h\xDD\xD6\xFF\xB8\x9F2\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/.tmp 2023-02-12 03:55:47,347 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40099] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-02-12 03:55:47,572 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(865): Instantiated testMajorCompactionFromAdmin,,1676174146717.61a9ec6d1e76a983beaae795490c1da9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:55:47,572 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1603): Closing 61a9ec6d1e76a983beaae795490c1da9, disabling compactions & flushes 2023-02-12 03:55:47,572 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1625): Closing region testMajorCompactionFromAdmin,,1676174146717.61a9ec6d1e76a983beaae795490c1da9. 2023-02-12 03:55:47,572 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionFromAdmin,,1676174146717.61a9ec6d1e76a983beaae795490c1da9. 2023-02-12 03:55:47,572 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionFromAdmin,,1676174146717.61a9ec6d1e76a983beaae795490c1da9. after waiting 0 ms 2023-02-12 03:55:47,572 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionFromAdmin,,1676174146717.61a9ec6d1e76a983beaae795490c1da9. 2023-02-12 03:55:47,572 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1837): Closed testMajorCompactionFromAdmin,,1676174146717.61a9ec6d1e76a983beaae795490c1da9. 2023-02-12 03:55:47,573 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1557): Region close journal for 61a9ec6d1e76a983beaae795490c1da9: Waiting for close lock at 1676174147572Disabling compacts and flushes for region at 1676174147572Disabling writes for close at 1676174147572Writing region close event to WAL at 1676174147572Closed at 1676174147572 2023-02-12 03:55:47,576 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(865): Instantiated testMajorCompactionFromAdmin,2,1676174146717.d65656cfa2fa6fbc9b16f832db0fdeca.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:55:47,576 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1603): Closing d65656cfa2fa6fbc9b16f832db0fdeca, disabling compactions & flushes 2023-02-12 03:55:47,576 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1625): Closing region testMajorCompactionFromAdmin,2,1676174146717.d65656cfa2fa6fbc9b16f832db0fdeca. 2023-02-12 03:55:47,576 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(865): Instantiated testMajorCompactionFromAdmin,1,1676174146717.bef88e13eab120ca8c7f6a50c6b022e5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:55:47,576 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionFromAdmin,2,1676174146717.d65656cfa2fa6fbc9b16f832db0fdeca. 2023-02-12 03:55:47,577 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionFromAdmin,2,1676174146717.d65656cfa2fa6fbc9b16f832db0fdeca. after waiting 0 ms 2023-02-12 03:55:47,577 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionFromAdmin,2,1676174146717.d65656cfa2fa6fbc9b16f832db0fdeca. 2023-02-12 03:55:47,577 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1837): Closed testMajorCompactionFromAdmin,2,1676174146717.d65656cfa2fa6fbc9b16f832db0fdeca. 2023-02-12 03:55:47,577 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1603): Closing bef88e13eab120ca8c7f6a50c6b022e5, disabling compactions & flushes 2023-02-12 03:55:47,577 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1625): Closing region testMajorCompactionFromAdmin,1,1676174146717.bef88e13eab120ca8c7f6a50c6b022e5. 2023-02-12 03:55:47,577 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionFromAdmin,1,1676174146717.bef88e13eab120ca8c7f6a50c6b022e5. 2023-02-12 03:55:47,577 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1557): Region close journal for d65656cfa2fa6fbc9b16f832db0fdeca: Waiting for close lock at 1676174147576Disabling compacts and flushes for region at 1676174147576Disabling writes for close at 1676174147577 (+1 ms)Writing region close event to WAL at 1676174147577Closed at 1676174147577 2023-02-12 03:55:47,577 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionFromAdmin,1,1676174146717.bef88e13eab120ca8c7f6a50c6b022e5. after waiting 0 ms 2023-02-12 03:55:47,577 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionFromAdmin,1,1676174146717.bef88e13eab120ca8c7f6a50c6b022e5. 2023-02-12 03:55:47,577 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1837): Closed testMajorCompactionFromAdmin,1,1676174146717.bef88e13eab120ca8c7f6a50c6b022e5. 2023-02-12 03:55:47,577 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1557): Region close journal for bef88e13eab120ca8c7f6a50c6b022e5: Waiting for close lock at 1676174147577Disabling compacts and flushes for region at 1676174147577Disabling writes for close at 1676174147577Writing region close event to WAL at 1676174147577Closed at 1676174147577 2023-02-12 03:55:47,581 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_ADD_TO_META 2023-02-12 03:55:47,582 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,,1676174146717.61a9ec6d1e76a983beaae795490c1da9.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1676174147582"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676174147582"}]},"ts":"1676174147582"} 2023-02-12 03:55:47,583 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,2,1676174146717.d65656cfa2fa6fbc9b16f832db0fdeca.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1676174147582"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676174147582"}]},"ts":"1676174147582"} 2023-02-12 03:55:47,583 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,1,1676174146717.bef88e13eab120ca8c7f6a50c6b022e5.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1676174147582"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1676174147582"}]},"ts":"1676174147582"} 2023-02-12 03:55:47,586 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-02-12 03:55:47,587 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-12 03:55:47,587 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionFromAdmin","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676174147587"}]},"ts":"1676174147587"} 2023-02-12 03:55:47,589 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionFromAdmin, state=ENABLING in hbase:meta 2023-02-12 03:55:47,593 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=61a9ec6d1e76a983beaae795490c1da9, ASSIGN}, {pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=bef88e13eab120ca8c7f6a50c6b022e5, ASSIGN}, {pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=d65656cfa2fa6fbc9b16f832db0fdeca, ASSIGN}] 2023-02-12 03:55:47,595 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=61a9ec6d1e76a983beaae795490c1da9, ASSIGN 2023-02-12 03:55:47,595 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=d65656cfa2fa6fbc9b16f832db0fdeca, ASSIGN 2023-02-12 03:55:47,596 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=bef88e13eab120ca8c7f6a50c6b022e5, ASSIGN 2023-02-12 03:55:47,596 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=61a9ec6d1e76a983beaae795490c1da9, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,39639,1676173982450; forceNewPlan=false, retain=false 2023-02-12 03:55:47,596 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=d65656cfa2fa6fbc9b16f832db0fdeca, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,39639,1676173982450; forceNewPlan=false, retain=false 2023-02-12 03:55:47,597 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=bef88e13eab120ca8c7f6a50c6b022e5, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,39639,1676173982450; forceNewPlan=false, retain=false 2023-02-12 03:55:47,749 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=117 updating hbase:meta row=61a9ec6d1e76a983beaae795490c1da9, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:47,749 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=118 updating hbase:meta row=bef88e13eab120ca8c7f6a50c6b022e5, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:47,749 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=119 updating hbase:meta row=d65656cfa2fa6fbc9b16f832db0fdeca, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:47,749 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,,1676174146717.61a9ec6d1e76a983beaae795490c1da9.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1676174147749"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676174147749"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676174147749"}]},"ts":"1676174147749"} 2023-02-12 03:55:47,750 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,2,1676174146717.d65656cfa2fa6fbc9b16f832db0fdeca.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1676174147749"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676174147749"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676174147749"}]},"ts":"1676174147749"} 2023-02-12 03:55:47,750 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,1,1676174146717.bef88e13eab120ca8c7f6a50c6b022e5.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1676174147749"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1676174147749"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1676174147749"}]},"ts":"1676174147749"} 2023-02-12 03:55:47,752 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=120, ppid=117, state=RUNNABLE; OpenRegionProcedure 61a9ec6d1e76a983beaae795490c1da9, server=jenkins-hbase20.apache.org,39639,1676173982450}] 2023-02-12 03:55:47,753 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=121, ppid=119, state=RUNNABLE; OpenRegionProcedure d65656cfa2fa6fbc9b16f832db0fdeca, server=jenkins-hbase20.apache.org,39639,1676173982450}] 2023-02-12 03:55:47,755 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=122, ppid=118, state=RUNNABLE; OpenRegionProcedure bef88e13eab120ca8c7f6a50c6b022e5, server=jenkins-hbase20.apache.org,39639,1676173982450}] 2023-02-12 03:55:47,849 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40099] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-02-12 03:55:47,912 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionFromAdmin,1,1676174146717.bef88e13eab120ca8c7f6a50c6b022e5. 2023-02-12 03:55:47,912 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => bef88e13eab120ca8c7f6a50c6b022e5, NAME => 'testMajorCompactionFromAdmin,1,1676174146717.bef88e13eab120ca8c7f6a50c6b022e5.', STARTKEY => '1', ENDKEY => '2'} 2023-02-12 03:55:47,913 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin bef88e13eab120ca8c7f6a50c6b022e5 2023-02-12 03:55:47,913 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionFromAdmin,1,1676174146717.bef88e13eab120ca8c7f6a50c6b022e5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:55:47,913 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for bef88e13eab120ca8c7f6a50c6b022e5 2023-02-12 03:55:47,913 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for bef88e13eab120ca8c7f6a50c6b022e5 2023-02-12 03:55:47,939 INFO [StoreOpener-bef88e13eab120ca8c7f6a50c6b022e5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region bef88e13eab120ca8c7f6a50c6b022e5 2023-02-12 03:55:47,941 DEBUG [StoreOpener-bef88e13eab120ca8c7f6a50c6b022e5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/bef88e13eab120ca8c7f6a50c6b022e5/family1 2023-02-12 03:55:47,941 DEBUG [StoreOpener-bef88e13eab120ca8c7f6a50c6b022e5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/bef88e13eab120ca8c7f6a50c6b022e5/family1 2023-02-12 03:55:47,941 INFO [StoreOpener-bef88e13eab120ca8c7f6a50c6b022e5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bef88e13eab120ca8c7f6a50c6b022e5 columnFamilyName family1 2023-02-12 03:55:47,942 INFO [StoreOpener-bef88e13eab120ca8c7f6a50c6b022e5-1] regionserver.HStore(310): Store=bef88e13eab120ca8c7f6a50c6b022e5/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:55:47,942 INFO [StoreOpener-bef88e13eab120ca8c7f6a50c6b022e5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region bef88e13eab120ca8c7f6a50c6b022e5 2023-02-12 03:55:47,944 DEBUG [StoreOpener-bef88e13eab120ca8c7f6a50c6b022e5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/bef88e13eab120ca8c7f6a50c6b022e5/family2 2023-02-12 03:55:47,944 DEBUG [StoreOpener-bef88e13eab120ca8c7f6a50c6b022e5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/bef88e13eab120ca8c7f6a50c6b022e5/family2 2023-02-12 03:55:47,944 INFO [StoreOpener-bef88e13eab120ca8c7f6a50c6b022e5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bef88e13eab120ca8c7f6a50c6b022e5 columnFamilyName family2 2023-02-12 03:55:47,945 INFO [StoreOpener-bef88e13eab120ca8c7f6a50c6b022e5-1] regionserver.HStore(310): Store=bef88e13eab120ca8c7f6a50c6b022e5/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:55:47,945 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/bef88e13eab120ca8c7f6a50c6b022e5 2023-02-12 03:55:47,945 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/bef88e13eab120ca8c7f6a50c6b022e5 2023-02-12 03:55:47,947 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 03:55:47,947 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for bef88e13eab120ca8c7f6a50c6b022e5 2023-02-12 03:55:47,949 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/bef88e13eab120ca8c7f6a50c6b022e5/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 03:55:47,949 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened bef88e13eab120ca8c7f6a50c6b022e5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74463094, jitterRate=0.10958656668663025}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 03:55:47,949 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for bef88e13eab120ca8c7f6a50c6b022e5: Running coprocessor pre-open hook at 1676174147914Writing region info on filesystem at 1676174147914Initializing all the Stores at 1676174147915 (+1 ms)Instantiating store for column family {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\xA8\xA6\x19l"\x88[s\xA3\xFA7\xA1YIH\xBC"\x10\x09\xC8\xD6\xABH\xDA\xA1\xA4\x1B\xF7m\x82\xB6\xF3\x87\x15*\x10z.\x03\xCA\x95\x81\x023\x13\xB5h\xDD\xD6\xFF\xB8\x9F2\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676174147916 (+1 ms)Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676174147916Cleaning up temporary data from old regions at 1676174147946 (+30 ms)Cleaning up detritus from prior splits at 1676174147946Running coprocessor post-open hooks at 1676174147949 (+3 ms)Region opened successfully at 1676174147949 2023-02-12 03:55:47,950 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionFromAdmin,1,1676174146717.bef88e13eab120ca8c7f6a50c6b022e5., pid=122, masterSystemTime=1676174147906 2023-02-12 03:55:47,951 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionFromAdmin,1,1676174146717.bef88e13eab120ca8c7f6a50c6b022e5. 2023-02-12 03:55:47,951 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionFromAdmin,1,1676174146717.bef88e13eab120ca8c7f6a50c6b022e5. 2023-02-12 03:55:47,951 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionFromAdmin,,1676174146717.61a9ec6d1e76a983beaae795490c1da9. 2023-02-12 03:55:47,951 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 61a9ec6d1e76a983beaae795490c1da9, NAME => 'testMajorCompactionFromAdmin,,1676174146717.61a9ec6d1e76a983beaae795490c1da9.', STARTKEY => '', ENDKEY => '1'} 2023-02-12 03:55:47,951 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=118 updating hbase:meta row=bef88e13eab120ca8c7f6a50c6b022e5, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:47,951 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin 61a9ec6d1e76a983beaae795490c1da9 2023-02-12 03:55:47,951 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,1,1676174146717.bef88e13eab120ca8c7f6a50c6b022e5.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1676174147951"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676174147951"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676174147951"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676174147951"}]},"ts":"1676174147951"} 2023-02-12 03:55:47,951 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionFromAdmin,,1676174146717.61a9ec6d1e76a983beaae795490c1da9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:55:47,951 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for 61a9ec6d1e76a983beaae795490c1da9 2023-02-12 03:55:47,951 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for 61a9ec6d1e76a983beaae795490c1da9 2023-02-12 03:55:47,954 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=122, resume processing ppid=118 2023-02-12 03:55:47,954 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=122, ppid=118, state=SUCCESS; OpenRegionProcedure bef88e13eab120ca8c7f6a50c6b022e5, server=jenkins-hbase20.apache.org,39639,1676173982450 in 198 msec 2023-02-12 03:55:47,955 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=118, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=bef88e13eab120ca8c7f6a50c6b022e5, ASSIGN in 361 msec 2023-02-12 03:55:47,973 INFO [StoreOpener-61a9ec6d1e76a983beaae795490c1da9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 61a9ec6d1e76a983beaae795490c1da9 2023-02-12 03:55:47,974 DEBUG [StoreOpener-61a9ec6d1e76a983beaae795490c1da9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/61a9ec6d1e76a983beaae795490c1da9/family1 2023-02-12 03:55:47,974 DEBUG [StoreOpener-61a9ec6d1e76a983beaae795490c1da9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/61a9ec6d1e76a983beaae795490c1da9/family1 2023-02-12 03:55:47,975 INFO [StoreOpener-61a9ec6d1e76a983beaae795490c1da9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 61a9ec6d1e76a983beaae795490c1da9 columnFamilyName family1 2023-02-12 03:55:47,976 INFO [StoreOpener-61a9ec6d1e76a983beaae795490c1da9-1] regionserver.HStore(310): Store=61a9ec6d1e76a983beaae795490c1da9/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:55:47,976 INFO [StoreOpener-61a9ec6d1e76a983beaae795490c1da9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 61a9ec6d1e76a983beaae795490c1da9 2023-02-12 03:55:47,977 DEBUG [StoreOpener-61a9ec6d1e76a983beaae795490c1da9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/61a9ec6d1e76a983beaae795490c1da9/family2 2023-02-12 03:55:47,977 DEBUG [StoreOpener-61a9ec6d1e76a983beaae795490c1da9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/61a9ec6d1e76a983beaae795490c1da9/family2 2023-02-12 03:55:47,977 INFO [StoreOpener-61a9ec6d1e76a983beaae795490c1da9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 61a9ec6d1e76a983beaae795490c1da9 columnFamilyName family2 2023-02-12 03:55:47,978 INFO [StoreOpener-61a9ec6d1e76a983beaae795490c1da9-1] regionserver.HStore(310): Store=61a9ec6d1e76a983beaae795490c1da9/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:55:47,978 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/61a9ec6d1e76a983beaae795490c1da9 2023-02-12 03:55:47,979 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/61a9ec6d1e76a983beaae795490c1da9 2023-02-12 03:55:47,980 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 03:55:47,980 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for 61a9ec6d1e76a983beaae795490c1da9 2023-02-12 03:55:47,981 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/61a9ec6d1e76a983beaae795490c1da9/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 03:55:47,982 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened 61a9ec6d1e76a983beaae795490c1da9; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67846033, jitterRate=0.010984674096107483}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 03:55:47,982 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for 61a9ec6d1e76a983beaae795490c1da9: Running coprocessor pre-open hook at 1676174147952Writing region info on filesystem at 1676174147952Initializing all the Stores at 1676174147952Instantiating store for column family {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\xA8\xA6\x19l"\x88[s\xA3\xFA7\xA1YIH\xBC"\x10\x09\xC8\xD6\xABH\xDA\xA1\xA4\x1B\xF7m\x82\xB6\xF3\x87\x15*\x10z.\x03\xCA\x95\x81\x023\x13\xB5h\xDD\xD6\xFF\xB8\x9F2\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676174147952Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676174147953 (+1 ms)Cleaning up temporary data from old regions at 1676174147979 (+26 ms)Cleaning up detritus from prior splits at 1676174147979Running coprocessor post-open hooks at 1676174147982 (+3 ms)Region opened successfully at 1676174147982 2023-02-12 03:55:47,982 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionFromAdmin,,1676174146717.61a9ec6d1e76a983beaae795490c1da9., pid=120, masterSystemTime=1676174147906 2023-02-12 03:55:47,983 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionFromAdmin,,1676174146717.61a9ec6d1e76a983beaae795490c1da9. 2023-02-12 03:55:47,983 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionFromAdmin,,1676174146717.61a9ec6d1e76a983beaae795490c1da9. 2023-02-12 03:55:47,983 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionFromAdmin,2,1676174146717.d65656cfa2fa6fbc9b16f832db0fdeca. 2023-02-12 03:55:47,983 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => d65656cfa2fa6fbc9b16f832db0fdeca, NAME => 'testMajorCompactionFromAdmin,2,1676174146717.d65656cfa2fa6fbc9b16f832db0fdeca.', STARTKEY => '2', ENDKEY => ''} 2023-02-12 03:55:47,983 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=117 updating hbase:meta row=61a9ec6d1e76a983beaae795490c1da9, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:47,984 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin d65656cfa2fa6fbc9b16f832db0fdeca 2023-02-12 03:55:47,984 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,,1676174146717.61a9ec6d1e76a983beaae795490c1da9.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1676174147983"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676174147983"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676174147983"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676174147983"}]},"ts":"1676174147983"} 2023-02-12 03:55:47,984 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionFromAdmin,2,1676174146717.d65656cfa2fa6fbc9b16f832db0fdeca.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-12 03:55:47,984 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7890): checking encryption for d65656cfa2fa6fbc9b16f832db0fdeca 2023-02-12 03:55:47,984 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7893): checking classloading for d65656cfa2fa6fbc9b16f832db0fdeca 2023-02-12 03:55:47,986 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=120, resume processing ppid=117 2023-02-12 03:55:47,986 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=120, ppid=117, state=SUCCESS; OpenRegionProcedure 61a9ec6d1e76a983beaae795490c1da9, server=jenkins-hbase20.apache.org,39639,1676173982450 in 233 msec 2023-02-12 03:55:47,987 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=117, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=61a9ec6d1e76a983beaae795490c1da9, ASSIGN in 393 msec 2023-02-12 03:55:48,002 INFO [StoreOpener-d65656cfa2fa6fbc9b16f832db0fdeca-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region d65656cfa2fa6fbc9b16f832db0fdeca 2023-02-12 03:55:48,003 DEBUG [StoreOpener-d65656cfa2fa6fbc9b16f832db0fdeca-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/d65656cfa2fa6fbc9b16f832db0fdeca/family1 2023-02-12 03:55:48,003 DEBUG [StoreOpener-d65656cfa2fa6fbc9b16f832db0fdeca-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/d65656cfa2fa6fbc9b16f832db0fdeca/family1 2023-02-12 03:55:48,003 INFO [StoreOpener-d65656cfa2fa6fbc9b16f832db0fdeca-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d65656cfa2fa6fbc9b16f832db0fdeca columnFamilyName family1 2023-02-12 03:55:48,004 INFO [StoreOpener-d65656cfa2fa6fbc9b16f832db0fdeca-1] regionserver.HStore(310): Store=d65656cfa2fa6fbc9b16f832db0fdeca/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:55:48,004 INFO [StoreOpener-d65656cfa2fa6fbc9b16f832db0fdeca-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region d65656cfa2fa6fbc9b16f832db0fdeca 2023-02-12 03:55:48,005 DEBUG [StoreOpener-d65656cfa2fa6fbc9b16f832db0fdeca-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/d65656cfa2fa6fbc9b16f832db0fdeca/family2 2023-02-12 03:55:48,005 DEBUG [StoreOpener-d65656cfa2fa6fbc9b16f832db0fdeca-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/d65656cfa2fa6fbc9b16f832db0fdeca/family2 2023-02-12 03:55:48,005 INFO [StoreOpener-d65656cfa2fa6fbc9b16f832db0fdeca-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d65656cfa2fa6fbc9b16f832db0fdeca columnFamilyName family2 2023-02-12 03:55:48,005 INFO [StoreOpener-d65656cfa2fa6fbc9b16f832db0fdeca-1] regionserver.HStore(310): Store=d65656cfa2fa6fbc9b16f832db0fdeca/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-12 03:55:48,006 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/d65656cfa2fa6fbc9b16f832db0fdeca 2023-02-12 03:55:48,006 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/d65656cfa2fa6fbc9b16f832db0fdeca 2023-02-12 03:55:48,007 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-12 03:55:48,016 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-12 03:55:48,016 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x46429197 to 127.0.0.1:59556 2023-02-12 03:55:48,016 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 03:55:48,017 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-12 03:55:48,017 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1054): writing seq id for d65656cfa2fa6fbc9b16f832db0fdeca 2023-02-12 03:55:48,017 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x34dba85f to 127.0.0.1:59556 2023-02-12 03:55:48,017 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 03:55:48,019 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/d65656cfa2fa6fbc9b16f832db0fdeca/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-12 03:55:48,019 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1071): Opened d65656cfa2fa6fbc9b16f832db0fdeca; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61388480, jitterRate=-0.08524036407470703}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-12 03:55:48,019 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(964): Region open journal for d65656cfa2fa6fbc9b16f832db0fdeca: Running coprocessor pre-open hook at 1676174147984Writing region info on filesystem at 1676174147984Initializing all the Stores at 1676174147984Instantiating store for column family {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\xA8\xA6\x19l"\x88[s\xA3\xFA7\xA1YIH\xBC"\x10\x09\xC8\xD6\xABH\xDA\xA1\xA4\x1B\xF7m\x82\xB6\xF3\x87\x15*\x10z.\x03\xCA\x95\x81\x023\x13\xB5h\xDD\xD6\xFF\xB8\x9F2\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676174147984Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1676174147985 (+1 ms)Cleaning up temporary data from old regions at 1676174148007 (+22 ms)Cleaning up detritus from prior splits at 1676174148007Running coprocessor post-open hooks at 1676174148019 (+12 ms)Region opened successfully at 1676174148019 2023-02-12 03:55:48,019 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionFromAdmin,2,1676174146717.d65656cfa2fa6fbc9b16f832db0fdeca., pid=121, masterSystemTime=1676174147906 2023-02-12 03:55:48,020 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionFromAdmin,2,1676174146717.d65656cfa2fa6fbc9b16f832db0fdeca. 2023-02-12 03:55:48,021 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionFromAdmin,2,1676174146717.d65656cfa2fa6fbc9b16f832db0fdeca. 2023-02-12 03:55:48,021 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=119 updating hbase:meta row=d65656cfa2fa6fbc9b16f832db0fdeca, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:48,021 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,2,1676174146717.d65656cfa2fa6fbc9b16f832db0fdeca.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1676174148021"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1676174148021"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1676174148021"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1676174148021"}]},"ts":"1676174148021"} 2023-02-12 03:55:48,023 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=121, resume processing ppid=119 2023-02-12 03:55:48,023 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=121, ppid=119, state=SUCCESS; OpenRegionProcedure d65656cfa2fa6fbc9b16f832db0fdeca, server=jenkins-hbase20.apache.org,39639,1676173982450 in 269 msec 2023-02-12 03:55:48,024 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=119, resume processing ppid=116 2023-02-12 03:55:48,024 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=119, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=d65656cfa2fa6fbc9b16f832db0fdeca, ASSIGN in 430 msec 2023-02-12 03:55:48,024 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-12 03:55:48,024 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionFromAdmin","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1676174148024"}]},"ts":"1676174148024"} 2023-02-12 03:55:48,025 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionFromAdmin, state=ENABLED in hbase:meta 2023-02-12 03:55:48,122 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_POST_OPERATION 2023-02-12 03:55:48,126 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=116, state=SUCCESS; CreateTableProcedure table=testMajorCompactionFromAdmin in 1.3830 sec 2023-02-12 03:55:48,850 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40099] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-02-12 03:55:48,851 INFO [Listener at localhost.localdomain/41049] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionFromAdmin, procId: 116 completed 2023-02-12 03:55:48,861 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39639] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,,1676174146717.61a9ec6d1e76a983beaae795490c1da9. with WAL disabled. Data may be lost in the event of a crash. 2023-02-12 03:55:48,862 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39639] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,1,1676174146717.bef88e13eab120ca8c7f6a50c6b022e5. with WAL disabled. Data may be lost in the event of a crash. 2023-02-12 03:55:48,862 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39639] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,2,1676174146717.d65656cfa2fa6fbc9b16f832db0fdeca. with WAL disabled. Data may be lost in the event of a crash. 2023-02-12 03:55:48,866 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40099] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-12 03:55:48,867 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40099] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-02-12 03:55:48,867 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-02-12 03:55:48,867 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:55:48,867 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-02-12 03:55:48,867 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-02-12 03:55:48,868 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-12 03:55:48,868 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-12 03:55:48,869 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:55:48,869 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:48,869 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:55:48,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:55:48,869 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:48,869 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-12 03:55:48,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-12 03:55:48,869 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-12 03:55:48,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-12 03:55:48,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-12 03:55:48,870 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-02-12 03:55:48,870 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-02-12 03:55:48,870 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-02-12 03:55:48,870 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:55:48,870 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-02-12 03:55:48,870 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1676174146717.bef88e13eab120ca8c7f6a50c6b022e5. 2023-02-12 03:55:48,870 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-12 03:55:48,870 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1676174146717.bef88e13eab120ca8c7f6a50c6b022e5. started... 2023-02-12 03:55:48,870 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1676174146717.61a9ec6d1e76a983beaae795490c1da9. 2023-02-12 03:55:48,870 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-12 03:55:48,870 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1676174146717.d65656cfa2fa6fbc9b16f832db0fdeca. 2023-02-12 03:55:48,870 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1676174146717.61a9ec6d1e76a983beaae795490c1da9. started... 2023-02-12 03:55:48,871 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1676174146717.d65656cfa2fa6fbc9b16f832db0fdeca. started... 2023-02-12 03:55:48,871 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing bef88e13eab120ca8c7f6a50c6b022e5 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-02-12 03:55:48,871 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing d65656cfa2fa6fbc9b16f832db0fdeca 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-02-12 03:55:48,871 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 61a9ec6d1e76a983beaae795490c1da9 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-02-12 03:55:48,907 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230212adabd7e55af24cfebfe53263ef99ad26 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230212adabd7e55af24cfebfe53263ef99ad26 2023-02-12 03:55:49,315 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230212032d407dd1a14b1fa069ab00ba221c70 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230212032d407dd1a14b1fa069ab00ba221c70 2023-02-12 03:55:49,315 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202302124250f7f3bd274ab89e552cfd281438cf to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202302124250f7f3bd274ab89e552cfd281438cf 2023-02-12 03:55:49,320 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/61a9ec6d1e76a983beaae795490c1da9/.tmp/family1/930f7462638846e0b75da8f3019960ae 2023-02-12 03:55:49,328 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/bef88e13eab120ca8c7f6a50c6b022e5/.tmp/family1/031cece029cc471a80aba5a6e2303dcf 2023-02-12 03:55:49,728 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/d65656cfa2fa6fbc9b16f832db0fdeca/.tmp/family1/c3ecb33ecded4aa69214d8f3c9aeddd2 2023-02-12 03:55:49,748 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230212f0ff28f731ef4c32ac0521b73d9103c6 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e20230212f0ff28f731ef4c32ac0521b73d9103c6 2023-02-12 03:55:49,755 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023021259994c0c31b64d38898d67fed5ec378b to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b2023021259994c0c31b64d38898d67fed5ec378b 2023-02-12 03:55:49,759 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/bef88e13eab120ca8c7f6a50c6b022e5/.tmp/family2/836cb18c68a3448091dd1fc263234b8c 2023-02-12 03:55:49,763 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/bef88e13eab120ca8c7f6a50c6b022e5/.tmp/family1/031cece029cc471a80aba5a6e2303dcf as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/bef88e13eab120ca8c7f6a50c6b022e5/family1/031cece029cc471a80aba5a6e2303dcf 2023-02-12 03:55:49,784 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/bef88e13eab120ca8c7f6a50c6b022e5/family1/031cece029cc471a80aba5a6e2303dcf, entries=4, sequenceid=5, filesize=5.5 K 2023-02-12 03:55:49,785 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/bef88e13eab120ca8c7f6a50c6b022e5/.tmp/family2/836cb18c68a3448091dd1fc263234b8c as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/bef88e13eab120ca8c7f6a50c6b022e5/family2/836cb18c68a3448091dd1fc263234b8c 2023-02-12 03:55:49,788 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/bef88e13eab120ca8c7f6a50c6b022e5/family2/836cb18c68a3448091dd1fc263234b8c, entries=2, sequenceid=5, filesize=5.1 K 2023-02-12 03:55:49,788 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for bef88e13eab120ca8c7f6a50c6b022e5 in 917ms, sequenceid=5, compaction requested=false 2023-02-12 03:55:49,788 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionFromAdmin' 2023-02-12 03:55:49,789 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for bef88e13eab120ca8c7f6a50c6b022e5: 2023-02-12 03:55:49,789 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1676174146717.bef88e13eab120ca8c7f6a50c6b022e5. 2023-02-12 03:55:49,789 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-12 03:55:50,153 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/61a9ec6d1e76a983beaae795490c1da9/.tmp/family2/3f6593b95047473ea37b988ad52a24d1 2023-02-12 03:55:50,163 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/61a9ec6d1e76a983beaae795490c1da9/.tmp/family1/930f7462638846e0b75da8f3019960ae as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/61a9ec6d1e76a983beaae795490c1da9/family1/930f7462638846e0b75da8f3019960ae 2023-02-12 03:55:50,170 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230212cfec443b036e49619945aa53b5e8792c to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c20230212cfec443b036e49619945aa53b5e8792c 2023-02-12 03:55:50,190 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/61a9ec6d1e76a983beaae795490c1da9/family1/930f7462638846e0b75da8f3019960ae, entries=4, sequenceid=5, filesize=5.5 K 2023-02-12 03:55:50,190 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/61a9ec6d1e76a983beaae795490c1da9/.tmp/family2/3f6593b95047473ea37b988ad52a24d1 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/61a9ec6d1e76a983beaae795490c1da9/family2/3f6593b95047473ea37b988ad52a24d1 2023-02-12 03:55:50,193 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/61a9ec6d1e76a983beaae795490c1da9/family2/3f6593b95047473ea37b988ad52a24d1, entries=2, sequenceid=5, filesize=5.1 K 2023-02-12 03:55:50,194 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 61a9ec6d1e76a983beaae795490c1da9 in 1323ms, sequenceid=5, compaction requested=false 2023-02-12 03:55:50,195 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 61a9ec6d1e76a983beaae795490c1da9: 2023-02-12 03:55:50,195 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1676174146717.61a9ec6d1e76a983beaae795490c1da9. 2023-02-12 03:55:50,195 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-12 03:55:50,577 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/d65656cfa2fa6fbc9b16f832db0fdeca/.tmp/family2/e3cb7a4a1ee042a9884e46df113504a8 2023-02-12 03:55:50,587 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/d65656cfa2fa6fbc9b16f832db0fdeca/.tmp/family1/c3ecb33ecded4aa69214d8f3c9aeddd2 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/d65656cfa2fa6fbc9b16f832db0fdeca/family1/c3ecb33ecded4aa69214d8f3c9aeddd2 2023-02-12 03:55:50,612 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/d65656cfa2fa6fbc9b16f832db0fdeca/family1/c3ecb33ecded4aa69214d8f3c9aeddd2, entries=4, sequenceid=5, filesize=5.5 K 2023-02-12 03:55:50,613 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/d65656cfa2fa6fbc9b16f832db0fdeca/.tmp/family2/e3cb7a4a1ee042a9884e46df113504a8 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/d65656cfa2fa6fbc9b16f832db0fdeca/family2/e3cb7a4a1ee042a9884e46df113504a8 2023-02-12 03:55:50,616 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/d65656cfa2fa6fbc9b16f832db0fdeca/family2/e3cb7a4a1ee042a9884e46df113504a8, entries=2, sequenceid=5, filesize=5.1 K 2023-02-12 03:55:50,616 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for d65656cfa2fa6fbc9b16f832db0fdeca in 1745ms, sequenceid=5, compaction requested=false 2023-02-12 03:55:50,616 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for d65656cfa2fa6fbc9b16f832db0fdeca: 2023-02-12 03:55:50,616 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1676174146717.d65656cfa2fa6fbc9b16f832db0fdeca. 2023-02-12 03:55:50,616 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-12 03:55:50,617 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-12 03:55:50,617 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:50,617 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-02-12 03:55:50,617 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-02-12 03:55:50,618 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:50,618 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-12 03:55:50,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:50,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:55:50,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:55:50,618 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-12 03:55:50,618 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 03:55:50,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:55:50,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:55:50,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-12 03:55:50,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:50,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:55:50,619 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-02-12 03:55:50,619 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@64a669e7[Count = 0] remaining members to acquire global barrier 2023-02-12 03:55:50,619 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-02-12 03:55:50,619 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-12 03:55:50,620 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-12 03:55:50,620 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-12 03:55:50,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-12 03:55:50,620 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-02-12 03:55:50,620 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:50,620 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-12 03:55:50,620 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-02-12 03:55:50,620 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase20.apache.org,39639,1676173982450' in zk 2023-02-12 03:55:50,621 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-02-12 03:55:50,621 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:55:50,621 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:50,621 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-02-12 03:55:50,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:50,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:55:50,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:55:50,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:55:50,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:55:50,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-12 03:55:50,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:50,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:55:50,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-12 03:55:50,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:50,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase20.apache.org,39639,1676173982450': 2023-02-12 03:55:50,623 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-02-12 03:55:50,623 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-02-12 03:55:50,623 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-12 03:55:50,623 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-12 03:55:50,623 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-02-12 03:55:50,623 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-12 03:55:50,624 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-12 03:55:50,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-12 03:55:50,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:55:50,624 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-12 03:55:50,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:55:50,624 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:55:50,624 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-12 03:55:50,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-12 03:55:50,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:55:50,625 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:55:50,625 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:50,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:55:50,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-12 03:55:50,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-12 03:55:50,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:55:50,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-12 03:55:50,626 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:50,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:50,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:55:50,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-12 03:55:50,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:50,627 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:50,627 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:55:50,627 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-12 03:55:50,627 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:55:50,627 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:55:50,627 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:55:50,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:55:50,627 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-02-12 03:55:50,627 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-12 03:55:50,627 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40099] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-02-12 03:55:50,627 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40099] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-12 03:55:50,627 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:50,628 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:55:50,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:55:50,628 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-12 03:55:50,628 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-12 03:55:50,628 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-12 03:55:50,628 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-02-12 03:55:50,628 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-12 03:55:50,728 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-12 03:55:50,730 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40099] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-12 03:55:50,732 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39639] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,,1676174146717.61a9ec6d1e76a983beaae795490c1da9. with WAL disabled. Data may be lost in the event of a crash. 2023-02-12 03:55:50,733 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39639] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,1,1676174146717.bef88e13eab120ca8c7f6a50c6b022e5. with WAL disabled. Data may be lost in the event of a crash. 2023-02-12 03:55:50,733 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39639] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,2,1676174146717.d65656cfa2fa6fbc9b16f832db0fdeca. with WAL disabled. Data may be lost in the event of a crash. 2023-02-12 03:55:50,739 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40099] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-12 03:55:50,741 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40099] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-02-12 03:55:50,741 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40099] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-02-12 03:55:50,741 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-02-12 03:55:50,741 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:55:50,742 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-02-12 03:55:50,742 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-02-12 03:55:50,742 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-12 03:55:50,742 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-12 03:55:50,743 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:50,743 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:55:50,743 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:55:50,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:55:50,743 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:50,743 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-12 03:55:50,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-12 03:55:50,744 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-12 03:55:50,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-12 03:55:50,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-12 03:55:50,745 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-02-12 03:55:50,745 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-02-12 03:55:50,745 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-02-12 03:55:50,745 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-02-12 03:55:50,745 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:55:50,745 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-02-12 03:55:50,745 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1676174146717.bef88e13eab120ca8c7f6a50c6b022e5. 2023-02-12 03:55:50,746 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1676174146717.bef88e13eab120ca8c7f6a50c6b022e5. started... 2023-02-12 03:55:50,746 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1676174146717.d65656cfa2fa6fbc9b16f832db0fdeca. 2023-02-12 03:55:50,746 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing bef88e13eab120ca8c7f6a50c6b022e5 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-02-12 03:55:50,746 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1676174146717.d65656cfa2fa6fbc9b16f832db0fdeca. started... 2023-02-12 03:55:50,746 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-12 03:55:50,746 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-12 03:55:50,746 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1676174146717.61a9ec6d1e76a983beaae795490c1da9. 2023-02-12 03:55:50,746 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1676174146717.61a9ec6d1e76a983beaae795490c1da9. started... 2023-02-12 03:55:50,746 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing d65656cfa2fa6fbc9b16f832db0fdeca 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-02-12 03:55:50,746 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 61a9ec6d1e76a983beaae795490c1da9 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-02-12 03:55:50,783 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302127d087f41a656481cb5986a5d014c0789 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202302127d087f41a656481cb5986a5d014c0789 2023-02-12 03:55:51,193 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230212f83d4e2b2bd945ad924e4e62da787dd1 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230212f83d4e2b2bd945ad924e4e62da787dd1 2023-02-12 03:55:51,193 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230212e006ee6aac854db986fbf465e2a5a254 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230212e006ee6aac854db986fbf465e2a5a254 2023-02-12 03:55:51,196 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/d65656cfa2fa6fbc9b16f832db0fdeca/.tmp/family1/6eba0cc796b9456eaa34f8a103fa9412 2023-02-12 03:55:51,607 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/61a9ec6d1e76a983beaae795490c1da9/.tmp/family1/d101d35015c84f7594cfd76bf76a61f7 2023-02-12 03:55:51,610 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/bef88e13eab120ca8c7f6a50c6b022e5/.tmp/family1/162e0d17c42c4bfbad0f13546b54743e 2023-02-12 03:55:51,626 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302127fea2e0aff1d4e9cb490db3cbbb4a1f9 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c202302127fea2e0aff1d4e9cb490db3cbbb4a1f9 2023-02-12 03:55:52,030 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/d65656cfa2fa6fbc9b16f832db0fdeca/.tmp/family2/ca65a68b2f054188b3e068fc99521f1e 2023-02-12 03:55:52,033 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/d65656cfa2fa6fbc9b16f832db0fdeca/.tmp/family1/6eba0cc796b9456eaa34f8a103fa9412 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/d65656cfa2fa6fbc9b16f832db0fdeca/family1/6eba0cc796b9456eaa34f8a103fa9412 2023-02-12 03:55:52,043 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202302126375d923dee44b699a7b2a327096f720 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e202302126375d923dee44b699a7b2a327096f720 2023-02-12 03:55:52,048 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/61a9ec6d1e76a983beaae795490c1da9/.tmp/family2/c51d563437ad45ab82d7883484853e2f 2023-02-12 03:55:52,049 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230212017c023b00f046adb39574032dc84f76 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b20230212017c023b00f046adb39574032dc84f76 2023-02-12 03:55:52,051 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/61a9ec6d1e76a983beaae795490c1da9/.tmp/family1/d101d35015c84f7594cfd76bf76a61f7 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/61a9ec6d1e76a983beaae795490c1da9/family1/d101d35015c84f7594cfd76bf76a61f7 2023-02-12 03:55:52,058 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/d65656cfa2fa6fbc9b16f832db0fdeca/family1/6eba0cc796b9456eaa34f8a103fa9412, entries=4, sequenceid=9, filesize=5.5 K 2023-02-12 03:55:52,058 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/d65656cfa2fa6fbc9b16f832db0fdeca/.tmp/family2/ca65a68b2f054188b3e068fc99521f1e as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/d65656cfa2fa6fbc9b16f832db0fdeca/family2/ca65a68b2f054188b3e068fc99521f1e 2023-02-12 03:55:52,061 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/d65656cfa2fa6fbc9b16f832db0fdeca/family2/ca65a68b2f054188b3e068fc99521f1e, entries=2, sequenceid=9, filesize=5.1 K 2023-02-12 03:55:52,062 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for d65656cfa2fa6fbc9b16f832db0fdeca in 1316ms, sequenceid=9, compaction requested=false 2023-02-12 03:55:52,062 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for d65656cfa2fa6fbc9b16f832db0fdeca: 2023-02-12 03:55:52,062 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1676174146717.d65656cfa2fa6fbc9b16f832db0fdeca. 2023-02-12 03:55:52,062 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-12 03:55:52,072 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/61a9ec6d1e76a983beaae795490c1da9/family1/d101d35015c84f7594cfd76bf76a61f7, entries=4, sequenceid=9, filesize=5.5 K 2023-02-12 03:55:52,073 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/61a9ec6d1e76a983beaae795490c1da9/.tmp/family2/c51d563437ad45ab82d7883484853e2f as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/61a9ec6d1e76a983beaae795490c1da9/family2/c51d563437ad45ab82d7883484853e2f 2023-02-12 03:55:52,076 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/61a9ec6d1e76a983beaae795490c1da9/family2/c51d563437ad45ab82d7883484853e2f, entries=2, sequenceid=9, filesize=5.1 K 2023-02-12 03:55:52,077 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 61a9ec6d1e76a983beaae795490c1da9 in 1331ms, sequenceid=9, compaction requested=false 2023-02-12 03:55:52,077 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 61a9ec6d1e76a983beaae795490c1da9: 2023-02-12 03:55:52,077 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1676174146717.61a9ec6d1e76a983beaae795490c1da9. 2023-02-12 03:55:52,077 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-12 03:55:52,454 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/bef88e13eab120ca8c7f6a50c6b022e5/.tmp/family2/82bcc93243ec49bdb20a2d8105ddfe75 2023-02-12 03:55:52,459 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/bef88e13eab120ca8c7f6a50c6b022e5/.tmp/family1/162e0d17c42c4bfbad0f13546b54743e as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/bef88e13eab120ca8c7f6a50c6b022e5/family1/162e0d17c42c4bfbad0f13546b54743e 2023-02-12 03:55:52,491 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/bef88e13eab120ca8c7f6a50c6b022e5/family1/162e0d17c42c4bfbad0f13546b54743e, entries=4, sequenceid=9, filesize=5.5 K 2023-02-12 03:55:52,492 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/bef88e13eab120ca8c7f6a50c6b022e5/.tmp/family2/82bcc93243ec49bdb20a2d8105ddfe75 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/bef88e13eab120ca8c7f6a50c6b022e5/family2/82bcc93243ec49bdb20a2d8105ddfe75 2023-02-12 03:55:52,495 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/bef88e13eab120ca8c7f6a50c6b022e5/family2/82bcc93243ec49bdb20a2d8105ddfe75, entries=2, sequenceid=9, filesize=5.1 K 2023-02-12 03:55:52,496 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for bef88e13eab120ca8c7f6a50c6b022e5 in 1750ms, sequenceid=9, compaction requested=false 2023-02-12 03:55:52,496 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for bef88e13eab120ca8c7f6a50c6b022e5: 2023-02-12 03:55:52,496 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1676174146717.bef88e13eab120ca8c7f6a50c6b022e5. 2023-02-12 03:55:52,496 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-12 03:55:52,496 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-12 03:55:52,496 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:52,496 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-02-12 03:55:52,496 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-02-12 03:55:52,497 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-12 03:55:52,497 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:52,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:52,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:55:52,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:55:52,497 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-12 03:55:52,497 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 03:55:52,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:55:52,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:55:52,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-12 03:55:52,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:52,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:55:52,499 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-02-12 03:55:52,499 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-02-12 03:55:52,499 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@69b81e8d[Count = 0] remaining members to acquire global barrier 2023-02-12 03:55:52,499 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-12 03:55:52,499 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-12 03:55:52,499 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-12 03:55:52,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-12 03:55:52,500 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-02-12 03:55:52,500 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:52,500 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-12 03:55:52,500 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-02-12 03:55:52,500 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase20.apache.org,39639,1676173982450' in zk 2023-02-12 03:55:52,500 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:52,500 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-02-12 03:55:52,501 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:55:52,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:52,501 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-02-12 03:55:52,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:55:52,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:55:52,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:55:52,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:55:52,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-12 03:55:52,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:52,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:55:52,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-12 03:55:52,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:52,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase20.apache.org,39639,1676173982450': 2023-02-12 03:55:52,503 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-02-12 03:55:52,503 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-02-12 03:55:52,503 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-12 03:55:52,503 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-12 03:55:52,504 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-02-12 03:55:52,504 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-12 03:55:52,504 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-12 03:55:52,504 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-12 03:55:52,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-12 03:55:52,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:55:52,505 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:55:52,505 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-12 03:55:52,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:55:52,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-12 03:55:52,505 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:52,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:55:52,505 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:55:52,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:55:52,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-12 03:55:52,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-12 03:55:52,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:55:52,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-12 03:55:52,506 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:52,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:52,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:55:52,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-12 03:55:52,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:52,508 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:52,508 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:55:52,508 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:55:52,508 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-12 03:55:52,508 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-12 03:55:52,508 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:55:52,508 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-02-12 03:55:52,508 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:55:52,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:55:52,508 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40099] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-02-12 03:55:52,509 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40099] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-12 03:55:52,508 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:52,509 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:55:52,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:55:52,509 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-02-12 03:55:52,509 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-12 03:55:52,509 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-12 03:55:52,509 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-12 03:55:52,509 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-12 03:55:52,609 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-12 03:55:52,610 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40099] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-12 03:55:52,611 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39639] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,,1676174146717.61a9ec6d1e76a983beaae795490c1da9. with WAL disabled. Data may be lost in the event of a crash. 2023-02-12 03:55:52,611 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39639] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,1,1676174146717.bef88e13eab120ca8c7f6a50c6b022e5. with WAL disabled. Data may be lost in the event of a crash. 2023-02-12 03:55:52,611 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39639] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,2,1676174146717.d65656cfa2fa6fbc9b16f832db0fdeca. with WAL disabled. Data may be lost in the event of a crash. 2023-02-12 03:55:52,614 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40099] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-12 03:55:52,617 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40099] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-02-12 03:55:52,617 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40099] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-02-12 03:55:52,617 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-02-12 03:55:52,617 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:55:52,617 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-02-12 03:55:52,617 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-02-12 03:55:52,618 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-12 03:55:52,618 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-12 03:55:52,618 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:55:52,618 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:52,618 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:55:52,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:55:52,619 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:52,619 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-12 03:55:52,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-12 03:55:52,619 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-12 03:55:52,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-12 03:55:52,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-12 03:55:52,620 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-02-12 03:55:52,620 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-02-12 03:55:52,620 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-02-12 03:55:52,620 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-02-12 03:55:52,620 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:55:52,620 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-02-12 03:55:52,621 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1676174146717.bef88e13eab120ca8c7f6a50c6b022e5. 2023-02-12 03:55:52,621 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1676174146717.bef88e13eab120ca8c7f6a50c6b022e5. started... 2023-02-12 03:55:52,621 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing bef88e13eab120ca8c7f6a50c6b022e5 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-02-12 03:55:52,621 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1676174146717.d65656cfa2fa6fbc9b16f832db0fdeca. 2023-02-12 03:55:52,621 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1676174146717.d65656cfa2fa6fbc9b16f832db0fdeca. started... 2023-02-12 03:55:52,621 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing d65656cfa2fa6fbc9b16f832db0fdeca 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-02-12 03:55:52,623 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-12 03:55:52,623 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-12 03:55:52,623 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1676174146717.61a9ec6d1e76a983beaae795490c1da9. 2023-02-12 03:55:52,623 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1676174146717.61a9ec6d1e76a983beaae795490c1da9. started... 2023-02-12 03:55:52,623 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 61a9ec6d1e76a983beaae795490c1da9 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-02-12 03:55:52,716 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230212b6304f7a0cc04f0d82c46e6d4ca568ee to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230212b6304f7a0cc04f0d82c46e6d4ca568ee 2023-02-12 03:55:52,735 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230212108241a9e9834e4c9b079540439e7c96 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230212108241a9e9834e4c9b079540439e7c96 2023-02-12 03:55:52,739 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/d65656cfa2fa6fbc9b16f832db0fdeca/.tmp/family1/220c9a327a4141fba76ba2ae775222f9 2023-02-12 03:55:52,791 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302128de89708eb4042caa07b3016fb7ca113 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c202302128de89708eb4042caa07b3016fb7ca113 2023-02-12 03:55:52,813 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/d65656cfa2fa6fbc9b16f832db0fdeca/.tmp/family2/96cb0ae04736499ea8bedbc0d950eae7 2023-02-12 03:55:52,820 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/d65656cfa2fa6fbc9b16f832db0fdeca/.tmp/family1/220c9a327a4141fba76ba2ae775222f9 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/d65656cfa2fa6fbc9b16f832db0fdeca/family1/220c9a327a4141fba76ba2ae775222f9 2023-02-12 03:55:52,845 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/d65656cfa2fa6fbc9b16f832db0fdeca/family1/220c9a327a4141fba76ba2ae775222f9, entries=4, sequenceid=13, filesize=5.5 K 2023-02-12 03:55:52,846 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/d65656cfa2fa6fbc9b16f832db0fdeca/.tmp/family2/96cb0ae04736499ea8bedbc0d950eae7 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/d65656cfa2fa6fbc9b16f832db0fdeca/family2/96cb0ae04736499ea8bedbc0d950eae7 2023-02-12 03:55:52,850 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/d65656cfa2fa6fbc9b16f832db0fdeca/family2/96cb0ae04736499ea8bedbc0d950eae7, entries=2, sequenceid=13, filesize=5.1 K 2023-02-12 03:55:52,851 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for d65656cfa2fa6fbc9b16f832db0fdeca in 230ms, sequenceid=13, compaction requested=true 2023-02-12 03:55:52,851 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for d65656cfa2fa6fbc9b16f832db0fdeca: 2023-02-12 03:55:52,851 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1676174146717.d65656cfa2fa6fbc9b16f832db0fdeca. 2023-02-12 03:55:52,851 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-12 03:55:53,118 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230212a1c82a286920405c86cff297009d7eb3 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230212a1c82a286920405c86cff297009d7eb3 2023-02-12 03:55:53,160 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/bef88e13eab120ca8c7f6a50c6b022e5/.tmp/family1/effbf55f205d475fb885ac940368a2f8 2023-02-12 03:55:53,461 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-12 03:55:53,531 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/61a9ec6d1e76a983beaae795490c1da9/.tmp/family1/2e77cec417a14088bd74f4d5a3168e0a 2023-02-12 03:55:53,594 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202302120f30dcd95e944cbda8bd2cd87cda5cfa to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b202302120f30dcd95e944cbda8bd2cd87cda5cfa 2023-02-12 03:55:53,970 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230212ab7fe908c8474e4ea4203cd7fd3a7850 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e20230212ab7fe908c8474e4ea4203cd7fd3a7850 2023-02-12 03:55:54,000 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/bef88e13eab120ca8c7f6a50c6b022e5/.tmp/family2/a349179687da4dbf92ca72b1b2d644a6 2023-02-12 03:55:54,005 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/bef88e13eab120ca8c7f6a50c6b022e5/.tmp/family1/effbf55f205d475fb885ac940368a2f8 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/bef88e13eab120ca8c7f6a50c6b022e5/family1/effbf55f205d475fb885ac940368a2f8 2023-02-12 03:55:54,026 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/bef88e13eab120ca8c7f6a50c6b022e5/family1/effbf55f205d475fb885ac940368a2f8, entries=4, sequenceid=13, filesize=5.5 K 2023-02-12 03:55:54,027 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/bef88e13eab120ca8c7f6a50c6b022e5/.tmp/family2/a349179687da4dbf92ca72b1b2d644a6 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/bef88e13eab120ca8c7f6a50c6b022e5/family2/a349179687da4dbf92ca72b1b2d644a6 2023-02-12 03:55:54,030 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/bef88e13eab120ca8c7f6a50c6b022e5/family2/a349179687da4dbf92ca72b1b2d644a6, entries=2, sequenceid=13, filesize=5.1 K 2023-02-12 03:55:54,031 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for bef88e13eab120ca8c7f6a50c6b022e5 in 1410ms, sequenceid=13, compaction requested=true 2023-02-12 03:55:54,031 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for bef88e13eab120ca8c7f6a50c6b022e5: 2023-02-12 03:55:54,031 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1676174146717.bef88e13eab120ca8c7f6a50c6b022e5. 2023-02-12 03:55:54,031 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-12 03:55:54,375 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/61a9ec6d1e76a983beaae795490c1da9/.tmp/family2/bcbd1c3aa6474dd5bafbf1053ae3168e 2023-02-12 03:55:54,380 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/61a9ec6d1e76a983beaae795490c1da9/.tmp/family1/2e77cec417a14088bd74f4d5a3168e0a as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/61a9ec6d1e76a983beaae795490c1da9/family1/2e77cec417a14088bd74f4d5a3168e0a 2023-02-12 03:55:54,401 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/61a9ec6d1e76a983beaae795490c1da9/family1/2e77cec417a14088bd74f4d5a3168e0a, entries=4, sequenceid=13, filesize=5.5 K 2023-02-12 03:55:54,402 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/61a9ec6d1e76a983beaae795490c1da9/.tmp/family2/bcbd1c3aa6474dd5bafbf1053ae3168e as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/61a9ec6d1e76a983beaae795490c1da9/family2/bcbd1c3aa6474dd5bafbf1053ae3168e 2023-02-12 03:55:54,405 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/61a9ec6d1e76a983beaae795490c1da9/family2/bcbd1c3aa6474dd5bafbf1053ae3168e, entries=2, sequenceid=13, filesize=5.1 K 2023-02-12 03:55:54,406 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 61a9ec6d1e76a983beaae795490c1da9 in 1783ms, sequenceid=13, compaction requested=true 2023-02-12 03:55:54,406 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 61a9ec6d1e76a983beaae795490c1da9: 2023-02-12 03:55:54,406 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1676174146717.61a9ec6d1e76a983beaae795490c1da9. 2023-02-12 03:55:54,406 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-12 03:55:54,406 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-12 03:55:54,406 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:54,406 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-02-12 03:55:54,406 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-02-12 03:55:54,407 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-12 03:55:54,407 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:54,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:54,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:55:54,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:55:54,408 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-12 03:55:54,408 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 03:55:54,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:55:54,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:55:54,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-12 03:55:54,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:54,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:55:54,409 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-02-12 03:55:54,409 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@78f7c0bc[Count = 0] remaining members to acquire global barrier 2023-02-12 03:55:54,409 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-02-12 03:55:54,409 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-12 03:55:54,409 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-12 03:55:54,409 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-12 03:55:54,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-12 03:55:54,409 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-02-12 03:55:54,409 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:54,409 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-12 03:55:54,409 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-02-12 03:55:54,410 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase20.apache.org,39639,1676173982450' in zk 2023-02-12 03:55:54,410 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:54,410 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-02-12 03:55:54,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:54,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:55:54,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:55:54,410 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:55:54,410 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-02-12 03:55:54,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:55:54,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:55:54,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-12 03:55:54,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:54,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:55:54,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-12 03:55:54,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:54,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase20.apache.org,39639,1676173982450': 2023-02-12 03:55:54,412 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-02-12 03:55:54,412 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-02-12 03:55:54,412 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-12 03:55:54,412 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-12 03:55:54,412 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-02-12 03:55:54,412 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-12 03:55:54,413 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-12 03:55:54,413 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:55:54,413 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-12 03:55:54,413 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-12 03:55:54,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-12 03:55:54,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-12 03:55:54,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:55:54,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:55:54,413 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:54,413 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:55:54,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:55:54,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:55:54,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-12 03:55:54,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-12 03:55:54,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:55:54,414 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:54,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-12 03:55:54,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:54,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:55:54,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-12 03:55:54,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:54,416 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:54,416 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:55:54,416 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-12 03:55:54,416 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:55:54,416 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:55:54,416 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:55:54,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:55:54,416 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40099] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-02-12 03:55:54,416 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40099] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-12 03:55:54,416 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-12 03:55:54,417 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:54,417 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-12 03:55:54,417 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:55:54,417 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-02-12 03:55:54,417 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-12 03:55:54,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:55:54,417 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-12 03:55:54,417 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-02-12 03:55:54,417 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-12 03:55:54,517 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-12 03:55:54,518 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40099] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-12 03:55:54,519 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39639] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,,1676174146717.61a9ec6d1e76a983beaae795490c1da9. with WAL disabled. Data may be lost in the event of a crash. 2023-02-12 03:55:54,519 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39639] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,1,1676174146717.bef88e13eab120ca8c7f6a50c6b022e5. with WAL disabled. Data may be lost in the event of a crash. 2023-02-12 03:55:54,519 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39639] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,2,1676174146717.d65656cfa2fa6fbc9b16f832db0fdeca. with WAL disabled. Data may be lost in the event of a crash. 2023-02-12 03:55:54,521 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40099] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-12 03:55:54,522 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40099] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-02-12 03:55:54,522 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40099] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-02-12 03:55:54,522 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-02-12 03:55:54,522 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:55:54,522 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-02-12 03:55:54,522 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-02-12 03:55:54,523 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-12 03:55:54,523 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-12 03:55:54,523 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:55:54,523 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:54,523 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:55:54,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:55:54,524 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:54,524 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-12 03:55:54,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-12 03:55:54,524 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-12 03:55:54,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-12 03:55:54,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-12 03:55:54,524 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-02-12 03:55:54,524 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-02-12 03:55:54,524 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-02-12 03:55:54,525 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-02-12 03:55:54,525 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:55:54,525 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-02-12 03:55:54,526 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1676174146717.bef88e13eab120ca8c7f6a50c6b022e5. 2023-02-12 03:55:54,526 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1676174146717.d65656cfa2fa6fbc9b16f832db0fdeca. 2023-02-12 03:55:54,527 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1676174146717.d65656cfa2fa6fbc9b16f832db0fdeca. started... 2023-02-12 03:55:54,526 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1676174146717.bef88e13eab120ca8c7f6a50c6b022e5. started... 2023-02-12 03:55:54,527 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing d65656cfa2fa6fbc9b16f832db0fdeca 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-02-12 03:55:54,527 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing bef88e13eab120ca8c7f6a50c6b022e5 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-02-12 03:55:54,527 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-12 03:55:54,527 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1676174146717.61a9ec6d1e76a983beaae795490c1da9. 2023-02-12 03:55:54,527 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-12 03:55:54,527 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1676174146717.61a9ec6d1e76a983beaae795490c1da9. started... 2023-02-12 03:55:54,527 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 61a9ec6d1e76a983beaae795490c1da9 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-02-12 03:55:54,569 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302124e93cb34390f42f89c6704142dca1671 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202302124e93cb34390f42f89c6704142dca1671 2023-02-12 03:55:54,569 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202302121040b025bc9a4ceda90c0cdb365188fc to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202302121040b025bc9a4ceda90c0cdb365188fc 2023-02-12 03:55:54,969 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230212b0978ae04356465d9a08a237164ee40b to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230212b0978ae04356465d9a08a237164ee40b 2023-02-12 03:55:54,986 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/d65656cfa2fa6fbc9b16f832db0fdeca/.tmp/family1/cb28ef59377c4e8c8d8c865bdc8ffc13 2023-02-12 03:55:54,986 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/bef88e13eab120ca8c7f6a50c6b022e5/.tmp/family1/b13f1fe082274949a0bed8e7345dd2d0 2023-02-12 03:55:54,987 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/61a9ec6d1e76a983beaae795490c1da9/.tmp/family1/d8a5b152f75542c3a527847358520760 2023-02-12 03:55:55,051 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202302121e2ba57b56e64ac1868e2c266fbd91c4 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b202302121e2ba57b56e64ac1868e2c266fbd91c4 2023-02-12 03:55:55,071 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230212f8674751495a448f824613434252987d to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c20230212f8674751495a448f824613434252987d 2023-02-12 03:55:55,075 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230212adb26314fa3e4847aa8562631f293642 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e20230212adb26314fa3e4847aa8562631f293642 2023-02-12 03:55:55,469 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/bef88e13eab120ca8c7f6a50c6b022e5/.tmp/family2/29320959da714e3c83573ff7ab77ace0 2023-02-12 03:55:55,473 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/bef88e13eab120ca8c7f6a50c6b022e5/.tmp/family1/b13f1fe082274949a0bed8e7345dd2d0 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/bef88e13eab120ca8c7f6a50c6b022e5/family1/b13f1fe082274949a0bed8e7345dd2d0 2023-02-12 03:55:55,477 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/d65656cfa2fa6fbc9b16f832db0fdeca/.tmp/family2/d06a41be24a74ea29e604b75bda53a94 2023-02-12 03:55:55,480 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/61a9ec6d1e76a983beaae795490c1da9/.tmp/family2/74b79c578ef64bea933b58a2584b0303 2023-02-12 03:55:55,481 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/d65656cfa2fa6fbc9b16f832db0fdeca/.tmp/family1/cb28ef59377c4e8c8d8c865bdc8ffc13 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/d65656cfa2fa6fbc9b16f832db0fdeca/family1/cb28ef59377c4e8c8d8c865bdc8ffc13 2023-02-12 03:55:55,484 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/61a9ec6d1e76a983beaae795490c1da9/.tmp/family1/d8a5b152f75542c3a527847358520760 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/61a9ec6d1e76a983beaae795490c1da9/family1/d8a5b152f75542c3a527847358520760 2023-02-12 03:55:55,502 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/d65656cfa2fa6fbc9b16f832db0fdeca/family1/cb28ef59377c4e8c8d8c865bdc8ffc13, entries=4, sequenceid=17, filesize=5.5 K 2023-02-12 03:55:55,503 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/d65656cfa2fa6fbc9b16f832db0fdeca/.tmp/family2/d06a41be24a74ea29e604b75bda53a94 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/d65656cfa2fa6fbc9b16f832db0fdeca/family2/d06a41be24a74ea29e604b75bda53a94 2023-02-12 03:55:55,503 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/61a9ec6d1e76a983beaae795490c1da9/family1/d8a5b152f75542c3a527847358520760, entries=4, sequenceid=17, filesize=5.5 K 2023-02-12 03:55:55,503 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/bef88e13eab120ca8c7f6a50c6b022e5/family1/b13f1fe082274949a0bed8e7345dd2d0, entries=4, sequenceid=17, filesize=5.5 K 2023-02-12 03:55:55,504 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/61a9ec6d1e76a983beaae795490c1da9/.tmp/family2/74b79c578ef64bea933b58a2584b0303 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/61a9ec6d1e76a983beaae795490c1da9/family2/74b79c578ef64bea933b58a2584b0303 2023-02-12 03:55:55,504 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/bef88e13eab120ca8c7f6a50c6b022e5/.tmp/family2/29320959da714e3c83573ff7ab77ace0 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/bef88e13eab120ca8c7f6a50c6b022e5/family2/29320959da714e3c83573ff7ab77ace0 2023-02-12 03:55:55,507 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/bef88e13eab120ca8c7f6a50c6b022e5/family2/29320959da714e3c83573ff7ab77ace0, entries=2, sequenceid=17, filesize=5.1 K 2023-02-12 03:55:55,508 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for bef88e13eab120ca8c7f6a50c6b022e5 in 981ms, sequenceid=17, compaction requested=true 2023-02-12 03:55:55,508 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for bef88e13eab120ca8c7f6a50c6b022e5: 2023-02-12 03:55:55,508 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1676174146717.bef88e13eab120ca8c7f6a50c6b022e5. 2023-02-12 03:55:55,508 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-12 03:55:55,512 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/d65656cfa2fa6fbc9b16f832db0fdeca/family2/d06a41be24a74ea29e604b75bda53a94, entries=2, sequenceid=17, filesize=5.1 K 2023-02-12 03:55:55,512 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/61a9ec6d1e76a983beaae795490c1da9/family2/74b79c578ef64bea933b58a2584b0303, entries=2, sequenceid=17, filesize=5.1 K 2023-02-12 03:55:55,512 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for d65656cfa2fa6fbc9b16f832db0fdeca in 985ms, sequenceid=17, compaction requested=true 2023-02-12 03:55:55,512 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for d65656cfa2fa6fbc9b16f832db0fdeca: 2023-02-12 03:55:55,513 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1676174146717.d65656cfa2fa6fbc9b16f832db0fdeca. 2023-02-12 03:55:55,513 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-12 03:55:55,513 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 61a9ec6d1e76a983beaae795490c1da9 in 986ms, sequenceid=17, compaction requested=true 2023-02-12 03:55:55,513 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 61a9ec6d1e76a983beaae795490c1da9: 2023-02-12 03:55:55,513 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1676174146717.61a9ec6d1e76a983beaae795490c1da9. 2023-02-12 03:55:55,513 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-12 03:55:55,513 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-12 03:55:55,513 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:55,513 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-02-12 03:55:55,513 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-02-12 03:55:55,514 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:55,514 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-12 03:55:55,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:55,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:55:55,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:55:55,514 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-12 03:55:55,514 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 03:55:55,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:55:55,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:55:55,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-12 03:55:55,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:55,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:55:55,515 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-02-12 03:55:55,516 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5c41ac9a[Count = 0] remaining members to acquire global barrier 2023-02-12 03:55:55,516 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-02-12 03:55:55,516 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-12 03:55:55,516 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-12 03:55:55,516 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-12 03:55:55,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-12 03:55:55,516 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-02-12 03:55:55,516 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-02-12 03:55:55,516 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:55,516 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-12 03:55:55,516 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase20.apache.org,39639,1676173982450' in zk 2023-02-12 03:55:55,517 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-02-12 03:55:55,517 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:55:55,517 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:55,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:55,517 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-02-12 03:55:55,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:55:55,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:55:55,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:55:55,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:55:55,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-12 03:55:55,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:55,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:55:55,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-12 03:55:55,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:55,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase20.apache.org,39639,1676173982450': 2023-02-12 03:55:55,520 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-02-12 03:55:55,520 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-02-12 03:55:55,520 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-12 03:55:55,520 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-12 03:55:55,520 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-02-12 03:55:55,520 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-12 03:55:55,521 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-12 03:55:55,521 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-12 03:55:55,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-12 03:55:55,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:55:55,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:55:55,521 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-12 03:55:55,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-12 03:55:55,521 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:55:55,521 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:55,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:55:55,521 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:55:55,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:55:55,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-12 03:55:55,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-12 03:55:55,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:55:55,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-12 03:55:55,523 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:55,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:55,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:55:55,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-12 03:55:55,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:55,524 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:55,524 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:55:55,524 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-12 03:55:55,524 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:55:55,524 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:55:55,524 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40099] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-02-12 03:55:55,524 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40099] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-12 03:55:55,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:55:55,524 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:55:55,524 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-12 03:55:55,525 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:55,525 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-12 03:55:55,525 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-12 03:55:55,525 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-12 03:55:55,525 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-02-12 03:55:55,524 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-02-12 03:55:55,525 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-12 03:55:55,525 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:55:55,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:55:55,625 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-12 03:55:55,626 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40099] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-12 03:55:55,644 DEBUG [Listener at localhost.localdomain/41049] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-12 03:55:55,653 DEBUG [Listener at localhost.localdomain/41049] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-12 03:55:55,663 DEBUG [Listener at localhost.localdomain/41049] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-12 03:55:55,665 DEBUG [Listener at localhost.localdomain/41049] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-12 03:55:55,745 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40099] master.MasterRpcServices(933): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-02-12 03:55:55,746 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40099] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-02-12 03:55:55,746 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40099] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-02-12 03:55:55,746 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-02-12 03:55:55,746 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:55:55,746 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-02-12 03:55:55,746 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-02-12 03:55:55,746 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-12 03:55:55,746 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-12 03:55:55,747 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:55,747 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:55:55,747 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:55:55,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:55:55,747 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:55,747 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-12 03:55:55,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-12 03:55:55,748 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-12 03:55:55,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-12 03:55:55,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-12 03:55:55,748 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-02-12 03:55:55,748 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-02-12 03:55:55,748 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-02-12 03:55:55,748 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-02-12 03:55:55,748 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-12 03:55:55,748 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-02-12 03:55:55,748 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1676174146717.bef88e13eab120ca8c7f6a50c6b022e5. 2023-02-12 03:55:55,748 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1676174146717.bef88e13eab120ca8c7f6a50c6b022e5. started... 2023-02-12 03:55:55,748 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1676174146717.d65656cfa2fa6fbc9b16f832db0fdeca. 2023-02-12 03:55:55,748 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-12 03:55:55,749 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing bef88e13eab120ca8c7f6a50c6b022e5 2/2 column families, dataSize=138 B heapSize=944 B 2023-02-12 03:55:55,749 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-12 03:55:55,749 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1676174146717.61a9ec6d1e76a983beaae795490c1da9. 2023-02-12 03:55:55,749 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1676174146717.d65656cfa2fa6fbc9b16f832db0fdeca. started... 2023-02-12 03:55:55,749 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1676174146717.61a9ec6d1e76a983beaae795490c1da9. started... 2023-02-12 03:55:55,749 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing d65656cfa2fa6fbc9b16f832db0fdeca 2/2 column families, dataSize=138 B heapSize=944 B 2023-02-12 03:55:55,749 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 61a9ec6d1e76a983beaae795490c1da9 2/2 column families, dataSize=138 B heapSize=944 B 2023-02-12 03:55:56,188 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/61a9ec6d1e76a983beaae795490c1da9/.tmp/family1/4bff2d9098b94e2fb23a1448ccf197ff 2023-02-12 03:55:56,206 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4bff2d9098b94e2fb23a1448ccf197ff 2023-02-12 03:55:56,587 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/bef88e13eab120ca8c7f6a50c6b022e5/.tmp/family1/3a5ada84ffb742909d1bc46b8db38764 2023-02-12 03:55:56,589 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/d65656cfa2fa6fbc9b16f832db0fdeca/.tmp/family1/cebccbdc74bf464fac8c12b96b469b7d 2023-02-12 03:55:56,609 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3a5ada84ffb742909d1bc46b8db38764 2023-02-12 03:55:56,616 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for cebccbdc74bf464fac8c12b96b469b7d 2023-02-12 03:55:56,627 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/61a9ec6d1e76a983beaae795490c1da9/.tmp/family2/74518e276fe04d069d5f08331d387c51 2023-02-12 03:55:56,630 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 74518e276fe04d069d5f08331d387c51 2023-02-12 03:55:56,631 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/61a9ec6d1e76a983beaae795490c1da9/.tmp/family1/4bff2d9098b94e2fb23a1448ccf197ff as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/61a9ec6d1e76a983beaae795490c1da9/family1/4bff2d9098b94e2fb23a1448ccf197ff 2023-02-12 03:55:56,660 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4bff2d9098b94e2fb23a1448ccf197ff 2023-02-12 03:55:56,660 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/61a9ec6d1e76a983beaae795490c1da9/family1/4bff2d9098b94e2fb23a1448ccf197ff, entries=3, sequenceid=23, filesize=5.2 K 2023-02-12 03:55:56,661 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/61a9ec6d1e76a983beaae795490c1da9/.tmp/family2/74518e276fe04d069d5f08331d387c51 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/61a9ec6d1e76a983beaae795490c1da9/family2/74518e276fe04d069d5f08331d387c51 2023-02-12 03:55:56,664 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 74518e276fe04d069d5f08331d387c51 2023-02-12 03:55:56,664 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/61a9ec6d1e76a983beaae795490c1da9/family2/74518e276fe04d069d5f08331d387c51, entries=1, sequenceid=23, filesize=5.0 K 2023-02-12 03:55:56,665 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 61a9ec6d1e76a983beaae795490c1da9 in 916ms, sequenceid=23, compaction requested=true 2023-02-12 03:55:56,665 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 61a9ec6d1e76a983beaae795490c1da9: 2023-02-12 03:55:56,665 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1676174146717.61a9ec6d1e76a983beaae795490c1da9. 2023-02-12 03:55:56,665 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-12 03:55:57,438 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/d65656cfa2fa6fbc9b16f832db0fdeca/.tmp/family2/42f9276d76a94794b1862dc0ac595c67 2023-02-12 03:55:57,443 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 42f9276d76a94794b1862dc0ac595c67 2023-02-12 03:55:57,443 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/d65656cfa2fa6fbc9b16f832db0fdeca/.tmp/family1/cebccbdc74bf464fac8c12b96b469b7d as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/d65656cfa2fa6fbc9b16f832db0fdeca/family1/cebccbdc74bf464fac8c12b96b469b7d 2023-02-12 03:55:57,445 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/bef88e13eab120ca8c7f6a50c6b022e5/.tmp/family2/07cb49fc12b04f5da9fd23c331ff3d9f 2023-02-12 03:55:57,448 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 07cb49fc12b04f5da9fd23c331ff3d9f 2023-02-12 03:55:57,448 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/bef88e13eab120ca8c7f6a50c6b022e5/.tmp/family1/3a5ada84ffb742909d1bc46b8db38764 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/bef88e13eab120ca8c7f6a50c6b022e5/family1/3a5ada84ffb742909d1bc46b8db38764 2023-02-12 03:55:57,473 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for cebccbdc74bf464fac8c12b96b469b7d 2023-02-12 03:55:57,473 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/d65656cfa2fa6fbc9b16f832db0fdeca/family1/cebccbdc74bf464fac8c12b96b469b7d, entries=3, sequenceid=23, filesize=5.2 K 2023-02-12 03:55:57,474 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/d65656cfa2fa6fbc9b16f832db0fdeca/.tmp/family2/42f9276d76a94794b1862dc0ac595c67 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/d65656cfa2fa6fbc9b16f832db0fdeca/family2/42f9276d76a94794b1862dc0ac595c67 2023-02-12 03:55:57,476 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3a5ada84ffb742909d1bc46b8db38764 2023-02-12 03:55:57,476 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/bef88e13eab120ca8c7f6a50c6b022e5/family1/3a5ada84ffb742909d1bc46b8db38764, entries=3, sequenceid=23, filesize=5.2 K 2023-02-12 03:55:57,477 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/bef88e13eab120ca8c7f6a50c6b022e5/.tmp/family2/07cb49fc12b04f5da9fd23c331ff3d9f as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/bef88e13eab120ca8c7f6a50c6b022e5/family2/07cb49fc12b04f5da9fd23c331ff3d9f 2023-02-12 03:55:57,478 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 42f9276d76a94794b1862dc0ac595c67 2023-02-12 03:55:57,478 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/d65656cfa2fa6fbc9b16f832db0fdeca/family2/42f9276d76a94794b1862dc0ac595c67, entries=1, sequenceid=23, filesize=5.0 K 2023-02-12 03:55:57,478 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for d65656cfa2fa6fbc9b16f832db0fdeca in 1729ms, sequenceid=23, compaction requested=true 2023-02-12 03:55:57,478 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for d65656cfa2fa6fbc9b16f832db0fdeca: 2023-02-12 03:55:57,479 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1676174146717.d65656cfa2fa6fbc9b16f832db0fdeca. 2023-02-12 03:55:57,479 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-12 03:55:57,480 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 07cb49fc12b04f5da9fd23c331ff3d9f 2023-02-12 03:55:57,480 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/bef88e13eab120ca8c7f6a50c6b022e5/family2/07cb49fc12b04f5da9fd23c331ff3d9f, entries=1, sequenceid=23, filesize=5.0 K 2023-02-12 03:55:57,481 INFO [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for bef88e13eab120ca8c7f6a50c6b022e5 in 1732ms, sequenceid=23, compaction requested=true 2023-02-12 03:55:57,481 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for bef88e13eab120ca8c7f6a50c6b022e5: 2023-02-12 03:55:57,481 DEBUG [rs(jenkins-hbase20.apache.org,39639,1676173982450)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1676174146717.bef88e13eab120ca8c7f6a50c6b022e5. 2023-02-12 03:55:57,481 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-12 03:55:57,481 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-12 03:55:57,481 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:57,481 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-02-12 03:55:57,481 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-02-12 03:55:57,482 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:57,482 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-12 03:55:57,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:57,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:55:57,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:55:57,482 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-12 03:55:57,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:55:57,482 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-12 03:55:57,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:55:57,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-12 03:55:57,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:57,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:55:57,484 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,39639,1676173982450' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-02-12 03:55:57,484 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@bff0fa4[Count = 0] remaining members to acquire global barrier 2023-02-12 03:55:57,484 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-02-12 03:55:57,484 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-12 03:55:57,484 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-12 03:55:57,484 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-12 03:55:57,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-12 03:55:57,484 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-02-12 03:55:57,484 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-02-12 03:55:57,484 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:57,484 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-12 03:55:57,484 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase20.apache.org,39639,1676173982450' in zk 2023-02-12 03:55:57,485 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-02-12 03:55:57,485 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:57,485 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:55:57,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:57,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:55:57,485 DEBUG [member: 'jenkins-hbase20.apache.org,39639,1676173982450' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-02-12 03:55:57,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:55:57,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:55:57,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:55:57,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-12 03:55:57,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:57,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:55:57,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-12 03:55:57,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:57,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase20.apache.org,39639,1676173982450': 2023-02-12 03:55:57,487 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,39639,1676173982450' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-02-12 03:55:57,487 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-02-12 03:55:57,487 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-12 03:55:57,487 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-12 03:55:57,487 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-02-12 03:55:57,487 INFO [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-12 03:55:57,488 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-12 03:55:57,488 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-12 03:55:57,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-12 03:55:57,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-12 03:55:57,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-12 03:55:57,488 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-12 03:55:57,488 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:55:57,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-12 03:55:57,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-12 03:55:57,488 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:55:57,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:55:57,488 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:57,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-12 03:55:57,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-12 03:55:57,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-12 03:55:57,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-12 03:55:57,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:57,489 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:57,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-12 03:55:57,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-12 03:55:57,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:57,491 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:57,491 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-12 03:55:57,491 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-12 03:55:57,491 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-12 03:55:57,491 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-12 03:55:57,491 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-12 03:55:57,491 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:55:57,491 DEBUG [(jenkins-hbase20.apache.org,40099,1676173981406)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-12 03:55:57,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-12 03:55:57,491 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40099] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-02-12 03:55:57,491 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40099] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-12 03:55:57,491 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-12 03:55:57,492 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-12 03:55:57,492 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-12 03:55:57,492 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-12 03:55:57,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-12 03:55:57,492 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-02-12 03:55:57,492 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-12 03:55:57,592 DEBUG [Listener at localhost.localdomain/41049] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-12 03:55:57,593 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40099] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-12 03:55:57,594 DEBUG [Listener at localhost.localdomain/41049] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-12 03:55:57,594 DEBUG [Listener at localhost.localdomain/41049] regionserver.HStore(1912): bef88e13eab120ca8c7f6a50c6b022e5/family1 is initiating major compaction (all files) 2023-02-12 03:55:57,595 INFO [Listener at localhost.localdomain/41049] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-12 03:55:57,595 INFO [Listener at localhost.localdomain/41049] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 03:55:57,595 INFO [Listener at localhost.localdomain/41049] regionserver.HRegion(2258): Starting compaction of bef88e13eab120ca8c7f6a50c6b022e5/family1 in testMajorCompactionFromAdmin,1,1676174146717.bef88e13eab120ca8c7f6a50c6b022e5. 2023-02-12 03:55:57,595 INFO [Listener at localhost.localdomain/41049] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/bef88e13eab120ca8c7f6a50c6b022e5/family1/031cece029cc471a80aba5a6e2303dcf, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/bef88e13eab120ca8c7f6a50c6b022e5/family1/162e0d17c42c4bfbad0f13546b54743e, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/bef88e13eab120ca8c7f6a50c6b022e5/family1/effbf55f205d475fb885ac940368a2f8, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/bef88e13eab120ca8c7f6a50c6b022e5/family1/b13f1fe082274949a0bed8e7345dd2d0, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/bef88e13eab120ca8c7f6a50c6b022e5/family1/3a5ada84ffb742909d1bc46b8db38764] into tmpdir=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/bef88e13eab120ca8c7f6a50c6b022e5/.tmp, totalSize=27.1 K 2023-02-12 03:55:57,596 DEBUG [Listener at localhost.localdomain/41049] compactions.Compactor(207): Compacting 031cece029cc471a80aba5a6e2303dcf, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676174148862 2023-02-12 03:55:57,597 DEBUG [Listener at localhost.localdomain/41049] compactions.Compactor(207): Compacting 162e0d17c42c4bfbad0f13546b54743e, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676174150733 2023-02-12 03:55:57,598 DEBUG [Listener at localhost.localdomain/41049] compactions.Compactor(207): Compacting effbf55f205d475fb885ac940368a2f8, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676174152611 2023-02-12 03:55:57,599 DEBUG [Listener at localhost.localdomain/41049] compactions.Compactor(207): Compacting b13f1fe082274949a0bed8e7345dd2d0, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676174154519 2023-02-12 03:55:57,600 DEBUG [Listener at localhost.localdomain/41049] compactions.Compactor(207): Compacting 3a5ada84ffb742909d1bc46b8db38764, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-12 03:55:57,614 INFO [Listener at localhost.localdomain/41049] throttle.PressureAwareThroughputController(145): bef88e13eab120ca8c7f6a50c6b022e5#family1#compaction#198 average throughput is 0.57 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-12 03:55:58,055 INFO [Listener at localhost.localdomain/41049] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b2023021299f90f9d9fd445609f5e41a163f675bf_del 2023-02-12 03:55:58,055 INFO [Listener at localhost.localdomain/41049] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023021299f90f9d9fd445609f5e41a163f675bf_del to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023021299f90f9d9fd445609f5e41a163f675bf_del 2023-02-12 03:55:58,914 INFO [Listener at localhost.localdomain/41049] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0e19149905814bd6b946da42850f6f13 2023-02-12 03:55:58,914 DEBUG [Listener at localhost.localdomain/41049] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/bef88e13eab120ca8c7f6a50c6b022e5/.tmp/family1/0e19149905814bd6b946da42850f6f13 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/bef88e13eab120ca8c7f6a50c6b022e5/family1/0e19149905814bd6b946da42850f6f13 2023-02-12 03:55:58,955 INFO [Listener at localhost.localdomain/41049] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0e19149905814bd6b946da42850f6f13 2023-02-12 03:55:58,956 INFO [Listener at localhost.localdomain/41049] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in bef88e13eab120ca8c7f6a50c6b022e5/family1 of bef88e13eab120ca8c7f6a50c6b022e5 into 0e19149905814bd6b946da42850f6f13(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-12 03:55:58,957 DEBUG [Listener at localhost.localdomain/41049] regionserver.HRegion(2288): Compaction status journal for bef88e13eab120ca8c7f6a50c6b022e5: 2023-02-12 03:55:58,957 DEBUG [Listener at localhost.localdomain/41049] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-12 03:55:58,957 DEBUG [Listener at localhost.localdomain/41049] regionserver.HStore(1912): bef88e13eab120ca8c7f6a50c6b022e5/family2 is initiating major compaction (all files) 2023-02-12 03:55:58,957 INFO [Listener at localhost.localdomain/41049] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-12 03:55:58,957 INFO [Listener at localhost.localdomain/41049] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 03:55:58,957 INFO [Listener at localhost.localdomain/41049] regionserver.HRegion(2258): Starting compaction of bef88e13eab120ca8c7f6a50c6b022e5/family2 in testMajorCompactionFromAdmin,1,1676174146717.bef88e13eab120ca8c7f6a50c6b022e5. 2023-02-12 03:55:58,958 INFO [Listener at localhost.localdomain/41049] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/bef88e13eab120ca8c7f6a50c6b022e5/family2/836cb18c68a3448091dd1fc263234b8c, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/bef88e13eab120ca8c7f6a50c6b022e5/family2/82bcc93243ec49bdb20a2d8105ddfe75, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/bef88e13eab120ca8c7f6a50c6b022e5/family2/a349179687da4dbf92ca72b1b2d644a6, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/bef88e13eab120ca8c7f6a50c6b022e5/family2/29320959da714e3c83573ff7ab77ace0, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/bef88e13eab120ca8c7f6a50c6b022e5/family2/07cb49fc12b04f5da9fd23c331ff3d9f] into tmpdir=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/bef88e13eab120ca8c7f6a50c6b022e5/.tmp, totalSize=25.4 K 2023-02-12 03:55:58,959 DEBUG [Listener at localhost.localdomain/41049] compactions.Compactor(207): Compacting 836cb18c68a3448091dd1fc263234b8c, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676174148862 2023-02-12 03:55:58,960 DEBUG [Listener at localhost.localdomain/41049] compactions.Compactor(207): Compacting 82bcc93243ec49bdb20a2d8105ddfe75, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676174150733 2023-02-12 03:55:58,961 DEBUG [Listener at localhost.localdomain/41049] compactions.Compactor(207): Compacting a349179687da4dbf92ca72b1b2d644a6, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676174152611 2023-02-12 03:55:58,961 DEBUG [Listener at localhost.localdomain/41049] compactions.Compactor(207): Compacting 29320959da714e3c83573ff7ab77ace0, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676174154519 2023-02-12 03:55:58,961 DEBUG [Listener at localhost.localdomain/41049] compactions.Compactor(207): Compacting 07cb49fc12b04f5da9fd23c331ff3d9f, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-12 03:55:58,969 INFO [Listener at localhost.localdomain/41049] throttle.PressureAwareThroughputController(145): bef88e13eab120ca8c7f6a50c6b022e5#family2#compaction#199 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-12 03:55:59,059 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/bef88e13eab120ca8c7f6a50c6b022e5/family1/031cece029cc471a80aba5a6e2303dcf, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/bef88e13eab120ca8c7f6a50c6b022e5/family1/162e0d17c42c4bfbad0f13546b54743e, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/bef88e13eab120ca8c7f6a50c6b022e5/family1/effbf55f205d475fb885ac940368a2f8, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/bef88e13eab120ca8c7f6a50c6b022e5/family1/b13f1fe082274949a0bed8e7345dd2d0, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/bef88e13eab120ca8c7f6a50c6b022e5/family1/3a5ada84ffb742909d1bc46b8db38764] to archive 2023-02-12 03:55:59,060 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-12 03:55:59,061 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/bef88e13eab120ca8c7f6a50c6b022e5/family1/031cece029cc471a80aba5a6e2303dcf to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMajorCompactionFromAdmin/bef88e13eab120ca8c7f6a50c6b022e5/family1/031cece029cc471a80aba5a6e2303dcf 2023-02-12 03:55:59,063 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/bef88e13eab120ca8c7f6a50c6b022e5/family1/162e0d17c42c4bfbad0f13546b54743e to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMajorCompactionFromAdmin/bef88e13eab120ca8c7f6a50c6b022e5/family1/162e0d17c42c4bfbad0f13546b54743e 2023-02-12 03:55:59,064 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/bef88e13eab120ca8c7f6a50c6b022e5/family1/effbf55f205d475fb885ac940368a2f8 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMajorCompactionFromAdmin/bef88e13eab120ca8c7f6a50c6b022e5/family1/effbf55f205d475fb885ac940368a2f8 2023-02-12 03:55:59,065 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/bef88e13eab120ca8c7f6a50c6b022e5/family1/b13f1fe082274949a0bed8e7345dd2d0 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMajorCompactionFromAdmin/bef88e13eab120ca8c7f6a50c6b022e5/family1/b13f1fe082274949a0bed8e7345dd2d0 2023-02-12 03:55:59,066 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/bef88e13eab120ca8c7f6a50c6b022e5/family1/3a5ada84ffb742909d1bc46b8db38764 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMajorCompactionFromAdmin/bef88e13eab120ca8c7f6a50c6b022e5/family1/3a5ada84ffb742909d1bc46b8db38764 2023-02-12 03:55:59,381 INFO [Listener at localhost.localdomain/41049] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20230212e19cc88c147a45b09080bc729715d052_del 2023-02-12 03:55:59,381 INFO [Listener at localhost.localdomain/41049] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230212e19cc88c147a45b09080bc729715d052_del to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b20230212e19cc88c147a45b09080bc729715d052_del 2023-02-12 03:55:59,792 INFO [Listener at localhost.localdomain/41049] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for bb26d6d9360b44689cec8f0e31089864 2023-02-12 03:55:59,792 DEBUG [Listener at localhost.localdomain/41049] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/bef88e13eab120ca8c7f6a50c6b022e5/.tmp/family2/bb26d6d9360b44689cec8f0e31089864 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/bef88e13eab120ca8c7f6a50c6b022e5/family2/bb26d6d9360b44689cec8f0e31089864 2023-02-12 03:55:59,795 INFO [Listener at localhost.localdomain/41049] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for bb26d6d9360b44689cec8f0e31089864 2023-02-12 03:55:59,796 INFO [Listener at localhost.localdomain/41049] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in bef88e13eab120ca8c7f6a50c6b022e5/family2 of bef88e13eab120ca8c7f6a50c6b022e5 into bb26d6d9360b44689cec8f0e31089864(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-12 03:55:59,796 DEBUG [Listener at localhost.localdomain/41049] regionserver.HRegion(2288): Compaction status journal for bef88e13eab120ca8c7f6a50c6b022e5: 2023-02-12 03:55:59,796 DEBUG [Listener at localhost.localdomain/41049] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-12 03:55:59,796 DEBUG [Listener at localhost.localdomain/41049] regionserver.HStore(1912): d65656cfa2fa6fbc9b16f832db0fdeca/family1 is initiating major compaction (all files) 2023-02-12 03:55:59,796 INFO [Listener at localhost.localdomain/41049] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-12 03:55:59,796 INFO [Listener at localhost.localdomain/41049] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 03:55:59,798 INFO [Listener at localhost.localdomain/41049] regionserver.HRegion(2258): Starting compaction of d65656cfa2fa6fbc9b16f832db0fdeca/family1 in testMajorCompactionFromAdmin,2,1676174146717.d65656cfa2fa6fbc9b16f832db0fdeca. 2023-02-12 03:55:59,798 INFO [Listener at localhost.localdomain/41049] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/d65656cfa2fa6fbc9b16f832db0fdeca/family1/c3ecb33ecded4aa69214d8f3c9aeddd2, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/d65656cfa2fa6fbc9b16f832db0fdeca/family1/6eba0cc796b9456eaa34f8a103fa9412, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/d65656cfa2fa6fbc9b16f832db0fdeca/family1/220c9a327a4141fba76ba2ae775222f9, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/d65656cfa2fa6fbc9b16f832db0fdeca/family1/cb28ef59377c4e8c8d8c865bdc8ffc13, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/d65656cfa2fa6fbc9b16f832db0fdeca/family1/cebccbdc74bf464fac8c12b96b469b7d] into tmpdir=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/d65656cfa2fa6fbc9b16f832db0fdeca/.tmp, totalSize=27.1 K 2023-02-12 03:55:59,798 DEBUG [Listener at localhost.localdomain/41049] compactions.Compactor(207): Compacting c3ecb33ecded4aa69214d8f3c9aeddd2, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676174148862 2023-02-12 03:55:59,799 DEBUG [Listener at localhost.localdomain/41049] compactions.Compactor(207): Compacting 6eba0cc796b9456eaa34f8a103fa9412, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676174150733 2023-02-12 03:55:59,799 DEBUG [Listener at localhost.localdomain/41049] compactions.Compactor(207): Compacting 220c9a327a4141fba76ba2ae775222f9, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676174152611 2023-02-12 03:55:59,799 DEBUG [Listener at localhost.localdomain/41049] compactions.Compactor(207): Compacting cb28ef59377c4e8c8d8c865bdc8ffc13, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676174154519 2023-02-12 03:55:59,800 DEBUG [Listener at localhost.localdomain/41049] compactions.Compactor(207): Compacting cebccbdc74bf464fac8c12b96b469b7d, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-12 03:55:59,807 INFO [Listener at localhost.localdomain/41049] throttle.PressureAwareThroughputController(145): d65656cfa2fa6fbc9b16f832db0fdeca#family1#compaction#200 average throughput is 0.86 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-12 03:55:59,855 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/bef88e13eab120ca8c7f6a50c6b022e5/family2/836cb18c68a3448091dd1fc263234b8c, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/bef88e13eab120ca8c7f6a50c6b022e5/family2/82bcc93243ec49bdb20a2d8105ddfe75, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/bef88e13eab120ca8c7f6a50c6b022e5/family2/a349179687da4dbf92ca72b1b2d644a6, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/bef88e13eab120ca8c7f6a50c6b022e5/family2/29320959da714e3c83573ff7ab77ace0, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/bef88e13eab120ca8c7f6a50c6b022e5/family2/07cb49fc12b04f5da9fd23c331ff3d9f] to archive 2023-02-12 03:55:59,856 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-12 03:55:59,857 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/bef88e13eab120ca8c7f6a50c6b022e5/family2/836cb18c68a3448091dd1fc263234b8c to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMajorCompactionFromAdmin/bef88e13eab120ca8c7f6a50c6b022e5/family2/836cb18c68a3448091dd1fc263234b8c 2023-02-12 03:55:59,858 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/bef88e13eab120ca8c7f6a50c6b022e5/family2/82bcc93243ec49bdb20a2d8105ddfe75 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMajorCompactionFromAdmin/bef88e13eab120ca8c7f6a50c6b022e5/family2/82bcc93243ec49bdb20a2d8105ddfe75 2023-02-12 03:55:59,859 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/bef88e13eab120ca8c7f6a50c6b022e5/family2/a349179687da4dbf92ca72b1b2d644a6 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMajorCompactionFromAdmin/bef88e13eab120ca8c7f6a50c6b022e5/family2/a349179687da4dbf92ca72b1b2d644a6 2023-02-12 03:55:59,860 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/bef88e13eab120ca8c7f6a50c6b022e5/family2/29320959da714e3c83573ff7ab77ace0 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMajorCompactionFromAdmin/bef88e13eab120ca8c7f6a50c6b022e5/family2/29320959da714e3c83573ff7ab77ace0 2023-02-12 03:55:59,861 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/bef88e13eab120ca8c7f6a50c6b022e5/family2/07cb49fc12b04f5da9fd23c331ff3d9f to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMajorCompactionFromAdmin/bef88e13eab120ca8c7f6a50c6b022e5/family2/07cb49fc12b04f5da9fd23c331ff3d9f 2023-02-12 03:56:00,247 INFO [Listener at localhost.localdomain/41049] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202302124727f56a8a5c46e5afd0d37eeb160979_del 2023-02-12 03:56:00,248 INFO [Listener at localhost.localdomain/41049] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302124727f56a8a5c46e5afd0d37eeb160979_del to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202302124727f56a8a5c46e5afd0d37eeb160979_del 2023-02-12 03:56:00,704 INFO [Listener at localhost.localdomain/41049] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1e3700bd46d343d4a658f35e7cc3d1dc 2023-02-12 03:56:00,705 DEBUG [Listener at localhost.localdomain/41049] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/d65656cfa2fa6fbc9b16f832db0fdeca/.tmp/family1/1e3700bd46d343d4a658f35e7cc3d1dc as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/d65656cfa2fa6fbc9b16f832db0fdeca/family1/1e3700bd46d343d4a658f35e7cc3d1dc 2023-02-12 03:56:00,724 INFO [Listener at localhost.localdomain/41049] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1e3700bd46d343d4a658f35e7cc3d1dc 2023-02-12 03:56:00,724 INFO [Listener at localhost.localdomain/41049] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in d65656cfa2fa6fbc9b16f832db0fdeca/family1 of d65656cfa2fa6fbc9b16f832db0fdeca into 1e3700bd46d343d4a658f35e7cc3d1dc(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-12 03:56:00,724 DEBUG [Listener at localhost.localdomain/41049] regionserver.HRegion(2288): Compaction status journal for d65656cfa2fa6fbc9b16f832db0fdeca: 2023-02-12 03:56:00,725 DEBUG [Listener at localhost.localdomain/41049] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-12 03:56:00,725 DEBUG [Listener at localhost.localdomain/41049] regionserver.HStore(1912): d65656cfa2fa6fbc9b16f832db0fdeca/family2 is initiating major compaction (all files) 2023-02-12 03:56:00,725 INFO [Listener at localhost.localdomain/41049] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-12 03:56:00,725 INFO [Listener at localhost.localdomain/41049] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 03:56:00,725 INFO [Listener at localhost.localdomain/41049] regionserver.HRegion(2258): Starting compaction of d65656cfa2fa6fbc9b16f832db0fdeca/family2 in testMajorCompactionFromAdmin,2,1676174146717.d65656cfa2fa6fbc9b16f832db0fdeca. 2023-02-12 03:56:00,725 INFO [Listener at localhost.localdomain/41049] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/d65656cfa2fa6fbc9b16f832db0fdeca/family2/e3cb7a4a1ee042a9884e46df113504a8, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/d65656cfa2fa6fbc9b16f832db0fdeca/family2/ca65a68b2f054188b3e068fc99521f1e, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/d65656cfa2fa6fbc9b16f832db0fdeca/family2/96cb0ae04736499ea8bedbc0d950eae7, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/d65656cfa2fa6fbc9b16f832db0fdeca/family2/d06a41be24a74ea29e604b75bda53a94, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/d65656cfa2fa6fbc9b16f832db0fdeca/family2/42f9276d76a94794b1862dc0ac595c67] into tmpdir=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/d65656cfa2fa6fbc9b16f832db0fdeca/.tmp, totalSize=25.4 K 2023-02-12 03:56:00,725 DEBUG [Listener at localhost.localdomain/41049] compactions.Compactor(207): Compacting e3cb7a4a1ee042a9884e46df113504a8, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676174148862 2023-02-12 03:56:00,726 DEBUG [Listener at localhost.localdomain/41049] compactions.Compactor(207): Compacting ca65a68b2f054188b3e068fc99521f1e, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676174150733 2023-02-12 03:56:00,726 DEBUG [Listener at localhost.localdomain/41049] compactions.Compactor(207): Compacting 96cb0ae04736499ea8bedbc0d950eae7, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676174152611 2023-02-12 03:56:00,726 DEBUG [Listener at localhost.localdomain/41049] compactions.Compactor(207): Compacting d06a41be24a74ea29e604b75bda53a94, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676174154519 2023-02-12 03:56:00,726 DEBUG [Listener at localhost.localdomain/41049] compactions.Compactor(207): Compacting 42f9276d76a94794b1862dc0ac595c67, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-12 03:56:00,733 INFO [Listener at localhost.localdomain/41049] throttle.PressureAwareThroughputController(145): d65656cfa2fa6fbc9b16f832db0fdeca#family2#compaction#201 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-12 03:56:00,750 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/d65656cfa2fa6fbc9b16f832db0fdeca/family1/c3ecb33ecded4aa69214d8f3c9aeddd2, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/d65656cfa2fa6fbc9b16f832db0fdeca/family1/6eba0cc796b9456eaa34f8a103fa9412, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/d65656cfa2fa6fbc9b16f832db0fdeca/family1/220c9a327a4141fba76ba2ae775222f9, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/d65656cfa2fa6fbc9b16f832db0fdeca/family1/cb28ef59377c4e8c8d8c865bdc8ffc13, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/d65656cfa2fa6fbc9b16f832db0fdeca/family1/cebccbdc74bf464fac8c12b96b469b7d] to archive 2023-02-12 03:56:00,751 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-12 03:56:00,752 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/d65656cfa2fa6fbc9b16f832db0fdeca/family1/c3ecb33ecded4aa69214d8f3c9aeddd2 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMajorCompactionFromAdmin/d65656cfa2fa6fbc9b16f832db0fdeca/family1/c3ecb33ecded4aa69214d8f3c9aeddd2 2023-02-12 03:56:00,753 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/d65656cfa2fa6fbc9b16f832db0fdeca/family1/6eba0cc796b9456eaa34f8a103fa9412 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMajorCompactionFromAdmin/d65656cfa2fa6fbc9b16f832db0fdeca/family1/6eba0cc796b9456eaa34f8a103fa9412 2023-02-12 03:56:00,755 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/d65656cfa2fa6fbc9b16f832db0fdeca/family1/220c9a327a4141fba76ba2ae775222f9 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMajorCompactionFromAdmin/d65656cfa2fa6fbc9b16f832db0fdeca/family1/220c9a327a4141fba76ba2ae775222f9 2023-02-12 03:56:00,756 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/d65656cfa2fa6fbc9b16f832db0fdeca/family1/cb28ef59377c4e8c8d8c865bdc8ffc13 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMajorCompactionFromAdmin/d65656cfa2fa6fbc9b16f832db0fdeca/family1/cb28ef59377c4e8c8d8c865bdc8ffc13 2023-02-12 03:56:00,757 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/d65656cfa2fa6fbc9b16f832db0fdeca/family1/cebccbdc74bf464fac8c12b96b469b7d to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMajorCompactionFromAdmin/d65656cfa2fa6fbc9b16f832db0fdeca/family1/cebccbdc74bf464fac8c12b96b469b7d 2023-02-12 03:56:01,149 INFO [Listener at localhost.localdomain/41049] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202302126e06cd51cd014eaca6bb62fb24b732ba_del 2023-02-12 03:56:01,150 INFO [Listener at localhost.localdomain/41049] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302126e06cd51cd014eaca6bb62fb24b732ba_del to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c202302126e06cd51cd014eaca6bb62fb24b732ba_del 2023-02-12 03:56:01,576 INFO [Listener at localhost.localdomain/41049] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b92ade8a0f1e428ab0ea80687f7ab39f 2023-02-12 03:56:01,577 DEBUG [Listener at localhost.localdomain/41049] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/d65656cfa2fa6fbc9b16f832db0fdeca/.tmp/family2/b92ade8a0f1e428ab0ea80687f7ab39f as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/d65656cfa2fa6fbc9b16f832db0fdeca/family2/b92ade8a0f1e428ab0ea80687f7ab39f 2023-02-12 03:56:01,583 INFO [Listener at localhost.localdomain/41049] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b92ade8a0f1e428ab0ea80687f7ab39f 2023-02-12 03:56:01,584 INFO [Listener at localhost.localdomain/41049] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in d65656cfa2fa6fbc9b16f832db0fdeca/family2 of d65656cfa2fa6fbc9b16f832db0fdeca into b92ade8a0f1e428ab0ea80687f7ab39f(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-12 03:56:01,584 DEBUG [Listener at localhost.localdomain/41049] regionserver.HRegion(2288): Compaction status journal for d65656cfa2fa6fbc9b16f832db0fdeca: 2023-02-12 03:56:01,584 DEBUG [Listener at localhost.localdomain/41049] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-12 03:56:01,584 DEBUG [Listener at localhost.localdomain/41049] regionserver.HStore(1912): 61a9ec6d1e76a983beaae795490c1da9/family1 is initiating major compaction (all files) 2023-02-12 03:56:01,585 INFO [Listener at localhost.localdomain/41049] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-12 03:56:01,585 INFO [Listener at localhost.localdomain/41049] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 03:56:01,585 INFO [Listener at localhost.localdomain/41049] regionserver.HRegion(2258): Starting compaction of 61a9ec6d1e76a983beaae795490c1da9/family1 in testMajorCompactionFromAdmin,,1676174146717.61a9ec6d1e76a983beaae795490c1da9. 2023-02-12 03:56:01,585 INFO [Listener at localhost.localdomain/41049] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/61a9ec6d1e76a983beaae795490c1da9/family1/930f7462638846e0b75da8f3019960ae, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/61a9ec6d1e76a983beaae795490c1da9/family1/d101d35015c84f7594cfd76bf76a61f7, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/61a9ec6d1e76a983beaae795490c1da9/family1/2e77cec417a14088bd74f4d5a3168e0a, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/61a9ec6d1e76a983beaae795490c1da9/family1/d8a5b152f75542c3a527847358520760, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/61a9ec6d1e76a983beaae795490c1da9/family1/4bff2d9098b94e2fb23a1448ccf197ff] into tmpdir=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/61a9ec6d1e76a983beaae795490c1da9/.tmp, totalSize=27.1 K 2023-02-12 03:56:01,586 DEBUG [Listener at localhost.localdomain/41049] compactions.Compactor(207): Compacting 930f7462638846e0b75da8f3019960ae, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676174148861 2023-02-12 03:56:01,586 DEBUG [Listener at localhost.localdomain/41049] compactions.Compactor(207): Compacting d101d35015c84f7594cfd76bf76a61f7, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676174150732 2023-02-12 03:56:01,586 DEBUG [Listener at localhost.localdomain/41049] compactions.Compactor(207): Compacting 2e77cec417a14088bd74f4d5a3168e0a, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676174152611 2023-02-12 03:56:01,587 DEBUG [Listener at localhost.localdomain/41049] compactions.Compactor(207): Compacting d8a5b152f75542c3a527847358520760, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676174154519 2023-02-12 03:56:01,587 DEBUG [Listener at localhost.localdomain/41049] compactions.Compactor(207): Compacting 4bff2d9098b94e2fb23a1448ccf197ff, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-12 03:56:01,596 INFO [Listener at localhost.localdomain/41049] throttle.PressureAwareThroughputController(145): 61a9ec6d1e76a983beaae795490c1da9#family1#compaction#202 average throughput is 0.86 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-12 03:56:01,651 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/d65656cfa2fa6fbc9b16f832db0fdeca/family2/e3cb7a4a1ee042a9884e46df113504a8, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/d65656cfa2fa6fbc9b16f832db0fdeca/family2/ca65a68b2f054188b3e068fc99521f1e, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/d65656cfa2fa6fbc9b16f832db0fdeca/family2/96cb0ae04736499ea8bedbc0d950eae7, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/d65656cfa2fa6fbc9b16f832db0fdeca/family2/d06a41be24a74ea29e604b75bda53a94, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/d65656cfa2fa6fbc9b16f832db0fdeca/family2/42f9276d76a94794b1862dc0ac595c67] to archive 2023-02-12 03:56:01,652 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-12 03:56:01,655 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/d65656cfa2fa6fbc9b16f832db0fdeca/family2/e3cb7a4a1ee042a9884e46df113504a8 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMajorCompactionFromAdmin/d65656cfa2fa6fbc9b16f832db0fdeca/family2/e3cb7a4a1ee042a9884e46df113504a8 2023-02-12 03:56:01,657 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/d65656cfa2fa6fbc9b16f832db0fdeca/family2/ca65a68b2f054188b3e068fc99521f1e to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMajorCompactionFromAdmin/d65656cfa2fa6fbc9b16f832db0fdeca/family2/ca65a68b2f054188b3e068fc99521f1e 2023-02-12 03:56:01,659 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/d65656cfa2fa6fbc9b16f832db0fdeca/family2/96cb0ae04736499ea8bedbc0d950eae7 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMajorCompactionFromAdmin/d65656cfa2fa6fbc9b16f832db0fdeca/family2/96cb0ae04736499ea8bedbc0d950eae7 2023-02-12 03:56:01,661 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/d65656cfa2fa6fbc9b16f832db0fdeca/family2/d06a41be24a74ea29e604b75bda53a94 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMajorCompactionFromAdmin/d65656cfa2fa6fbc9b16f832db0fdeca/family2/d06a41be24a74ea29e604b75bda53a94 2023-02-12 03:56:01,663 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/d65656cfa2fa6fbc9b16f832db0fdeca/family2/42f9276d76a94794b1862dc0ac595c67 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMajorCompactionFromAdmin/d65656cfa2fa6fbc9b16f832db0fdeca/family2/42f9276d76a94794b1862dc0ac595c67 2023-02-12 03:56:02,038 INFO [Listener at localhost.localdomain/41049] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20230212c0dd009603d44871994b95b08092c895_del 2023-02-12 03:56:02,039 INFO [Listener at localhost.localdomain/41049] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230212c0dd009603d44871994b95b08092c895_del to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230212c0dd009603d44871994b95b08092c895_del 2023-02-12 03:56:02,885 INFO [Listener at localhost.localdomain/41049] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4a17d5e00be64532b4f723778a9fa38d 2023-02-12 03:56:02,885 DEBUG [Listener at localhost.localdomain/41049] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/61a9ec6d1e76a983beaae795490c1da9/.tmp/family1/4a17d5e00be64532b4f723778a9fa38d as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/61a9ec6d1e76a983beaae795490c1da9/family1/4a17d5e00be64532b4f723778a9fa38d 2023-02-12 03:56:02,906 INFO [Listener at localhost.localdomain/41049] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4a17d5e00be64532b4f723778a9fa38d 2023-02-12 03:56:02,907 INFO [Listener at localhost.localdomain/41049] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 61a9ec6d1e76a983beaae795490c1da9/family1 of 61a9ec6d1e76a983beaae795490c1da9 into 4a17d5e00be64532b4f723778a9fa38d(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-12 03:56:02,907 DEBUG [Listener at localhost.localdomain/41049] regionserver.HRegion(2288): Compaction status journal for 61a9ec6d1e76a983beaae795490c1da9: 2023-02-12 03:56:02,907 DEBUG [Listener at localhost.localdomain/41049] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-12 03:56:02,907 DEBUG [Listener at localhost.localdomain/41049] regionserver.HStore(1912): 61a9ec6d1e76a983beaae795490c1da9/family2 is initiating major compaction (all files) 2023-02-12 03:56:02,907 INFO [Listener at localhost.localdomain/41049] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-12 03:56:02,907 INFO [Listener at localhost.localdomain/41049] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-12 03:56:02,907 INFO [Listener at localhost.localdomain/41049] regionserver.HRegion(2258): Starting compaction of 61a9ec6d1e76a983beaae795490c1da9/family2 in testMajorCompactionFromAdmin,,1676174146717.61a9ec6d1e76a983beaae795490c1da9. 2023-02-12 03:56:02,907 INFO [Listener at localhost.localdomain/41049] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/61a9ec6d1e76a983beaae795490c1da9/family2/3f6593b95047473ea37b988ad52a24d1, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/61a9ec6d1e76a983beaae795490c1da9/family2/c51d563437ad45ab82d7883484853e2f, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/61a9ec6d1e76a983beaae795490c1da9/family2/bcbd1c3aa6474dd5bafbf1053ae3168e, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/61a9ec6d1e76a983beaae795490c1da9/family2/74b79c578ef64bea933b58a2584b0303, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/61a9ec6d1e76a983beaae795490c1da9/family2/74518e276fe04d069d5f08331d387c51] into tmpdir=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/61a9ec6d1e76a983beaae795490c1da9/.tmp, totalSize=25.4 K 2023-02-12 03:56:02,908 DEBUG [Listener at localhost.localdomain/41049] compactions.Compactor(207): Compacting 3f6593b95047473ea37b988ad52a24d1, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1676174148861 2023-02-12 03:56:02,908 DEBUG [Listener at localhost.localdomain/41049] compactions.Compactor(207): Compacting c51d563437ad45ab82d7883484853e2f, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1676174150732 2023-02-12 03:56:02,909 DEBUG [Listener at localhost.localdomain/41049] compactions.Compactor(207): Compacting bcbd1c3aa6474dd5bafbf1053ae3168e, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1676174152611 2023-02-12 03:56:02,909 DEBUG [Listener at localhost.localdomain/41049] compactions.Compactor(207): Compacting 74b79c578ef64bea933b58a2584b0303, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1676174154519 2023-02-12 03:56:02,909 DEBUG [Listener at localhost.localdomain/41049] compactions.Compactor(207): Compacting 74518e276fe04d069d5f08331d387c51, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-12 03:56:02,917 INFO [Listener at localhost.localdomain/41049] throttle.PressureAwareThroughputController(145): 61a9ec6d1e76a983beaae795490c1da9#family2#compaction#203 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-12 03:56:02,951 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/61a9ec6d1e76a983beaae795490c1da9/family1/930f7462638846e0b75da8f3019960ae, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/61a9ec6d1e76a983beaae795490c1da9/family1/d101d35015c84f7594cfd76bf76a61f7, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/61a9ec6d1e76a983beaae795490c1da9/family1/2e77cec417a14088bd74f4d5a3168e0a, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/61a9ec6d1e76a983beaae795490c1da9/family1/d8a5b152f75542c3a527847358520760, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/61a9ec6d1e76a983beaae795490c1da9/family1/4bff2d9098b94e2fb23a1448ccf197ff] to archive 2023-02-12 03:56:02,952 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-12 03:56:02,953 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/61a9ec6d1e76a983beaae795490c1da9/family1/930f7462638846e0b75da8f3019960ae to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMajorCompactionFromAdmin/61a9ec6d1e76a983beaae795490c1da9/family1/930f7462638846e0b75da8f3019960ae 2023-02-12 03:56:02,955 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/61a9ec6d1e76a983beaae795490c1da9/family1/d101d35015c84f7594cfd76bf76a61f7 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMajorCompactionFromAdmin/61a9ec6d1e76a983beaae795490c1da9/family1/d101d35015c84f7594cfd76bf76a61f7 2023-02-12 03:56:02,956 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/61a9ec6d1e76a983beaae795490c1da9/family1/2e77cec417a14088bd74f4d5a3168e0a to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMajorCompactionFromAdmin/61a9ec6d1e76a983beaae795490c1da9/family1/2e77cec417a14088bd74f4d5a3168e0a 2023-02-12 03:56:02,957 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/61a9ec6d1e76a983beaae795490c1da9/family1/d8a5b152f75542c3a527847358520760 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMajorCompactionFromAdmin/61a9ec6d1e76a983beaae795490c1da9/family1/d8a5b152f75542c3a527847358520760 2023-02-12 03:56:02,957 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/61a9ec6d1e76a983beaae795490c1da9/family1/4bff2d9098b94e2fb23a1448ccf197ff to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMajorCompactionFromAdmin/61a9ec6d1e76a983beaae795490c1da9/family1/4bff2d9098b94e2fb23a1448ccf197ff 2023-02-12 03:56:03,325 INFO [Listener at localhost.localdomain/41049] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e2023021236131145234d41e9b78ec21516cd22be_del 2023-02-12 03:56:03,325 INFO [Listener at localhost.localdomain/41049] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023021236131145234d41e9b78ec21516cd22be_del to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e2023021236131145234d41e9b78ec21516cd22be_del 2023-02-12 03:56:03,741 DEBUG [regionserver/jenkins-hbase20:0.Chore.1] throttle.PressureAwareCompactionThroughputController(103): CompactionPressure is 0.15384615384615385, tune throughput to 57.69 MB/second 2023-02-12 03:56:04,145 INFO [Listener at localhost.localdomain/41049] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 97c1de5941d3477da1745d0b8374c9a8 2023-02-12 03:56:04,147 DEBUG [Listener at localhost.localdomain/41049] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/61a9ec6d1e76a983beaae795490c1da9/.tmp/family2/97c1de5941d3477da1745d0b8374c9a8 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/61a9ec6d1e76a983beaae795490c1da9/family2/97c1de5941d3477da1745d0b8374c9a8 2023-02-12 03:56:04,152 INFO [Listener at localhost.localdomain/41049] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 97c1de5941d3477da1745d0b8374c9a8 2023-02-12 03:56:04,153 INFO [Listener at localhost.localdomain/41049] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 61a9ec6d1e76a983beaae795490c1da9/family2 of 61a9ec6d1e76a983beaae795490c1da9 into 97c1de5941d3477da1745d0b8374c9a8(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-12 03:56:04,153 DEBUG [Listener at localhost.localdomain/41049] regionserver.HRegion(2288): Compaction status journal for 61a9ec6d1e76a983beaae795490c1da9: 2023-02-12 03:56:04,157 DEBUG [Listener at localhost.localdomain/41049] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-12 03:56:04,160 DEBUG [Listener at localhost.localdomain/41049] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-12 03:56:04,160 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/61a9ec6d1e76a983beaae795490c1da9/family2/3f6593b95047473ea37b988ad52a24d1, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/61a9ec6d1e76a983beaae795490c1da9/family2/c51d563437ad45ab82d7883484853e2f, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/61a9ec6d1e76a983beaae795490c1da9/family2/bcbd1c3aa6474dd5bafbf1053ae3168e, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/61a9ec6d1e76a983beaae795490c1da9/family2/74b79c578ef64bea933b58a2584b0303, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/61a9ec6d1e76a983beaae795490c1da9/family2/74518e276fe04d069d5f08331d387c51] to archive 2023-02-12 03:56:04,161 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-12 03:56:04,163 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/61a9ec6d1e76a983beaae795490c1da9/family2/3f6593b95047473ea37b988ad52a24d1 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMajorCompactionFromAdmin/61a9ec6d1e76a983beaae795490c1da9/family2/3f6593b95047473ea37b988ad52a24d1 2023-02-12 03:56:04,164 DEBUG [Listener at localhost.localdomain/41049] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-12 03:56:04,164 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/61a9ec6d1e76a983beaae795490c1da9/family2/c51d563437ad45ab82d7883484853e2f to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMajorCompactionFromAdmin/61a9ec6d1e76a983beaae795490c1da9/family2/c51d563437ad45ab82d7883484853e2f 2023-02-12 03:56:04,165 DEBUG [Listener at localhost.localdomain/41049] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-12 03:56:04,166 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/61a9ec6d1e76a983beaae795490c1da9/family2/bcbd1c3aa6474dd5bafbf1053ae3168e to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMajorCompactionFromAdmin/61a9ec6d1e76a983beaae795490c1da9/family2/bcbd1c3aa6474dd5bafbf1053ae3168e 2023-02-12 03:56:04,167 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/61a9ec6d1e76a983beaae795490c1da9/family2/74b79c578ef64bea933b58a2584b0303 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMajorCompactionFromAdmin/61a9ec6d1e76a983beaae795490c1da9/family2/74b79c578ef64bea933b58a2584b0303 2023-02-12 03:56:04,168 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/61a9ec6d1e76a983beaae795490c1da9/family2/74518e276fe04d069d5f08331d387c51 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMajorCompactionFromAdmin/61a9ec6d1e76a983beaae795490c1da9/family2/74518e276fe04d069d5f08331d387c51 2023-02-12 03:56:04,170 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=40099] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\xA8\xA6\x19l"\x88[s\xA3\xFA7\xA1YIH\xBC"\x10\x09\xC8\xD6\xABH\xDA\xA1\xA4\x1B\xF7m\x82\xB6\xF3\x87\x15*\x10z.\x03\xCA\x95\x81\x023\x13\xB5h\xDD\xD6\xFF\xB8\x9F2\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testMajorCompactionFromAdmin 2023-02-12 03:56:04,187 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676173985818] procedure2.ProcedureExecutor(1029): Stored pid=123, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-02-12 03:56:04,188 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=123, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-02-12 03:56:04,188 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=123, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1676174764188 2023-02-12 03:56:04,188 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676173985818] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionFromAdmin', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-12 03:56:04,189 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676173985818] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-12 03:56:04,512 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676173985818] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 3 del files, 12 selected files, and 0 irrelevant files table 'testMajorCompactionFromAdmin' and column 'family1' 2023-02-12 03:56:04,530 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676173985818] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20230212c0dd009603d44871994b95b08092c895_del 2023-02-12 03:56:04,548 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676173985818] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b2023021299f90f9d9fd445609f5e41a163f675bf_del 2023-02-12 03:56:04,576 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676173985818] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202302124727f56a8a5c46e5afd0d37eeb160979_del 2023-02-12 03:56:04,577 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676173985818] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='testMajorCompactionFromAdmin' column='family1' 2023-02-12 03:56:04,577 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676173985818] zookeeper.ReadOnlyZKClient(139): Connect 0x7e0c2074 to 127.0.0.1:59556 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-12 03:56:04,580 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676173985818] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@263ce051, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-12 03:56:04,581 INFO [MobCompactor-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20230212 for table='testMajorCompactionFromAdmin' and column='family1' 2023-02-12 03:56:04,719 DEBUG [regionserver/jenkins-hbase20:0.Chore.1] throttle.PressureAwareCompactionThroughputController(103): CompactionPressure is 0.0, tune throughput to 50.00 MB/second 2023-02-12 03:56:05,132 INFO [MobCompactor-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230212af646b3c8cdb497f922722a3e4bb0f0b to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230212af646b3c8cdb497f922722a3e4bb0f0b 2023-02-12 03:56:05,133 INFO [MobCompactor-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230212 table='testMajorCompactionFromAdmin' column='family1' 2023-02-12 03:56:05,149 DEBUG [MobCompactor-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-12 03:56:05,152 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:60802, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-12 03:56:05,164 DEBUG [MobCompactor-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-12 03:56:05,166 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:43572, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-12 03:56:05,208 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20230212/family1/76aac67949da4de49841d121e4fdd6f0 first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x07] 2023-02-12 03:56:05,210 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionFromAdmin,1,1676174146717.bef88e13eab120ca8c7f6a50c6b022e5., hostname=jenkins-hbase20.apache.org,39639,1676173982450, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20230212/family1/76aac67949da4de49841d121e4fdd6f0}] 2023-02-12 03:56:05,216 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39639] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20230212/family1/76aac67949da4de49841d121e4fdd6f0 for inclusion in bef88e13eab120ca8c7f6a50c6b022e5/family1 2023-02-12 03:56:05,247 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39639] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x07 2023-02-12 03:56:05,247 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39639] regionserver.HStore(777): Region bounds: first=1 last=2 2023-02-12 03:56:05,247 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39639] regionserver.HRegion(2445): Flush status journal for bef88e13eab120ca8c7f6a50c6b022e5: 2023-02-12 03:56:05,248 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39639] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20230212/family1/76aac67949da4de49841d121e4fdd6f0 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/staging/jenkins__testMajorCompactionFromAdmin__1rjund5p5a0f11msih3qc3c2n9hv8apsu2amos8envousdfuufe1m2b1p1lbsvth/family1/76aac67949da4de49841d121e4fdd6f0 2023-02-12 03:56:05,250 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39639] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/staging/jenkins__testMajorCompactionFromAdmin__1rjund5p5a0f11msih3qc3c2n9hv8apsu2amos8envousdfuufe1m2b1p1lbsvth/family1/76aac67949da4de49841d121e4fdd6f0 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/bef88e13eab120ca8c7f6a50c6b022e5/family1/a84db8b6bbf7481e8b1caa7ef2784561_SeqId_28_ 2023-02-12 03:56:05,251 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39639] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/staging/jenkins__testMajorCompactionFromAdmin__1rjund5p5a0f11msih3qc3c2n9hv8apsu2amos8envousdfuufe1m2b1p1lbsvth/family1/76aac67949da4de49841d121e4fdd6f0 into bef88e13eab120ca8c7f6a50c6b022e5/family1 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/bef88e13eab120ca8c7f6a50c6b022e5/family1/a84db8b6bbf7481e8b1caa7ef2784561_SeqId_28_ - updating store file list. 2023-02-12 03:56:05,276 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39639] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/bef88e13eab120ca8c7f6a50c6b022e5/family1/a84db8b6bbf7481e8b1caa7ef2784561_SeqId_28_ into bef88e13eab120ca8c7f6a50c6b022e5/family1 2023-02-12 03:56:05,276 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39639] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/staging/jenkins__testMajorCompactionFromAdmin__1rjund5p5a0f11msih3qc3c2n9hv8apsu2amos8envousdfuufe1m2b1p1lbsvth/family1/76aac67949da4de49841d121e4fdd6f0 into bef88e13eab120ca8c7f6a50c6b022e5/family1 (new location: hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/bef88e13eab120ca8c7f6a50c6b022e5/family1/a84db8b6bbf7481e8b1caa7ef2784561_SeqId_28_) 2023-02-12 03:56:05,277 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39639] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/staging/jenkins__testMajorCompactionFromAdmin__1rjund5p5a0f11msih3qc3c2n9hv8apsu2amos8envousdfuufe1m2b1p1lbsvth/family1/76aac67949da4de49841d121e4fdd6f0 2023-02-12 03:56:05,278 INFO [MobCompactor-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230212 table='testMajorCompactionFromAdmin' column='family1' 2023-02-12 03:56:05,279 DEBUG [MobCompactor-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-02-12 03:56:05,280 DEBUG [MobCompactor-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202302121040b025bc9a4ceda90c0cdb365188fc to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202302121040b025bc9a4ceda90c0cdb365188fc 2023-02-12 03:56:05,282 DEBUG [MobCompactor-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230212108241a9e9834e4c9b079540439e7c96 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230212108241a9e9834e4c9b079540439e7c96 2023-02-12 03:56:05,283 DEBUG [MobCompactor-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202302124250f7f3bd274ab89e552cfd281438cf to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202302124250f7f3bd274ab89e552cfd281438cf 2023-02-12 03:56:05,284 DEBUG [MobCompactor-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230212f83d4e2b2bd945ad924e4e62da787dd1 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230212f83d4e2b2bd945ad924e4e62da787dd1 2023-02-12 03:56:05,284 INFO [MobCompactor-pool-1] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-02-12 03:56:05,284 DEBUG [MobCompactor-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20230212' 2023-02-12 03:56:05,285 INFO [MobCompactor-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20230212 for table='testMajorCompactionFromAdmin' and column='family1' 2023-02-12 03:56:05,285 INFO [MobCompactor-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20230212 for table='testMajorCompactionFromAdmin' and column='family1' 2023-02-12 03:56:05,870 INFO [MobCompactor-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302126ee847c0e1c64f639c7d3bca97ce74f6 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202302126ee847c0e1c64f639c7d3bca97ce74f6 2023-02-12 03:56:05,871 INFO [MobCompactor-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230212 table='testMajorCompactionFromAdmin' column='family1' 2023-02-12 03:56:05,930 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20230212/family1/08d2e6bef7cd42efa3cef5d55b63f76c first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x07] 2023-02-12 03:56:05,931 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionFromAdmin,2,1676174146717.d65656cfa2fa6fbc9b16f832db0fdeca., hostname=jenkins-hbase20.apache.org,39639,1676173982450, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20230212/family1/08d2e6bef7cd42efa3cef5d55b63f76c}] 2023-02-12 03:56:05,933 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39639] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20230212/family1/08d2e6bef7cd42efa3cef5d55b63f76c for inclusion in d65656cfa2fa6fbc9b16f832db0fdeca/family1 2023-02-12 03:56:05,954 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39639] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x07 2023-02-12 03:56:05,954 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39639] regionserver.HStore(777): Region bounds: first=2 last= 2023-02-12 03:56:05,954 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39639] regionserver.HRegion(2445): Flush status journal for d65656cfa2fa6fbc9b16f832db0fdeca: 2023-02-12 03:56:05,955 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39639] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20230212/family1/08d2e6bef7cd42efa3cef5d55b63f76c to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/staging/jenkins__testMajorCompactionFromAdmin__d348jplubad5836u76vqja5gef5ojltg1vn7qeqgr0sb6gselfqotc17cnist80j/family1/08d2e6bef7cd42efa3cef5d55b63f76c 2023-02-12 03:56:05,956 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39639] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/staging/jenkins__testMajorCompactionFromAdmin__d348jplubad5836u76vqja5gef5ojltg1vn7qeqgr0sb6gselfqotc17cnist80j/family1/08d2e6bef7cd42efa3cef5d55b63f76c as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/d65656cfa2fa6fbc9b16f832db0fdeca/family1/7938f16748ff4ee4935546cc8d135a9f_SeqId_28_ 2023-02-12 03:56:05,957 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39639] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/staging/jenkins__testMajorCompactionFromAdmin__d348jplubad5836u76vqja5gef5ojltg1vn7qeqgr0sb6gselfqotc17cnist80j/family1/08d2e6bef7cd42efa3cef5d55b63f76c into d65656cfa2fa6fbc9b16f832db0fdeca/family1 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/d65656cfa2fa6fbc9b16f832db0fdeca/family1/7938f16748ff4ee4935546cc8d135a9f_SeqId_28_ - updating store file list. 2023-02-12 03:56:05,984 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39639] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/d65656cfa2fa6fbc9b16f832db0fdeca/family1/7938f16748ff4ee4935546cc8d135a9f_SeqId_28_ into d65656cfa2fa6fbc9b16f832db0fdeca/family1 2023-02-12 03:56:05,984 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39639] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/staging/jenkins__testMajorCompactionFromAdmin__d348jplubad5836u76vqja5gef5ojltg1vn7qeqgr0sb6gselfqotc17cnist80j/family1/08d2e6bef7cd42efa3cef5d55b63f76c into d65656cfa2fa6fbc9b16f832db0fdeca/family1 (new location: hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/d65656cfa2fa6fbc9b16f832db0fdeca/family1/7938f16748ff4ee4935546cc8d135a9f_SeqId_28_) 2023-02-12 03:56:05,984 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39639] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/staging/jenkins__testMajorCompactionFromAdmin__d348jplubad5836u76vqja5gef5ojltg1vn7qeqgr0sb6gselfqotc17cnist80j/family1/08d2e6bef7cd42efa3cef5d55b63f76c 2023-02-12 03:56:05,986 INFO [MobCompactor-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230212 table='testMajorCompactionFromAdmin' column='family1' 2023-02-12 03:56:05,987 DEBUG [MobCompactor-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-02-12 03:56:05,988 DEBUG [MobCompactor-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230212032d407dd1a14b1fa069ab00ba221c70 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230212032d407dd1a14b1fa069ab00ba221c70 2023-02-12 03:56:05,990 DEBUG [MobCompactor-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202302124e93cb34390f42f89c6704142dca1671 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202302124e93cb34390f42f89c6704142dca1671 2023-02-12 03:56:05,991 DEBUG [MobCompactor-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202302127d087f41a656481cb5986a5d014c0789 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202302127d087f41a656481cb5986a5d014c0789 2023-02-12 03:56:05,992 DEBUG [MobCompactor-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230212b6304f7a0cc04f0d82c46e6d4ca568ee to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230212b6304f7a0cc04f0d82c46e6d4ca568ee 2023-02-12 03:56:05,992 INFO [MobCompactor-pool-1] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-02-12 03:56:05,992 DEBUG [MobCompactor-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20230212' 2023-02-12 03:56:05,993 INFO [MobCompactor-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20230212 for table='testMajorCompactionFromAdmin' and column='family1' 2023-02-12 03:56:05,993 INFO [MobCompactor-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20230212 for table='testMajorCompactionFromAdmin' and column='family1' 2023-02-12 03:56:06,545 INFO [MobCompactor-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202302126d4bda34993c490aaf6ee102870847c8 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202302126d4bda34993c490aaf6ee102870847c8 2023-02-12 03:56:06,545 INFO [MobCompactor-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230212 table='testMajorCompactionFromAdmin' column='family1' 2023-02-12 03:56:06,589 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20230212/family1/71573395ded040d6a8385337364d3c5d first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x07] 2023-02-12 03:56:06,590 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionFromAdmin,,1676174146717.61a9ec6d1e76a983beaae795490c1da9., hostname=jenkins-hbase20.apache.org,39639,1676173982450, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20230212/family1/71573395ded040d6a8385337364d3c5d}] 2023-02-12 03:56:06,591 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39639] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20230212/family1/71573395ded040d6a8385337364d3c5d for inclusion in 61a9ec6d1e76a983beaae795490c1da9/family1 2023-02-12 03:56:06,613 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39639] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x07 2023-02-12 03:56:06,613 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39639] regionserver.HStore(777): Region bounds: first= last=1 2023-02-12 03:56:06,613 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39639] regionserver.HRegion(2445): Flush status journal for 61a9ec6d1e76a983beaae795490c1da9: 2023-02-12 03:56:06,614 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39639] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20230212/family1/71573395ded040d6a8385337364d3c5d to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/staging/jenkins__testMajorCompactionFromAdmin__ccqfeh9oc4vidbtqeoufvn7itqun0uu2538lc2o727kbvsv95k2km3auvgnvtm2k/family1/71573395ded040d6a8385337364d3c5d 2023-02-12 03:56:06,616 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39639] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/staging/jenkins__testMajorCompactionFromAdmin__ccqfeh9oc4vidbtqeoufvn7itqun0uu2538lc2o727kbvsv95k2km3auvgnvtm2k/family1/71573395ded040d6a8385337364d3c5d as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/61a9ec6d1e76a983beaae795490c1da9/family1/c29bb03172eb499eaf901acfe1db8c48_SeqId_28_ 2023-02-12 03:56:06,617 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39639] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/staging/jenkins__testMajorCompactionFromAdmin__ccqfeh9oc4vidbtqeoufvn7itqun0uu2538lc2o727kbvsv95k2km3auvgnvtm2k/family1/71573395ded040d6a8385337364d3c5d into 61a9ec6d1e76a983beaae795490c1da9/family1 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/61a9ec6d1e76a983beaae795490c1da9/family1/c29bb03172eb499eaf901acfe1db8c48_SeqId_28_ - updating store file list. 2023-02-12 03:56:06,643 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39639] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/61a9ec6d1e76a983beaae795490c1da9/family1/c29bb03172eb499eaf901acfe1db8c48_SeqId_28_ into 61a9ec6d1e76a983beaae795490c1da9/family1 2023-02-12 03:56:06,643 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39639] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/staging/jenkins__testMajorCompactionFromAdmin__ccqfeh9oc4vidbtqeoufvn7itqun0uu2538lc2o727kbvsv95k2km3auvgnvtm2k/family1/71573395ded040d6a8385337364d3c5d into 61a9ec6d1e76a983beaae795490c1da9/family1 (new location: hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/61a9ec6d1e76a983beaae795490c1da9/family1/c29bb03172eb499eaf901acfe1db8c48_SeqId_28_) 2023-02-12 03:56:06,644 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39639] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/staging/jenkins__testMajorCompactionFromAdmin__ccqfeh9oc4vidbtqeoufvn7itqun0uu2538lc2o727kbvsv95k2km3auvgnvtm2k/family1/71573395ded040d6a8385337364d3c5d 2023-02-12 03:56:06,646 INFO [MobCompactor-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230212 table='testMajorCompactionFromAdmin' column='family1' 2023-02-12 03:56:06,646 DEBUG [MobCompactor-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-02-12 03:56:06,648 DEBUG [MobCompactor-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230212a1c82a286920405c86cff297009d7eb3 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230212a1c82a286920405c86cff297009d7eb3 2023-02-12 03:56:06,649 DEBUG [MobCompactor-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230212adabd7e55af24cfebfe53263ef99ad26 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230212adabd7e55af24cfebfe53263ef99ad26 2023-02-12 03:56:06,650 DEBUG [MobCompactor-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230212b0978ae04356465d9a08a237164ee40b to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230212b0978ae04356465d9a08a237164ee40b 2023-02-12 03:56:06,650 DEBUG [MobCompactor-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230212e006ee6aac854db986fbf465e2a5a254 to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230212e006ee6aac854db986fbf465e2a5a254 2023-02-12 03:56:06,651 INFO [MobCompactor-pool-1] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-02-12 03:56:06,651 DEBUG [MobCompactor-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20230212' 2023-02-12 03:56:06,651 INFO [MobCompactor-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20230212 for table='testMajorCompactionFromAdmin' and column='family1' 2023-02-12 03:56:06,651 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676173985818] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testMajorCompactionFromAdmin' column='family1' 2023-02-12 03:56:06,651 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676173985818] compactions.PartitionedMobCompactor(364): After a mob compaction with all files selected, archiving the del files for table='testMajorCompactionFromAdmin' and column='family1' 2023-02-12 03:56:06,651 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676173985818] compactions.PartitionedMobCompactor(367): [hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230212c0dd009603d44871994b95b08092c895_del] 2023-02-12 03:56:06,651 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676173985818] backup.HFileArchiver(360): Archiving compacted files. 2023-02-12 03:56:06,652 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676173985818] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230212c0dd009603d44871994b95b08092c895_del to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230212c0dd009603d44871994b95b08092c895_del 2023-02-12 03:56:06,652 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676173985818] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-02-12 03:56:06,653 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676173985818] compactions.PartitionedMobCompactor(367): [hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023021299f90f9d9fd445609f5e41a163f675bf_del] 2023-02-12 03:56:06,653 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676173985818] backup.HFileArchiver(360): Archiving compacted files. 2023-02-12 03:56:06,654 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676173985818] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023021299f90f9d9fd445609f5e41a163f675bf_del to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023021299f90f9d9fd445609f5e41a163f675bf_del 2023-02-12 03:56:06,654 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676173985818] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-02-12 03:56:06,654 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676173985818] compactions.PartitionedMobCompactor(367): [hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202302124727f56a8a5c46e5afd0d37eeb160979_del] 2023-02-12 03:56:06,654 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676173985818] backup.HFileArchiver(360): Archiving compacted files. 2023-02-12 03:56:06,655 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676173985818] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202302124727f56a8a5c46e5afd0d37eeb160979_del to hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202302124727f56a8a5c46e5afd0d37eeb160979_del 2023-02-12 03:56:06,655 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676173985818] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-02-12 03:56:06,655 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1676173985818] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionFromAdmin', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-12 03:56:06,656 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=123, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-02-12 03:56:06,657 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=123, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE in 2.4700 sec 2023-02-12 03:56:06,672 DEBUG [Listener at localhost.localdomain/41049] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-12 03:56:06,674 DEBUG [Listener at localhost.localdomain/41049] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-12 03:56:06,677 DEBUG [Listener at localhost.localdomain/41049] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-12 03:56:06,678 DEBUG [Listener at localhost.localdomain/41049] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-12 03:56:06,682 INFO [Listener at localhost.localdomain/41049] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-12 03:56:06,715 INFO [Listener at localhost.localdomain/41049] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionFromAdmin Thread=246 (was 252), OpenFileDescriptor=634 (was 644), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=113 (was 87) - SystemLoadAverage LEAK? -, ProcessCount=164 (was 164), AvailableMemoryMB=3561 (was 3877) 2023-02-12 03:56:06,716 DEBUG [Listener at localhost.localdomain/41049] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1f820396 to 127.0.0.1:59556 2023-02-12 03:56:06,716 DEBUG [Listener at localhost.localdomain/41049] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 03:56:06,716 INFO [Listener at localhost.localdomain/41049] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-12 03:56:06,716 INFO [Listener at localhost.localdomain/41049] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-12 03:56:06,716 DEBUG [Listener at localhost.localdomain/41049] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x11ea4006 to 127.0.0.1:59556 2023-02-12 03:56:06,716 DEBUG [Listener at localhost.localdomain/41049] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 03:56:06,717 DEBUG [Listener at localhost.localdomain/41049] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-12 03:56:06,717 DEBUG [Listener at localhost.localdomain/41049] util.JVMClusterUtil(257): Found active master hash=1346409528, stopped=false 2023-02-12 03:56:06,717 INFO [Listener at localhost.localdomain/41049] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase20.apache.org,40099,1676173981406 2023-02-12 03:56:06,718 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-12 03:56:06,718 INFO [Listener at localhost.localdomain/41049] procedure2.ProcedureExecutor(629): Stopping 2023-02-12 03:56:06,718 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-12 03:56:06,718 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 03:56:06,718 DEBUG [Listener at localhost.localdomain/41049] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x29686ab0 to 127.0.0.1:59556 2023-02-12 03:56:06,718 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 03:56:06,718 DEBUG [Listener at localhost.localdomain/41049] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 03:56:06,718 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-12 03:56:06,718 INFO [Listener at localhost.localdomain/41049] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase20.apache.org,39639,1676173982450' ***** 2023-02-12 03:56:06,718 INFO [Listener at localhost.localdomain/41049] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-12 03:56:06,718 INFO [RS:0;jenkins-hbase20:39639] regionserver.HeapMemoryManager(220): Stopping 2023-02-12 03:56:06,719 INFO [RS:0;jenkins-hbase20:39639] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-12 03:56:06,719 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-12 03:56:06,719 INFO [RS:0;jenkins-hbase20:39639] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-12 03:56:06,719 INFO [RS:0;jenkins-hbase20:39639] regionserver.HRegionServer(3304): Received CLOSE for bef88e13eab120ca8c7f6a50c6b022e5 2023-02-12 03:56:06,720 INFO [RS:0;jenkins-hbase20:39639] regionserver.HRegionServer(3304): Received CLOSE for 347ac77f0d77b4a83b4ec30d49737288 2023-02-12 03:56:06,720 INFO [RS:0;jenkins-hbase20:39639] regionserver.HRegionServer(3304): Received CLOSE for 7219c41156bc54a262cb892cb04282fe 2023-02-12 03:56:06,720 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing bef88e13eab120ca8c7f6a50c6b022e5, disabling compactions & flushes 2023-02-12 03:56:06,720 INFO [RS:0;jenkins-hbase20:39639] regionserver.HRegionServer(3304): Received CLOSE for 4c1781260cda984f8a55d33a072f186e 2023-02-12 03:56:06,720 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionFromAdmin,1,1676174146717.bef88e13eab120ca8c7f6a50c6b022e5. 2023-02-12 03:56:06,720 INFO [RS:0;jenkins-hbase20:39639] regionserver.HRegionServer(3304): Received CLOSE for 0e9d0e06e60b6abe7b05797a5112bb5e 2023-02-12 03:56:06,720 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionFromAdmin,1,1676174146717.bef88e13eab120ca8c7f6a50c6b022e5. 2023-02-12 03:56:06,720 INFO [RS:0;jenkins-hbase20:39639] regionserver.HRegionServer(3304): Received CLOSE for 38bfa684335ca214a06d15565b8cb87b 2023-02-12 03:56:06,720 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionFromAdmin,1,1676174146717.bef88e13eab120ca8c7f6a50c6b022e5. after waiting 0 ms 2023-02-12 03:56:06,720 INFO [RS:0;jenkins-hbase20:39639] regionserver.HRegionServer(3304): Received CLOSE for 5de519c4afe22c04111a6724c632530e 2023-02-12 03:56:06,720 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionFromAdmin,1,1676174146717.bef88e13eab120ca8c7f6a50c6b022e5. 2023-02-12 03:56:06,720 INFO [RS:0;jenkins-hbase20:39639] regionserver.HRegionServer(3304): Received CLOSE for 369851c5c3dd6d38afc3b2a16e1a3ffc 2023-02-12 03:56:06,720 INFO [RS:0;jenkins-hbase20:39639] regionserver.HRegionServer(3304): Received CLOSE for d65656cfa2fa6fbc9b16f832db0fdeca 2023-02-12 03:56:06,720 INFO [RS:0;jenkins-hbase20:39639] regionserver.HRegionServer(3304): Received CLOSE for 56c18fcb418f4ae343b8ef57374cdf69 2023-02-12 03:56:06,720 INFO [RS:0;jenkins-hbase20:39639] regionserver.HRegionServer(3304): Received CLOSE for 6868bac373e3128a323294fb5686f080 2023-02-12 03:56:06,720 INFO [RS:0;jenkins-hbase20:39639] regionserver.HRegionServer(3304): Received CLOSE for 4e8254a6d12aded099b366c106c6930d 2023-02-12 03:56:06,720 INFO [RS:0;jenkins-hbase20:39639] regionserver.HRegionServer(3304): Received CLOSE for 413323817eab6eca83ffbd861a4ef441 2023-02-12 03:56:06,720 INFO [RS:0;jenkins-hbase20:39639] regionserver.HRegionServer(3304): Received CLOSE for 11ce5e4ebf46f66d8a2278adef25cc7b 2023-02-12 03:56:06,720 INFO [RS:0;jenkins-hbase20:39639] regionserver.HRegionServer(3304): Received CLOSE for 008ac801462bd1c3f87556bf17bb0d46 2023-02-12 03:56:06,720 INFO [RS:0;jenkins-hbase20:39639] regionserver.HRegionServer(3304): Received CLOSE for d12646a520864c41bc260dbfbe486d5f 2023-02-12 03:56:06,720 INFO [RS:0;jenkins-hbase20:39639] regionserver.HRegionServer(3304): Received CLOSE for a73fcc0290683d7b4b64c0d6b697edf9 2023-02-12 03:56:06,720 INFO [RS:0;jenkins-hbase20:39639] regionserver.HRegionServer(3304): Received CLOSE for 61a9ec6d1e76a983beaae795490c1da9 2023-02-12 03:56:06,720 INFO [RS:0;jenkins-hbase20:39639] regionserver.HRegionServer(3304): Received CLOSE for 5a64d004db5bc34d6763997394073059 2023-02-12 03:56:06,720 INFO [RS:0;jenkins-hbase20:39639] regionserver.HRegionServer(3304): Received CLOSE for 7a34b5c93155c75d8e84f8d88f767143 2023-02-12 03:56:06,721 INFO [RS:0;jenkins-hbase20:39639] regionserver.HRegionServer(1145): stopping server jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:56:06,721 DEBUG [RS:0;jenkins-hbase20:39639] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6d79c67c to 127.0.0.1:59556 2023-02-12 03:56:06,721 DEBUG [RS:0;jenkins-hbase20:39639] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 03:56:06,721 INFO [RS:0;jenkins-hbase20:39639] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-12 03:56:06,721 INFO [RS:0;jenkins-hbase20:39639] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-12 03:56:06,721 INFO [RS:0;jenkins-hbase20:39639] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-12 03:56:06,721 INFO [RS:0;jenkins-hbase20:39639] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-12 03:56:06,722 INFO [RS:0;jenkins-hbase20:39639] regionserver.HRegionServer(1475): Waiting on 21 regions to close 2023-02-12 03:56:06,722 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-12 03:56:06,722 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-12 03:56:06,722 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-12 03:56:06,722 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-12 03:56:06,722 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-12 03:56:06,722 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=50.62 KB heapSize=78.23 KB 2023-02-12 03:56:06,722 DEBUG [RS:0;jenkins-hbase20:39639] regionserver.HRegionServer(1505): Waiting on 008ac801462bd1c3f87556bf17bb0d46, 0e9d0e06e60b6abe7b05797a5112bb5e, 11ce5e4ebf46f66d8a2278adef25cc7b, 1588230740, 347ac77f0d77b4a83b4ec30d49737288, 369851c5c3dd6d38afc3b2a16e1a3ffc, 38bfa684335ca214a06d15565b8cb87b, 413323817eab6eca83ffbd861a4ef441, 4c1781260cda984f8a55d33a072f186e, 4e8254a6d12aded099b366c106c6930d, 56c18fcb418f4ae343b8ef57374cdf69, 5a64d004db5bc34d6763997394073059, 5de519c4afe22c04111a6724c632530e, 61a9ec6d1e76a983beaae795490c1da9, 6868bac373e3128a323294fb5686f080, 7219c41156bc54a262cb892cb04282fe, 7a34b5c93155c75d8e84f8d88f767143, a73fcc0290683d7b4b64c0d6b697edf9, bef88e13eab120ca8c7f6a50c6b022e5, d12646a520864c41bc260dbfbe486d5f, d65656cfa2fa6fbc9b16f832db0fdeca 2023-02-12 03:56:06,724 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/bef88e13eab120ca8c7f6a50c6b022e5/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-02-12 03:56:06,725 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testMajorCompactionFromAdmin,1,1676174146717.bef88e13eab120ca8c7f6a50c6b022e5. 2023-02-12 03:56:06,725 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for bef88e13eab120ca8c7f6a50c6b022e5: Waiting for close lock at 1676174166720Running coprocessor pre-close hooks at 1676174166720Disabling compacts and flushes for region at 1676174166720Disabling writes for close at 1676174166720Writing region close event to WAL at 1676174166721 (+1 ms)Running coprocessor post-close hooks at 1676174166724 (+3 ms)Closed at 1676174166725 (+1 ms) 2023-02-12 03:56:06,725 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,1,1676174146717.bef88e13eab120ca8c7f6a50c6b022e5. 2023-02-12 03:56:06,725 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 347ac77f0d77b4a83b4ec30d49737288, disabling compactions & flushes 2023-02-12 03:56:06,725 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1676173986005.347ac77f0d77b4a83b4ec30d49737288. 2023-02-12 03:56:06,725 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1676173986005.347ac77f0d77b4a83b4ec30d49737288. 2023-02-12 03:56:06,725 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1676173986005.347ac77f0d77b4a83b4ec30d49737288. after waiting 0 ms 2023-02-12 03:56:06,725 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1676173986005.347ac77f0d77b4a83b4ec30d49737288. 2023-02-12 03:56:06,729 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/347ac77f0d77b4a83b4ec30d49737288/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=49 2023-02-12 03:56:06,730 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1676173986005.347ac77f0d77b4a83b4ec30d49737288. 2023-02-12 03:56:06,731 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 347ac77f0d77b4a83b4ec30d49737288: Waiting for close lock at 1676174166725Running coprocessor pre-close hooks at 1676174166725Disabling compacts and flushes for region at 1676174166725Disabling writes for close at 1676174166725Writing region close event to WAL at 1676174166726 (+1 ms)Running coprocessor post-close hooks at 1676174166730 (+4 ms)Closed at 1676174166730 2023-02-12 03:56:06,731 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1676173986005.347ac77f0d77b4a83b4ec30d49737288. 2023-02-12 03:56:06,731 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 7219c41156bc54a262cb892cb04282fe, disabling compactions & flushes 2023-02-12 03:56:06,731 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithMonthlyPolicy,,1676173999793.7219c41156bc54a262cb892cb04282fe. 2023-02-12 03:56:06,731 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithMonthlyPolicy,,1676173999793.7219c41156bc54a262cb892cb04282fe. 2023-02-12 03:56:06,731 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithMonthlyPolicy,,1676173999793.7219c41156bc54a262cb892cb04282fe. after waiting 0 ms 2023-02-12 03:56:06,731 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithMonthlyPolicy,,1676173999793.7219c41156bc54a262cb892cb04282fe. 2023-02-12 03:56:06,735 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithMonthlyPolicy/7219c41156bc54a262cb892cb04282fe/recovered.edits/52.seqid, newMaxSeqId=52, maxSeqId=1 2023-02-12 03:56:06,736 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testMajorCompactionWithMonthlyPolicy,,1676173999793.7219c41156bc54a262cb892cb04282fe. 2023-02-12 03:56:06,736 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 7219c41156bc54a262cb892cb04282fe: Waiting for close lock at 1676174166731Running coprocessor pre-close hooks at 1676174166731Disabling compacts and flushes for region at 1676174166731Disabling writes for close at 1676174166731Writing region close event to WAL at 1676174166732 (+1 ms)Running coprocessor post-close hooks at 1676174166735 (+3 ms)Closed at 1676174166736 (+1 ms) 2023-02-12 03:56:06,736 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithMonthlyPolicy,,1676173999793.7219c41156bc54a262cb892cb04282fe. 2023-02-12 03:56:06,736 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 4c1781260cda984f8a55d33a072f186e, disabling compactions & flushes 2023-02-12 03:56:06,736 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testScannerOnBulkLoadRefHFiles,1,1676174025214.4c1781260cda984f8a55d33a072f186e. 2023-02-12 03:56:06,736 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,1,1676174025214.4c1781260cda984f8a55d33a072f186e. 2023-02-12 03:56:06,736 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testScannerOnBulkLoadRefHFiles,1,1676174025214.4c1781260cda984f8a55d33a072f186e. after waiting 0 ms 2023-02-12 03:56:06,736 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testScannerOnBulkLoadRefHFiles,1,1676174025214.4c1781260cda984f8a55d33a072f186e. 2023-02-12 03:56:06,740 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testScannerOnBulkLoadRefHFiles/4c1781260cda984f8a55d33a072f186e/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-12 03:56:06,741 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testScannerOnBulkLoadRefHFiles,1,1676174025214.4c1781260cda984f8a55d33a072f186e. 2023-02-12 03:56:06,741 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 4c1781260cda984f8a55d33a072f186e: Waiting for close lock at 1676174166736Running coprocessor pre-close hooks at 1676174166736Disabling compacts and flushes for region at 1676174166736Disabling writes for close at 1676174166736Writing region close event to WAL at 1676174166737 (+1 ms)Running coprocessor post-close hooks at 1676174166740 (+3 ms)Closed at 1676174166741 (+1 ms) 2023-02-12 03:56:06,741 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,1,1676174025214.4c1781260cda984f8a55d33a072f186e. 2023-02-12 03:56:06,741 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 0e9d0e06e60b6abe7b05797a5112bb5e, disabling compactions & flushes 2023-02-12 03:56:06,741 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testCompactionWithHFileLink,1,1676174084167.0e9d0e06e60b6abe7b05797a5112bb5e. 2023-02-12 03:56:06,741 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1676174084167.0e9d0e06e60b6abe7b05797a5112bb5e. 2023-02-12 03:56:06,741 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testCompactionWithHFileLink,1,1676174084167.0e9d0e06e60b6abe7b05797a5112bb5e. after waiting 0 ms 2023-02-12 03:56:06,741 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testCompactionWithHFileLink,1,1676174084167.0e9d0e06e60b6abe7b05797a5112bb5e. 2023-02-12 03:56:06,744 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/0e9d0e06e60b6abe7b05797a5112bb5e/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-02-12 03:56:06,746 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testCompactionWithHFileLink,1,1676174084167.0e9d0e06e60b6abe7b05797a5112bb5e. 2023-02-12 03:56:06,746 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 0e9d0e06e60b6abe7b05797a5112bb5e: Waiting for close lock at 1676174166741Running coprocessor pre-close hooks at 1676174166741Disabling compacts and flushes for region at 1676174166741Disabling writes for close at 1676174166741Writing region close event to WAL at 1676174166742 (+1 ms)Running coprocessor post-close hooks at 1676174166745 (+3 ms)Closed at 1676174166746 (+1 ms) 2023-02-12 03:56:06,746 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,1,1676174084167.0e9d0e06e60b6abe7b05797a5112bb5e. 2023-02-12 03:56:06,746 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 38bfa684335ca214a06d15565b8cb87b, disabling compactions & flushes 2023-02-12 03:56:06,746 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676174061396.38bfa684335ca214a06d15565b8cb87b. 2023-02-12 03:56:06,746 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676174061396.38bfa684335ca214a06d15565b8cb87b. 2023-02-12 03:56:06,746 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676174061396.38bfa684335ca214a06d15565b8cb87b. after waiting 0 ms 2023-02-12 03:56:06,746 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676174061396.38bfa684335ca214a06d15565b8cb87b. 2023-02-12 03:56:06,749 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/38bfa684335ca214a06d15565b8cb87b/recovered.edits/58.seqid, newMaxSeqId=58, maxSeqId=55 2023-02-12 03:56:06,750 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676174061396.38bfa684335ca214a06d15565b8cb87b. 2023-02-12 03:56:06,750 INFO [regionserver/jenkins-hbase20:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactedHFilesCleaner was stopped 2023-02-12 03:56:06,751 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 38bfa684335ca214a06d15565b8cb87b: Waiting for close lock at 1676174166746Running coprocessor pre-close hooks at 1676174166746Disabling compacts and flushes for region at 1676174166746Disabling writes for close at 1676174166746Writing region close event to WAL at 1676174166747 (+1 ms)Running coprocessor post-close hooks at 1676174166750 (+3 ms)Closed at 1676174166750 2023-02-12 03:56:06,751 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1676174061396.38bfa684335ca214a06d15565b8cb87b. 2023-02-12 03:56:06,751 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 5de519c4afe22c04111a6724c632530e, disabling compactions & flushes 2023-02-12 03:56:06,751 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region ns:testMinorCompaction,2,1676174113888.5de519c4afe22c04111a6724c632530e. 2023-02-12 03:56:06,751 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on ns:testMinorCompaction,2,1676174113888.5de519c4afe22c04111a6724c632530e. 2023-02-12 03:56:06,751 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on ns:testMinorCompaction,2,1676174113888.5de519c4afe22c04111a6724c632530e. after waiting 0 ms 2023-02-12 03:56:06,751 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region ns:testMinorCompaction,2,1676174113888.5de519c4afe22c04111a6724c632530e. 2023-02-12 03:56:06,755 INFO [regionserver/jenkins-hbase20:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-02-12 03:56:06,755 INFO [regionserver/jenkins-hbase20:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-02-12 03:56:06,758 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/5de519c4afe22c04111a6724c632530e/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-02-12 03:56:06,759 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed ns:testMinorCompaction,2,1676174113888.5de519c4afe22c04111a6724c632530e. 2023-02-12 03:56:06,759 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 5de519c4afe22c04111a6724c632530e: Waiting for close lock at 1676174166751Running coprocessor pre-close hooks at 1676174166751Disabling compacts and flushes for region at 1676174166751Disabling writes for close at 1676174166751Writing region close event to WAL at 1676174166754 (+3 ms)Running coprocessor post-close hooks at 1676174166758 (+4 ms)Closed at 1676174166759 (+1 ms) 2023-02-12 03:56:06,759 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,2,1676174113888.5de519c4afe22c04111a6724c632530e. 2023-02-12 03:56:06,759 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 369851c5c3dd6d38afc3b2a16e1a3ffc, disabling compactions & flushes 2023-02-12 03:56:06,759 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testCompactionWithHFileLink,2,1676174084167.369851c5c3dd6d38afc3b2a16e1a3ffc. 2023-02-12 03:56:06,759 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1676174084167.369851c5c3dd6d38afc3b2a16e1a3ffc. 2023-02-12 03:56:06,759 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testCompactionWithHFileLink,2,1676174084167.369851c5c3dd6d38afc3b2a16e1a3ffc. after waiting 0 ms 2023-02-12 03:56:06,760 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testCompactionWithHFileLink,2,1676174084167.369851c5c3dd6d38afc3b2a16e1a3ffc. 2023-02-12 03:56:06,763 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/369851c5c3dd6d38afc3b2a16e1a3ffc/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-02-12 03:56:06,764 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testCompactionWithHFileLink,2,1676174084167.369851c5c3dd6d38afc3b2a16e1a3ffc. 2023-02-12 03:56:06,764 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 369851c5c3dd6d38afc3b2a16e1a3ffc: Waiting for close lock at 1676174166759Running coprocessor pre-close hooks at 1676174166759Disabling compacts and flushes for region at 1676174166759Disabling writes for close at 1676174166759Writing region close event to WAL at 1676174166761 (+2 ms)Running coprocessor post-close hooks at 1676174166763 (+2 ms)Closed at 1676174166764 (+1 ms) 2023-02-12 03:56:06,764 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,2,1676174084167.369851c5c3dd6d38afc3b2a16e1a3ffc. 2023-02-12 03:56:06,764 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing d65656cfa2fa6fbc9b16f832db0fdeca, disabling compactions & flushes 2023-02-12 03:56:06,764 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionFromAdmin,2,1676174146717.d65656cfa2fa6fbc9b16f832db0fdeca. 2023-02-12 03:56:06,764 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionFromAdmin,2,1676174146717.d65656cfa2fa6fbc9b16f832db0fdeca. 2023-02-12 03:56:06,764 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionFromAdmin,2,1676174146717.d65656cfa2fa6fbc9b16f832db0fdeca. after waiting 0 ms 2023-02-12 03:56:06,764 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionFromAdmin,2,1676174146717.d65656cfa2fa6fbc9b16f832db0fdeca. 2023-02-12 03:56:06,764 INFO [regionserver/jenkins-hbase20:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-12 03:56:06,767 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/d65656cfa2fa6fbc9b16f832db0fdeca/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-02-12 03:56:06,768 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testMajorCompactionFromAdmin,2,1676174146717.d65656cfa2fa6fbc9b16f832db0fdeca. 2023-02-12 03:56:06,768 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for d65656cfa2fa6fbc9b16f832db0fdeca: Waiting for close lock at 1676174166764Running coprocessor pre-close hooks at 1676174166764Disabling compacts and flushes for region at 1676174166764Disabling writes for close at 1676174166764Writing region close event to WAL at 1676174166765 (+1 ms)Running coprocessor post-close hooks at 1676174166768 (+3 ms)Closed at 1676174166768 2023-02-12 03:56:06,768 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,2,1676174146717.d65656cfa2fa6fbc9b16f832db0fdeca. 2023-02-12 03:56:06,768 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 56c18fcb418f4ae343b8ef57374cdf69, disabling compactions & flushes 2023-02-12 03:56:06,768 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testMinorCompactionWithWeeklyPolicy,,1676174012788.56c18fcb418f4ae343b8ef57374cdf69. 2023-02-12 03:56:06,768 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMinorCompactionWithWeeklyPolicy,,1676174012788.56c18fcb418f4ae343b8ef57374cdf69. 2023-02-12 03:56:06,768 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testMinorCompactionWithWeeklyPolicy,,1676174012788.56c18fcb418f4ae343b8ef57374cdf69. after waiting 0 ms 2023-02-12 03:56:06,768 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testMinorCompactionWithWeeklyPolicy,,1676174012788.56c18fcb418f4ae343b8ef57374cdf69. 2023-02-12 03:56:06,771 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithWeeklyPolicy/56c18fcb418f4ae343b8ef57374cdf69/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-02-12 03:56:06,772 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testMinorCompactionWithWeeklyPolicy,,1676174012788.56c18fcb418f4ae343b8ef57374cdf69. 2023-02-12 03:56:06,772 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 56c18fcb418f4ae343b8ef57374cdf69: Waiting for close lock at 1676174166768Running coprocessor pre-close hooks at 1676174166768Disabling compacts and flushes for region at 1676174166768Disabling writes for close at 1676174166768Writing region close event to WAL at 1676174166769 (+1 ms)Running coprocessor post-close hooks at 1676174166772 (+3 ms)Closed at 1676174166772 2023-02-12 03:56:06,772 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testMinorCompactionWithWeeklyPolicy,,1676174012788.56c18fcb418f4ae343b8ef57374cdf69. 2023-02-12 03:56:06,772 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 6868bac373e3128a323294fb5686f080, disabling compactions & flushes 2023-02-12 03:56:06,773 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyPolicy,,1676174030338.6868bac373e3128a323294fb5686f080. 2023-02-12 03:56:06,773 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyPolicy,,1676174030338.6868bac373e3128a323294fb5686f080. 2023-02-12 03:56:06,773 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyPolicy,,1676174030338.6868bac373e3128a323294fb5686f080. after waiting 0 ms 2023-02-12 03:56:06,773 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyPolicy,,1676174030338.6868bac373e3128a323294fb5686f080. 2023-02-12 03:56:06,775 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyPolicy/6868bac373e3128a323294fb5686f080/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-02-12 03:56:06,776 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyPolicy,,1676174030338.6868bac373e3128a323294fb5686f080. 2023-02-12 03:56:06,776 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 6868bac373e3128a323294fb5686f080: Waiting for close lock at 1676174166772Running coprocessor pre-close hooks at 1676174166772Disabling compacts and flushes for region at 1676174166772Disabling writes for close at 1676174166773 (+1 ms)Writing region close event to WAL at 1676174166773Running coprocessor post-close hooks at 1676174166776 (+3 ms)Closed at 1676174166776 2023-02-12 03:56:06,776 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyPolicy,,1676174030338.6868bac373e3128a323294fb5686f080. 2023-02-12 03:56:06,776 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 4e8254a6d12aded099b366c106c6930d, disabling compactions & flushes 2023-02-12 03:56:06,776 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testCompactionWithHFileLink,,1676174084167.4e8254a6d12aded099b366c106c6930d. 2023-02-12 03:56:06,776 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testCompactionWithHFileLink,,1676174084167.4e8254a6d12aded099b366c106c6930d. 2023-02-12 03:56:06,776 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testCompactionWithHFileLink,,1676174084167.4e8254a6d12aded099b366c106c6930d. after waiting 0 ms 2023-02-12 03:56:06,776 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testCompactionWithHFileLink,,1676174084167.4e8254a6d12aded099b366c106c6930d. 2023-02-12 03:56:06,779 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testCompactionWithHFileLink/4e8254a6d12aded099b366c106c6930d/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-02-12 03:56:06,780 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testCompactionWithHFileLink,,1676174084167.4e8254a6d12aded099b366c106c6930d. 2023-02-12 03:56:06,780 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 4e8254a6d12aded099b366c106c6930d: Waiting for close lock at 1676174166776Running coprocessor pre-close hooks at 1676174166776Disabling compacts and flushes for region at 1676174166776Disabling writes for close at 1676174166776Writing region close event to WAL at 1676174166777 (+1 ms)Running coprocessor post-close hooks at 1676174166780 (+3 ms)Closed at 1676174166780 2023-02-12 03:56:06,780 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,,1676174084167.4e8254a6d12aded099b366c106c6930d. 2023-02-12 03:56:06,780 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 413323817eab6eca83ffbd861a4ef441, disabling compactions & flushes 2023-02-12 03:56:06,781 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region ns:testMinorCompaction,1,1676174113888.413323817eab6eca83ffbd861a4ef441. 2023-02-12 03:56:06,781 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on ns:testMinorCompaction,1,1676174113888.413323817eab6eca83ffbd861a4ef441. 2023-02-12 03:56:06,781 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on ns:testMinorCompaction,1,1676174113888.413323817eab6eca83ffbd861a4ef441. after waiting 0 ms 2023-02-12 03:56:06,781 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region ns:testMinorCompaction,1,1676174113888.413323817eab6eca83ffbd861a4ef441. 2023-02-12 03:56:06,784 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/413323817eab6eca83ffbd861a4ef441/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-02-12 03:56:06,786 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed ns:testMinorCompaction,1,1676174113888.413323817eab6eca83ffbd861a4ef441. 2023-02-12 03:56:06,786 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 413323817eab6eca83ffbd861a4ef441: Waiting for close lock at 1676174166780Running coprocessor pre-close hooks at 1676174166780Disabling compacts and flushes for region at 1676174166780Disabling writes for close at 1676174166781 (+1 ms)Writing region close event to WAL at 1676174166782 (+1 ms)Running coprocessor post-close hooks at 1676174166784 (+2 ms)Closed at 1676174166786 (+2 ms) 2023-02-12 03:56:06,786 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,1,1676174113888.413323817eab6eca83ffbd861a4ef441. 2023-02-12 03:56:06,786 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 11ce5e4ebf46f66d8a2278adef25cc7b, disabling compactions & flushes 2023-02-12 03:56:06,786 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testScannerOnBulkLoadRefHFiles,,1676174025214.11ce5e4ebf46f66d8a2278adef25cc7b. 2023-02-12 03:56:06,786 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,,1676174025214.11ce5e4ebf46f66d8a2278adef25cc7b. 2023-02-12 03:56:06,786 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testScannerOnBulkLoadRefHFiles,,1676174025214.11ce5e4ebf46f66d8a2278adef25cc7b. after waiting 0 ms 2023-02-12 03:56:06,786 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testScannerOnBulkLoadRefHFiles,,1676174025214.11ce5e4ebf46f66d8a2278adef25cc7b. 2023-02-12 03:56:06,795 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testScannerOnBulkLoadRefHFiles/11ce5e4ebf46f66d8a2278adef25cc7b/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-12 03:56:06,795 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testScannerOnBulkLoadRefHFiles,,1676174025214.11ce5e4ebf46f66d8a2278adef25cc7b. 2023-02-12 03:56:06,795 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 11ce5e4ebf46f66d8a2278adef25cc7b: Waiting for close lock at 1676174166786Running coprocessor pre-close hooks at 1676174166786Disabling compacts and flushes for region at 1676174166786Disabling writes for close at 1676174166786Writing region close event to WAL at 1676174166791 (+5 ms)Running coprocessor post-close hooks at 1676174166795 (+4 ms)Closed at 1676174166795 2023-02-12 03:56:06,796 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,,1676174025214.11ce5e4ebf46f66d8a2278adef25cc7b. 2023-02-12 03:56:06,796 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 008ac801462bd1c3f87556bf17bb0d46, disabling compactions & flushes 2023-02-12 03:56:06,796 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676174044109.008ac801462bd1c3f87556bf17bb0d46. 2023-02-12 03:56:06,796 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676174044109.008ac801462bd1c3f87556bf17bb0d46. 2023-02-12 03:56:06,796 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676174044109.008ac801462bd1c3f87556bf17bb0d46. after waiting 0 ms 2023-02-12 03:56:06,796 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676174044109.008ac801462bd1c3f87556bf17bb0d46. 2023-02-12 03:56:06,799 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/008ac801462bd1c3f87556bf17bb0d46/recovered.edits/58.seqid, newMaxSeqId=58, maxSeqId=55 2023-02-12 03:56:06,799 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676174044109.008ac801462bd1c3f87556bf17bb0d46. 2023-02-12 03:56:06,799 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 008ac801462bd1c3f87556bf17bb0d46: Waiting for close lock at 1676174166796Running coprocessor pre-close hooks at 1676174166796Disabling compacts and flushes for region at 1676174166796Disabling writes for close at 1676174166796Writing region close event to WAL at 1676174166796Running coprocessor post-close hooks at 1676174166799 (+3 ms)Closed at 1676174166799 2023-02-12 03:56:06,799 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1676174044109.008ac801462bd1c3f87556bf17bb0d46. 2023-02-12 03:56:06,799 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing d12646a520864c41bc260dbfbe486d5f, disabling compactions & flushes 2023-02-12 03:56:06,799 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1676173984659.d12646a520864c41bc260dbfbe486d5f. 2023-02-12 03:56:06,800 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1676173984659.d12646a520864c41bc260dbfbe486d5f. 2023-02-12 03:56:06,800 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1676173984659.d12646a520864c41bc260dbfbe486d5f. after waiting 0 ms 2023-02-12 03:56:06,800 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1676173984659.d12646a520864c41bc260dbfbe486d5f. 2023-02-12 03:56:06,800 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2744): Flushing d12646a520864c41bc260dbfbe486d5f 1/1 column families, dataSize=109 B heapSize=592 B 2023-02-12 03:56:06,923 DEBUG [RS:0;jenkins-hbase20:39639] regionserver.HRegionServer(1505): Waiting on 1588230740, 5a64d004db5bc34d6763997394073059, 61a9ec6d1e76a983beaae795490c1da9, 7a34b5c93155c75d8e84f8d88f767143, a73fcc0290683d7b4b64c0d6b697edf9, d12646a520864c41bc260dbfbe486d5f 2023-02-12 03:56:07,123 DEBUG [RS:0;jenkins-hbase20:39639] regionserver.HRegionServer(1505): Waiting on 1588230740, 5a64d004db5bc34d6763997394073059, 61a9ec6d1e76a983beaae795490c1da9, 7a34b5c93155c75d8e84f8d88f767143, a73fcc0290683d7b4b64c0d6b697edf9, d12646a520864c41bc260dbfbe486d5f 2023-02-12 03:56:07,135 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=48.34 KB at sequenceid=130 (bloomFilter=false), to=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/hbase/meta/1588230740/.tmp/info/0f45f5cea65147d79abf0d8d0e440767 2023-02-12 03:56:07,140 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0f45f5cea65147d79abf0d8d0e440767 2023-02-12 03:56:07,145 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=102 B at sequenceid=130 (bloomFilter=false), to=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/hbase/meta/1588230740/.tmp/rep_barrier/612e12b39c7b46cca28523c8eaebd7a9 2023-02-12 03:56:07,150 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 612e12b39c7b46cca28523c8eaebd7a9 2023-02-12 03:56:07,219 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=109 B at sequenceid=7 (bloomFilter=true), to=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/hbase/namespace/d12646a520864c41bc260dbfbe486d5f/.tmp/info/3812d8cd44744d23bcfa47a38af5650d 2023-02-12 03:56:07,224 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/hbase/namespace/d12646a520864c41bc260dbfbe486d5f/.tmp/info/3812d8cd44744d23bcfa47a38af5650d as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/hbase/namespace/d12646a520864c41bc260dbfbe486d5f/info/3812d8cd44744d23bcfa47a38af5650d 2023-02-12 03:56:07,229 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/hbase/namespace/d12646a520864c41bc260dbfbe486d5f/info/3812d8cd44744d23bcfa47a38af5650d, entries=3, sequenceid=7, filesize=4.8 K 2023-02-12 03:56:07,230 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~109 B/109, heapSize ~576 B/576, currentSize=0 B/0 for d12646a520864c41bc260dbfbe486d5f in 430ms, sequenceid=7, compaction requested=false 2023-02-12 03:56:07,235 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/hbase/namespace/d12646a520864c41bc260dbfbe486d5f/recovered.edits/10.seqid, newMaxSeqId=10, maxSeqId=1 2023-02-12 03:56:07,236 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1676173984659.d12646a520864c41bc260dbfbe486d5f. 2023-02-12 03:56:07,236 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for d12646a520864c41bc260dbfbe486d5f: Waiting for close lock at 1676174166799Running coprocessor pre-close hooks at 1676174166799Disabling compacts and flushes for region at 1676174166799Disabling writes for close at 1676174166800 (+1 ms)Obtaining lock to block concurrent updates at 1676174166800Preparing flush snapshotting stores in d12646a520864c41bc260dbfbe486d5f at 1676174166800Finished memstore snapshotting hbase:namespace,,1676173984659.d12646a520864c41bc260dbfbe486d5f., syncing WAL and waiting on mvcc, flushsize=dataSize=109, getHeapSize=576, getOffHeapSize=0, getCellsCount=3 at 1676174166800Flushing stores of hbase:namespace,,1676173984659.d12646a520864c41bc260dbfbe486d5f. at 1676174166800Flushing d12646a520864c41bc260dbfbe486d5f/info: creating writer at 1676174166800Flushing d12646a520864c41bc260dbfbe486d5f/info: appending metadata at 1676174166802 (+2 ms)Flushing d12646a520864c41bc260dbfbe486d5f/info: closing flushed file at 1676174166802Flushing d12646a520864c41bc260dbfbe486d5f/info: reopening flushed file at 1676174167225 (+423 ms)Finished flush of dataSize ~109 B/109, heapSize ~576 B/576, currentSize=0 B/0 for d12646a520864c41bc260dbfbe486d5f in 430ms, sequenceid=7, compaction requested=false at 1676174167230 (+5 ms)Writing region close event to WAL at 1676174167232 (+2 ms)Running coprocessor post-close hooks at 1676174167236 (+4 ms)Closed at 1676174167236 2023-02-12 03:56:07,236 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1676173984659.d12646a520864c41bc260dbfbe486d5f. 2023-02-12 03:56:07,236 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing a73fcc0290683d7b4b64c0d6b697edf9, disabling compactions & flushes 2023-02-12 03:56:07,236 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testMinorCompactionWithMonthlyPolicy,,1676174133254.a73fcc0290683d7b4b64c0d6b697edf9. 2023-02-12 03:56:07,236 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMinorCompactionWithMonthlyPolicy,,1676174133254.a73fcc0290683d7b4b64c0d6b697edf9. 2023-02-12 03:56:07,236 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testMinorCompactionWithMonthlyPolicy,,1676174133254.a73fcc0290683d7b4b64c0d6b697edf9. after waiting 0 ms 2023-02-12 03:56:07,236 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testMinorCompactionWithMonthlyPolicy,,1676174133254.a73fcc0290683d7b4b64c0d6b697edf9. 2023-02-12 03:56:07,240 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMinorCompactionWithMonthlyPolicy/a73fcc0290683d7b4b64c0d6b697edf9/recovered.edits/52.seqid, newMaxSeqId=52, maxSeqId=1 2023-02-12 03:56:07,240 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testMinorCompactionWithMonthlyPolicy,,1676174133254.a73fcc0290683d7b4b64c0d6b697edf9. 2023-02-12 03:56:07,240 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for a73fcc0290683d7b4b64c0d6b697edf9: Waiting for close lock at 1676174167236Running coprocessor pre-close hooks at 1676174167236Disabling compacts and flushes for region at 1676174167236Disabling writes for close at 1676174167236Writing region close event to WAL at 1676174167237 (+1 ms)Running coprocessor post-close hooks at 1676174167240 (+3 ms)Closed at 1676174167240 2023-02-12 03:56:07,240 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testMinorCompactionWithMonthlyPolicy,,1676174133254.a73fcc0290683d7b4b64c0d6b697edf9. 2023-02-12 03:56:07,241 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 61a9ec6d1e76a983beaae795490c1da9, disabling compactions & flushes 2023-02-12 03:56:07,241 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionFromAdmin,,1676174146717.61a9ec6d1e76a983beaae795490c1da9. 2023-02-12 03:56:07,241 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionFromAdmin,,1676174146717.61a9ec6d1e76a983beaae795490c1da9. 2023-02-12 03:56:07,241 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionFromAdmin,,1676174146717.61a9ec6d1e76a983beaae795490c1da9. after waiting 0 ms 2023-02-12 03:56:07,241 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionFromAdmin,,1676174146717.61a9ec6d1e76a983beaae795490c1da9. 2023-02-12 03:56:07,245 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testMajorCompactionFromAdmin/61a9ec6d1e76a983beaae795490c1da9/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-02-12 03:56:07,246 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testMajorCompactionFromAdmin,,1676174146717.61a9ec6d1e76a983beaae795490c1da9. 2023-02-12 03:56:07,246 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 61a9ec6d1e76a983beaae795490c1da9: Waiting for close lock at 1676174167241Running coprocessor pre-close hooks at 1676174167241Disabling compacts and flushes for region at 1676174167241Disabling writes for close at 1676174167241Writing region close event to WAL at 1676174167243 (+2 ms)Running coprocessor post-close hooks at 1676174167246 (+3 ms)Closed at 1676174167246 2023-02-12 03:56:07,246 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,,1676174146717.61a9ec6d1e76a983beaae795490c1da9. 2023-02-12 03:56:07,246 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 5a64d004db5bc34d6763997394073059, disabling compactions & flushes 2023-02-12 03:56:07,246 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region testScannerOnBulkLoadRefHFiles,2,1676174025214.5a64d004db5bc34d6763997394073059. 2023-02-12 03:56:07,247 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,2,1676174025214.5a64d004db5bc34d6763997394073059. 2023-02-12 03:56:07,247 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on testScannerOnBulkLoadRefHFiles,2,1676174025214.5a64d004db5bc34d6763997394073059. after waiting 0 ms 2023-02-12 03:56:07,247 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region testScannerOnBulkLoadRefHFiles,2,1676174025214.5a64d004db5bc34d6763997394073059. 2023-02-12 03:56:07,255 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/default/testScannerOnBulkLoadRefHFiles/5a64d004db5bc34d6763997394073059/recovered.edits/15.seqid, newMaxSeqId=15, maxSeqId=1 2023-02-12 03:56:07,256 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed testScannerOnBulkLoadRefHFiles,2,1676174025214.5a64d004db5bc34d6763997394073059. 2023-02-12 03:56:07,256 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 5a64d004db5bc34d6763997394073059: Waiting for close lock at 1676174167246Running coprocessor pre-close hooks at 1676174167246Disabling compacts and flushes for region at 1676174167246Disabling writes for close at 1676174167247 (+1 ms)Writing region close event to WAL at 1676174167251 (+4 ms)Running coprocessor post-close hooks at 1676174167256 (+5 ms)Closed at 1676174167256 2023-02-12 03:56:07,256 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,2,1676174025214.5a64d004db5bc34d6763997394073059. 2023-02-12 03:56:07,256 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1603): Closing 7a34b5c93155c75d8e84f8d88f767143, disabling compactions & flushes 2023-02-12 03:56:07,256 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1625): Closing region ns:testMinorCompaction,,1676174113888.7a34b5c93155c75d8e84f8d88f767143. 2023-02-12 03:56:07,256 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on ns:testMinorCompaction,,1676174113888.7a34b5c93155c75d8e84f8d88f767143. 2023-02-12 03:56:07,256 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1713): Acquired close lock on ns:testMinorCompaction,,1676174113888.7a34b5c93155c75d8e84f8d88f767143. after waiting 0 ms 2023-02-12 03:56:07,256 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1723): Updates disabled for region ns:testMinorCompaction,,1676174113888.7a34b5c93155c75d8e84f8d88f767143. 2023-02-12 03:56:07,262 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/ns/testMinorCompaction/7a34b5c93155c75d8e84f8d88f767143/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-02-12 03:56:07,263 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed ns:testMinorCompaction,,1676174113888.7a34b5c93155c75d8e84f8d88f767143. 2023-02-12 03:56:07,263 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 7a34b5c93155c75d8e84f8d88f767143: Waiting for close lock at 1676174167256Running coprocessor pre-close hooks at 1676174167256Disabling compacts and flushes for region at 1676174167256Disabling writes for close at 1676174167256Writing region close event to WAL at 1676174167259 (+3 ms)Running coprocessor post-close hooks at 1676174167262 (+3 ms)Closed at 1676174167262 2023-02-12 03:56:07,263 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,,1676174113888.7a34b5c93155c75d8e84f8d88f767143. 2023-02-12 03:56:07,323 DEBUG [RS:0;jenkins-hbase20:39639] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-12 03:56:07,524 DEBUG [RS:0;jenkins-hbase20:39639] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-12 03:56:07,559 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.18 KB at sequenceid=130 (bloomFilter=false), to=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/hbase/meta/1588230740/.tmp/table/21d2556746a842c08d9fb73f0e0be55a 2023-02-12 03:56:07,563 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 21d2556746a842c08d9fb73f0e0be55a 2023-02-12 03:56:07,564 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/hbase/meta/1588230740/.tmp/info/0f45f5cea65147d79abf0d8d0e440767 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/hbase/meta/1588230740/info/0f45f5cea65147d79abf0d8d0e440767 2023-02-12 03:56:07,568 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0f45f5cea65147d79abf0d8d0e440767 2023-02-12 03:56:07,568 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/hbase/meta/1588230740/info/0f45f5cea65147d79abf0d8d0e440767, entries=226, sequenceid=130, filesize=37.9 K 2023-02-12 03:56:07,571 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/hbase/meta/1588230740/.tmp/rep_barrier/612e12b39c7b46cca28523c8eaebd7a9 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/hbase/meta/1588230740/rep_barrier/612e12b39c7b46cca28523c8eaebd7a9 2023-02-12 03:56:07,576 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 612e12b39c7b46cca28523c8eaebd7a9 2023-02-12 03:56:07,576 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/hbase/meta/1588230740/rep_barrier/612e12b39c7b46cca28523c8eaebd7a9, entries=1, sequenceid=130, filesize=5.0 K 2023-02-12 03:56:07,577 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/hbase/meta/1588230740/.tmp/table/21d2556746a842c08d9fb73f0e0be55a as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/hbase/meta/1588230740/table/21d2556746a842c08d9fb73f0e0be55a 2023-02-12 03:56:07,581 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 21d2556746a842c08d9fb73f0e0be55a 2023-02-12 03:56:07,582 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/hbase/meta/1588230740/table/21d2556746a842c08d9fb73f0e0be55a, entries=27, sequenceid=130, filesize=6.6 K 2023-02-12 03:56:07,584 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~50.62 KB/51839, heapSize ~78.19 KB/80064, currentSize=0 B/0 for 1588230740 in 862ms, sequenceid=130, compaction requested=false 2023-02-12 03:56:07,615 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/data/hbase/meta/1588230740/recovered.edits/133.seqid, newMaxSeqId=133, maxSeqId=1 2023-02-12 03:56:07,615 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-12 03:56:07,615 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-12 03:56:07,615 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1676174166722Running coprocessor pre-close hooks at 1676174166722Disabling compacts and flushes for region at 1676174166722Disabling writes for close at 1676174166722Obtaining lock to block concurrent updates at 1676174166722Preparing flush snapshotting stores in 1588230740 at 1676174166722Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=51839, getHeapSize=80064, getOffHeapSize=0, getCellsCount=365 at 1676174166722Flushing stores of hbase:meta,,1.1588230740 at 1676174166723 (+1 ms)Flushing 1588230740/info: creating writer at 1676174166723Flushing 1588230740/info: appending metadata at 1676174166729 (+6 ms)Flushing 1588230740/info: closing flushed file at 1676174166729Flushing 1588230740/rep_barrier: creating writer at 1676174167140 (+411 ms)Flushing 1588230740/rep_barrier: appending metadata at 1676174167142 (+2 ms)Flushing 1588230740/rep_barrier: closing flushed file at 1676174167142Flushing 1588230740/table: creating writer at 1676174167150 (+8 ms)Flushing 1588230740/table: appending metadata at 1676174167152 (+2 ms)Flushing 1588230740/table: closing flushed file at 1676174167152Flushing 1588230740/info: reopening flushed file at 1676174167564 (+412 ms)Flushing 1588230740/rep_barrier: reopening flushed file at 1676174167571 (+7 ms)Flushing 1588230740/table: reopening flushed file at 1676174167577 (+6 ms)Finished flush of dataSize ~50.62 KB/51839, heapSize ~78.19 KB/80064, currentSize=0 B/0 for 1588230740 in 862ms, sequenceid=130, compaction requested=false at 1676174167584 (+7 ms)Writing region close event to WAL at 1676174167612 (+28 ms)Running coprocessor post-close hooks at 1676174167615 (+3 ms)Closed at 1676174167615 2023-02-12 03:56:07,616 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-12 03:56:07,724 INFO [RS:0;jenkins-hbase20:39639] regionserver.HRegionServer(1171): stopping server jenkins-hbase20.apache.org,39639,1676173982450; all regions closed. 2023-02-12 03:56:07,731 DEBUG [RS:0;jenkins-hbase20:39639] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/oldWALs 2023-02-12 03:56:07,731 INFO [RS:0;jenkins-hbase20:39639] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C39639%2C1676173982450.meta:.meta(num 1676173984415) 2023-02-12 03:56:07,735 DEBUG [RS:0;jenkins-hbase20:39639] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/oldWALs 2023-02-12 03:56:07,735 INFO [RS:0;jenkins-hbase20:39639] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C39639%2C1676173982450:(num 1676173983912) 2023-02-12 03:56:07,735 DEBUG [RS:0;jenkins-hbase20:39639] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 03:56:07,735 INFO [RS:0;jenkins-hbase20:39639] regionserver.LeaseManager(133): Closed leases 2023-02-12 03:56:07,736 INFO [RS:0;jenkins-hbase20:39639] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase20:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-12 03:56:07,736 INFO [regionserver/jenkins-hbase20:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-12 03:56:07,737 INFO [RS:0;jenkins-hbase20:39639] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:39639 2023-02-12 03:56:07,744 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,39639,1676173982450 2023-02-12 03:56:07,744 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 03:56:07,745 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-12 03:56:07,745 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase20.apache.org,39639,1676173982450] 2023-02-12 03:56:07,746 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase20.apache.org,39639,1676173982450; numProcessing=1 2023-02-12 03:56:07,747 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase20.apache.org,39639,1676173982450 already deleted, retry=false 2023-02-12 03:56:07,747 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase20.apache.org,39639,1676173982450 expired; onlineServers=0 2023-02-12 03:56:07,747 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase20.apache.org,40099,1676173981406' ***** 2023-02-12 03:56:07,747 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-12 03:56:07,748 DEBUG [M:0;jenkins-hbase20:40099] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@117d9e03, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-02-12 03:56:07,748 INFO [M:0;jenkins-hbase20:40099] regionserver.HRegionServer(1145): stopping server jenkins-hbase20.apache.org,40099,1676173981406 2023-02-12 03:56:07,748 INFO [M:0;jenkins-hbase20:40099] regionserver.HRegionServer(1171): stopping server jenkins-hbase20.apache.org,40099,1676173981406; all regions closed. 2023-02-12 03:56:07,748 DEBUG [M:0;jenkins-hbase20:40099] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-12 03:56:07,748 DEBUG [M:0;jenkins-hbase20:40099] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-12 03:56:07,748 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-12 03:56:07,748 DEBUG [M:0;jenkins-hbase20:40099] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-12 03:56:07,748 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1676173983531] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1676173983531,5,FailOnTimeoutGroup] 2023-02-12 03:56:07,748 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1676173983530] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1676173983530,5,FailOnTimeoutGroup] 2023-02-12 03:56:07,749 INFO [M:0;jenkins-hbase20:40099] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-12 03:56:07,749 INFO [M:0;jenkins-hbase20:40099] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-12 03:56:07,749 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-12 03:56:07,749 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-12 03:56:07,749 INFO [M:0;jenkins-hbase20:40099] hbase.ChoreService(369): Chore service for: master/jenkins-hbase20:0 had [] on shutdown 2023-02-12 03:56:07,750 DEBUG [M:0;jenkins-hbase20:40099] master.HMaster(1502): Stopping service threads 2023-02-12 03:56:07,750 INFO [M:0;jenkins-hbase20:40099] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-12 03:56:07,750 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-12 03:56:07,750 ERROR [M:0;jenkins-hbase20:40099] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-20,5,PEWorkerGroup] Thread[HFileArchiver-21,5,PEWorkerGroup] Thread[HFileArchiver-22,5,PEWorkerGroup] 2023-02-12 03:56:07,751 INFO [M:0;jenkins-hbase20:40099] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-12 03:56:07,751 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-12 03:56:07,751 DEBUG [M:0;jenkins-hbase20:40099] zookeeper.ZKUtil(398): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-12 03:56:07,751 WARN [M:0;jenkins-hbase20:40099] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-12 03:56:07,751 INFO [M:0;jenkins-hbase20:40099] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-12 03:56:07,751 INFO [M:0;jenkins-hbase20:40099] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-12 03:56:07,751 DEBUG [M:0;jenkins-hbase20:40099] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-12 03:56:07,752 INFO [M:0;jenkins-hbase20:40099] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 03:56:07,752 DEBUG [M:0;jenkins-hbase20:40099] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 03:56:07,752 DEBUG [M:0;jenkins-hbase20:40099] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-12 03:56:07,752 DEBUG [M:0;jenkins-hbase20:40099] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 03:56:07,752 INFO [M:0;jenkins-hbase20:40099] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=513.50 KB heapSize=599.70 KB 2023-02-12 03:56:07,760 INFO [M:0;jenkins-hbase20:40099] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=513.50 KB at sequenceid=1011 (bloomFilter=true), to=hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/b986e612f79342fb99b4b7b202c47323 2023-02-12 03:56:07,764 INFO [M:0;jenkins-hbase20:40099] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b986e612f79342fb99b4b7b202c47323 2023-02-12 03:56:07,765 DEBUG [M:0;jenkins-hbase20:40099] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/b986e612f79342fb99b4b7b202c47323 as hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/b986e612f79342fb99b4b7b202c47323 2023-02-12 03:56:07,768 INFO [M:0;jenkins-hbase20:40099] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b986e612f79342fb99b4b7b202c47323 2023-02-12 03:56:07,768 INFO [M:0;jenkins-hbase20:40099] regionserver.HStore(1080): Added hdfs://localhost.localdomain:44635/user/jenkins/test-data/6ad1b6ca-3b0a-1f17-bdca-12ff779724de/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/b986e612f79342fb99b4b7b202c47323, entries=123, sequenceid=1011, filesize=33.3 K 2023-02-12 03:56:07,769 INFO [M:0;jenkins-hbase20:40099] regionserver.HRegion(2947): Finished flush of dataSize ~513.50 KB/525825, heapSize ~599.69 KB/614080, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 17ms, sequenceid=1011, compaction requested=false 2023-02-12 03:56:07,769 INFO [M:0;jenkins-hbase20:40099] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-12 03:56:07,769 DEBUG [M:0;jenkins-hbase20:40099] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1676174167751Disabling compacts and flushes for region at 1676174167751Disabling writes for close at 1676174167752 (+1 ms)Obtaining lock to block concurrent updates at 1676174167752Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1676174167752Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=525825, getHeapSize=614080, getOffHeapSize=0, getCellsCount=1166 at 1676174167752Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1676174167752Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1676174167752Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1676174167755 (+3 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1676174167755Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1676174167765 (+10 ms)Finished flush of dataSize ~513.50 KB/525825, heapSize ~599.69 KB/614080, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 17ms, sequenceid=1011, compaction requested=false at 1676174167769 (+4 ms)Writing region close event to WAL at 1676174167769Closed at 1676174167769 2023-02-12 03:56:07,772 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-12 03:56:07,772 INFO [M:0;jenkins-hbase20:40099] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-12 03:56:07,772 INFO [M:0;jenkins-hbase20:40099] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:40099 2023-02-12 03:56:07,774 DEBUG [M:0;jenkins-hbase20:40099] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase20.apache.org,40099,1676173981406 already deleted, retry=false 2023-02-12 03:56:07,846 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 03:56:07,847 INFO [RS:0;jenkins-hbase20:39639] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase20.apache.org,39639,1676173982450; zookeeper connection closed. 2023-02-12 03:56:07,847 ERROR [Listener at localhost.localdomain/41049-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@28ed7039 rejected from java.util.concurrent.ThreadPoolExecutor@2cd2e1fc[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 534] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 03:56:07,847 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): regionserver:39639-0x10154d0f56d0001, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 03:56:07,847 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@6cf4c8a2] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@6cf4c8a2 2023-02-12 03:56:07,847 ERROR [Listener at localhost.localdomain/41049-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1bdcf35e rejected from java.util.concurrent.ThreadPoolExecutor@2cd2e1fc[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 534] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 03:56:07,847 INFO [Listener at localhost.localdomain/41049] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 1 regionserver(s) complete 2023-02-12 03:56:07,947 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 03:56:07,947 INFO [M:0;jenkins-hbase20:40099] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase20.apache.org,40099,1676173981406; zookeeper connection closed. 2023-02-12 03:56:07,947 ERROR [Listener at localhost.localdomain/41049-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6cefa9b5 rejected from java.util.concurrent.ThreadPoolExecutor@23acfea9[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 906] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 03:56:07,947 DEBUG [Listener at localhost.localdomain/41049-EventThread] zookeeper.ZKWatcher(600): master:40099-0x10154d0f56d0000, quorum=127.0.0.1:59556, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-12 03:56:07,947 ERROR [Listener at localhost.localdomain/41049-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6d06b862 rejected from java.util.concurrent.ThreadPoolExecutor@23acfea9[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 906] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-12 03:56:07,948 WARN [Listener at localhost.localdomain/41049] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-12 03:56:07,952 INFO [Listener at localhost.localdomain/41049] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-12 03:56:08,075 WARN [BP-1387251289-148.251.75.209-1676173977617 heartbeating to localhost.localdomain/127.0.0.1:44635] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-12 03:56:08,076 WARN [BP-1387251289-148.251.75.209-1676173977617 heartbeating to localhost.localdomain/127.0.0.1:44635] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1387251289-148.251.75.209-1676173977617 (Datanode Uuid 6d5619e5-9e10-46fd-8c6c-bb1351f6f414) service to localhost.localdomain/127.0.0.1:44635 2023-02-12 03:56:08,078 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3c8cff1a-3314-a11f-82b4-27989886696f/cluster_8d46982c-f2f0-5a04-0a7b-ed62cf4de184/dfs/data/data1/current/BP-1387251289-148.251.75.209-1676173977617] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-12 03:56:08,078 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/3c8cff1a-3314-a11f-82b4-27989886696f/cluster_8d46982c-f2f0-5a04-0a7b-ed62cf4de184/dfs/data/data2/current/BP-1387251289-148.251.75.209-1676173977617] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-12 03:56:08,106 INFO [Listener at localhost.localdomain/41049] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost.localdomain:0 2023-02-12 03:56:08,254 INFO [Listener at localhost.localdomain/41049] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-12 03:56:08,386 INFO [Listener at localhost.localdomain/41049] hbase.HBaseTestingUtility(1293): Minicluster is down